✨ AI Summary
We are seeking a Senior Data Engineer to join our team in Abu Dhabi, UAE. This onsite role involves migrating a large-scale data platform using modern technologies and building production-ready pipelines with PySpark and SQL on Databricks. Responsibilities include re-engineering transformation logic, designing data validation and reconciliation processes, tuning performance, contributing to medallion-layer design, implementing data quality frameworks, and mentoring junior engineers within a CI/CD and Agile environment.
Candidates must have 7+ years of data engineering experience, strong proficiency with Databricks, PySpark, SQL, and Delta Lake, and in-depth knowledge of ingestion patterns, Spark performance tuning, and partitioning strategies. Solid SQL expertise, experience in data migration projects, and professional English communication skills are required, along with a Bachelor's degree in a relevant field. Nice-to-haves include Databricks certification, familiarity with Palantir Foundry, and background in financial services or asset management.
🎁 Benefits & Perks
End of service gratuity, Private healthcare and life insurance, Employee assistance program, Wellness program, Annual air travel allowance for expatriates, Regular performance feedback and salary reviews, Global travel medical and accident insurance, Referral bonuses, Learning and development opportunities including in-house training and coaching, professional certifications, and courses.
Requirements
Requires 7+ years of data engineering experience with strong proficiency in Databricks, PySpark, SQL, and Delta Lake. Must have in-depth knowledge of ingestion patterns, Spark performance tuning, and partitioning strategies. Experience in data migration projects and professional-level English communication skills are essential. A Bachelor's degree in computer science, information technology, or a related field is required.
Description
We're looking for a Senior Data Engineer to join our team in Abu Dhabi, United Arab Emirates in an onsite working mode. This role involves working on a large-scale data platform migration using modern data technologies and building production-ready pipelines in a dynamic delivery environment. You will be part of a dedicated engineering team focused on high-impact work that requires strong hands-on expertise.ResponsibilitiesBuild, optimize and productionize data pipelines on Databricks using PySpark and SQL Re-engineer and migrate transformation logic from a legacy platform to Databricks Design and perform data validation and reconciliation to ensure accuracy across platforms Tune performance through partitioning, Delta optimization, cluster configuration and ingestion strategies Contribute to medallion-layer design and implement data quality frameworks Review code and mentor junior engineers to promote best practices Work within Git-based CI/CD setups and follow Agile delivery processes Requirements7+ years of data engineering experience with recent hands-on delivery Strong proficiency with Databricks platform, PySpark, SQL and Delta Lake In-depth knowledge of ingestion patterns, Spark performance tuning and partitioning strategies Solid SQL expertise with practical ability to write and validate queries Experience in data migration or re-platforming projects Professional-level English communication skills Bachelor's degree in computer science, information technology or a related field Nice to haveDatabricks Certified Data Engineer Professional certification Familiarity with Palantir Foundry Background in financial services or asset management Experience with Unity Catalog governance Knowledge of large-scale data quality or reconciliation frameworksWe offerEnd of service gratuityPrivate healthcare and life insuranceEmployee assistance programWellness programAnnual air travel allowance for expatriatesRegular performance feedback and salary reviewsGlobal travel medical and accident insuranceReferral bonusesLearning and development opportunities including in-house training and coaching, professional certifications, and courses