Senior Databricks Lead

🏢 Cognizant Consulting
📍 Abu Dhabi, United Arab EmiratesFull-timeOn-site
📅 Posted: 2w ago🔄 Updated: 2w ago
CV%
✨ AI Summary
We are seeking a Senior Databricks Lead Engineer to spearhead next-generation platform upgrades, establish best practices, and lead delivery within our Lakehouse ecosystem. This role requires extensive experience in leading major Databricks transformations, with a focus on influencing architecture, engineering standards, and team direction. Key responsibilities include modernizing the Databricks platform, adopting advanced features, designing and delivering Lakeflow jobs and pipelines, implementing Unity Catalog, DQX, DB Genie, and AI/BI workloads, and establishing engineering best practices and automation frameworks. The role also involves mentoring teams and guiding technical decisions.
Required Skills
Other
SynapseDBRLakeflowDB GenieDQX
Information Technology
Data Engineering & Analytics
Requirements
Requires 7+ years in data/platform engineering with deep Databricks expertise, strong hands-on experience with Pyspark, DBR, Lakeflow, UC, DQX, DB Genie, Delta Lake, and experience with ADF, Synapse, and Azure DevOps. Proven leadership in large-scale Databricks or Lakehouse transformation projects is essential, along with strong problem-solving and leadership abilities.
Description
We're looking for a seasoned Databricks Lead Engineer to drive next‑gen platform uplift, define best practices, and lead delivery across our Lakehouse ecosystem. This role is for someone who has led major Databricks transformations with the individual contribution and can influence architecture, engineering standards, and team direction.ResponsibilitiesLead modernization of Databricks platform and adoption of advanced features.Design and deliver Lakeflow jobs, pipelines, and scalable Lakehouse solutions.Implement and optimize Unity Catalog, DQX, DB Genie, AI/BI workloads.Establish engineering best practices, governance, and automation frameworks.Along with the individual contribution, mentor teams and guide technical decision‑making across the organization.Requirements7+ years in data/platform engineering with deep Databricks expertiseStrong Hands‑on experience with Pyspark, DBR, Lakeflow, UC, DQX, DB Genie, Delta LakeExperienced in ADF, Synapse and exposure to Azure DevOPsProven leadership in large‑scale Databricks or Lakehouse transformation projectsStrong out of the box thinking, problem‑solving, and deliverables leadershipAbility to set direction, challenge assumptions, and drive outcome
✨ Premium Match Details
Deep-dive CV analysis, customized Cover Letters, and Interview prep!
📊 Match Analysis
Insights against your active CV
📊
Personalized Match Analysis
Upload your CV to see exact matching percentages, detailed skills mapping, and gap analysis for this role.
🎯 Overalli74%
⚡ Skillsi85%
View Breakdown
Ontology Match: 85.0
Matched:✓ Requirements Matching✓ Ontology Skills Mapping
📜 Eligibilityi49%
View Breakdown
Local: 19600%
🏗️ Career Fiti91%
View Breakdown
Seniority: 91.0
📋 Requirementsi67%
View Breakdown
Domain: 67.0
🔥 Motivationi78%
View Breakdown
Title Fit: 78.00