✨ AI Summary
Quantum Talent Group is hiring a Senior Data Engineer for a leading company establishing a technology Delivery Hub in Egypt. The role involves designing, building, and optimizing scalable data platforms and pipelines using Azure Data Factory, Microsoft Fabric, and Delta Lake to support data, AI, and automation solutions. Key responsibilities include developing complex data transformations with Python and advanced SQL, ingesting data from various sources, designing data models, implementing data quality checks, optimizing performance, and applying software engineering principles to data development.
The ideal candidate will have 5-8+ years of professional data engineering experience, with strong hands-on skills in Azure Data Factory/Microsoft Fabric, advanced SQL, Python for data processing, Delta Lake, and building ETL/ELT pipelines. Experience with data modeling, data warehousing, CI/CD for data pipelines, and mentoring junior engineers is also required. Desirable experience includes Azure Databricks, PySpark, Azure Data Lake Storage, data governance, Power BI, and supporting machine learning or generative AI use cases.
🎁 Benefits & Perks
This opportunity offers the chance to join a newly established technology Delivery Hub at an early stage, develop solutions using modern Azure, Fabric, and Lakehouse technologies, and influence engineering standards and technical culture.
Requirements
Requires 5-8+ years of professional data engineering experience with strong hands-on experience in Azure Data Factory and/or Microsoft Fabric. Must have advanced SQL skills, strong Python development experience for data processing, practical experience with Delta Lake and modern Lakehouse architecture, and experience building production-grade ETL/ELT pipelines. A strong understanding of data modeling, data warehousing, integration patterns, and experience implementing CI/CD for data pipelines is also essential.
Description
****We're Hiring for a Senior Data Engineer****Location: New Cairo, Egypt (On-site)Experience: 5–8 yearsWe are supporting a leading company in establishing a specialized technology Delivery Hub in Egypt. The new hub will act as a regional technology engine, delivering enterprise-scale data, AI and intelligent automation solutions. It will also establish a sustainable Center of Excellence for AI and advanced analytics.We are looking for a hands-on Senior Data Engineer to design, build and optimize scalable data platforms and pipelines that support analytics, reporting, machine learning and enterprise AI solutions.Key responsibilities:Design, develop and maintain reliable, scalable data pipelines using Azure Data Factory and/or Microsoft Fabric.Build modern Lakehouse and data-processing solutions using Delta Lake.Develop complex data transformations and integrations using Python and advanced SQL.Ingest and integrate structured and unstructured data from multiple enterprise sources.Design efficient data models and analytics-ready datasets.Implement data-quality checks, validation controls, monitoring and alerting.Optimize pipelines and queries for performance, scalability and cost.Apply software-engineering principles to data development, including modularity, testing, documentation and code reviews.Build and maintain CI/CD pipelines for automated testing and deployment of data solutions.Troubleshoot data-pipeline failures and resolve production issues.Mentor junior engineers and support technical knowledge sharing.Requirements:5-8+ years of professional data-engineering experience.Strong hands-on experience with Azure Data Factory and/or Microsoft Fabric.Advanced SQL skills, including complex queries, performance optimization and data transformation.Strong Python development experience for data-processing and automation workloads.Practical experience with Delta Lake and modern Lakehouse architecture.Experience building production-grade ETL and ELT pipelines.Strong understanding of data modelling, data warehousing and integration patterns.Experience implementing CI/CD for data pipelines and data-platform components.Desirable experience:Azure Databricks, PySpark or Apache Spark.Azure Data Lake Storage and other Azure data services.Data governance, cataloguing, lineage and data-quality frameworks.Power BI or downstream analytics integration.Experience supporting machine-learning, generative-AI or advanced-analytics use cases.Why consider this opportunityJoin a newly established technology Delivery Hub at an early and influential stage.Develop solutions using modern Azure, Fabric and Lakehouse technologies.Influence engineering standards, delivery practices and the technical culture of a growing team.Interested candidates are invited to apply with an up-to-date CV or contact me directly for a confidential discussion.