✨ AI Summary
We are seeking an experienced Big Data Engineer to design, build, and maintain scalable data pipelines using Spark, Hadoop, and Kafka. The role requires strong programming skills (Java, Scala, Python) and hands-on experience with cloud platforms (AWS, Azure, GCP) and data stores (HDFS, S3, BigQuery). You will collaborate with data scientists and IT, ensure data quality and timely delivery, optimize storage for performance and cost, and document architectures and processes. A minimum of 3 years in data engineering is required; knowledge of ETL tools, data governance, and container technologies (Docker, Kubernetes) is preferred. Strong communication, problem-solving, and an analytical mindset are essential for success in this role. The position is full-time and requires the ability to work across cloud and on-prem environments.
Requirements
Requirements: Bachelor's degree in Computer Science, Information Technology, or a related field. 3+ years of experience as a Big Data Engineer or in a similar data engineering role. Proficiency in big data technologies such as Apache Spark, Hadoop, and Apache Kafka. Strong coding skills in programming languages like Java, Scala, or Python. Familiarity with data processing frameworks and ETL tools. Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and data storage solutions (e.g., HDFS, S3, BigQuery). Analytical mindset and excellent problem-solving abilities. Strong communication skills to collaborate effectively with technical and non-technical stakeholders. A self-motivated and proactive approach to work, with the ability to manage multiple tasks and deadlines. Preferred Qualifications: Experience with machine learning frameworks and algorithms is a plus. Knowledge of data governance and security best practices. Familiarity with containerization technologies and orchestration tools like Docker and Kubernetes.
Description
Müller’s Solutions is looking for an experienced Big Data Engineer to join our innovative team. In this role, you will be responsible for designing and developing scalable big data solutions that enable advanced analytics and insights across the organization. You will work with large data sets and utilize cutting-edge technologies to ensure data processing is efficient and reliable.Key Responsibilities: Design, build, and maintain scalable data pipelines using big data technologies such as Apache Spark, Hadoop, and Kafka. Collaborate with data scientists, analysts, and IT teams to identify data requirements and deliver solutions that meet business needs. Ensure high data quality and integrity by implementing robust data validation and testing processes. Optimize data storage solutions for performance and cost-efficiency across cloud and on-premises environments. Monitor and troubleshoot data processing workflows to ensure timely data delivery. Document data architectures, processes, and workflows for knowledge sharing and compliance. Stay ahead of industry trends and best practices in big data technologies and methodologies.