Senior Azure Data Engineer

We are looking for a Senior Azure Data Engineer to join our team and drive the development and optimization of scalable data solutions in the cloud. The ideal candidate will have deep expertise in Py. Spark, strong experience with Azure Data Factory and Synapse, and a solid background in modern DevOps practices.

Responsibilities

Design, develop and optimize large-scale data processing solutions with Py. Spark Implement and maintain advanced data pipelines and workflows in Azure Data Factory and Azure Synapse Develop, automate and monitor development and build pipelines for robust data engineering solutions Collaborate with cross-functional teams to deliver scalable and reliable data solutions Apply best practices for code optimization, version control with Git and infrastructure automation Integrate Azure Functions for data orchestration and transformation tasks Contribute to infrastructure setup and automation using Terraform Document solutions and mentor junior team members Requirements Minimum 8 years’ experience in data engineering Expertise in Py.

Spark with a focus on writing optimized and scalable code Background in Azure Data Factory and Azure Synapse for data integration and orchestration Skills in Azure services and Azure Functions Experience designing and managing development and build pipelines in cloud environments Proficiency in Git for version control and collaboration Familiarity with Terraform for infrastructure automation Qualifications in integrating Azure Functions into data workflows Knowledge of building development and build pipelines Advanced knowledge of Azure DevOps, CI/CD and infrastructure as code tools Competency in problem-solving, communication and documentation skills