Data Engineer with Python

We are seeking an experienced and highly motivated Data Engineer to join our expanding Data Engineering practice. This role will enhance one of our established Platform Teams, where you will design, construct, and scale data pipelines using Databricks with Py. Spark on Microsoft Azure, enabling our AI Factory teams to create and deploy advanced machine learning solutions.

This position offers a unique opportunity to work at the crossroads of big data, cloud frameworks, and MLOps, delivering durable, scalable, and efficient data platforms that promote innovation throughout the organization.

Responsibilities

Design analytical solutions using Cloud Native, Big Data, and NoSQL technologies Build scalable data pipelines with Databricks and Py. Spark on Azure Collaborate with MLOps and ML Engineering teams to deliver robust data platforms for AI model development and deployment Work alongside architects, technical leads, and cross-functional teams to align solutions with business objectives Assist the SAP Platform Team in utilizing SAP BTP and hyperscaler services for enterprise-grade data platforms Conduct and participate in code reviews to ensure adherence to technical standards and best practices Mentor junior engineers to cultivate an innovative and high-performance engineering culture Implement CI/CD practices into data workflows using tools like Jenkins, GitLab CI/CD, and Concourse Facilitate communication with stakeholders to understand business processes, model input data, and deliver aligned solutions Requirements Minimum of 2 years' experience in Software Engineering with a solid background in Data Engineering, Machine Learning Operations, or Machine Learning Expertise in Python and Py.

Spark Familiarity with Databricks and Microsoft Azure cloud services Strong knowledge of software version control tools like GitHub or Git Background in CI/CD tools such as Jenkins, GitLab CI/CD, or Concourse Proven capability to deliver scalable, robust, and highly available data solutions Competency in problem-solving, analytical thinking, and managing stakeholder relationships Nice to have Skills in another programming language such as Java, SQL, or Scala Understanding of SAP BTP or comparable enterprise data platforms Background in agile development methodologies