Senior Azure Data Engineer

We are seeking a Senior Azure Data Engineer to join our software, system, and test engineering team. The role focuses on building and maintaining resilient data pipelines and processing systems for a large user base. Your contributions will ensure our data solutions align with business demands and maintain high industry standards.

You will coordinate with architects, tech leads, and team members to deliver on product objectives. If you bring expertise in Azure DevOps, Databricks, and designing scalable data solutions, we encourage you to apply and make an impact through innovative projects.

Responsibilities

Build and maintain data pipelines alongside large-scale customer-focused processing systems Establish data frameworks to provide stable and reliable operations Ensure data solutions adhere to business requirements and industry standards Recommend strategies to boost data quality, efficiency, and reliability Collaborate with system architects, technical leads, and team members to achieve aligned goals Deploy Databricks workflows using Databricks Asset Bundles Support scalable data platforms designed for a broad user base Write Python scripts to automate data processes and improve performance Oversee Azure DevOps CI/CD pipelines and associated deployment tools Requirements Background in data DevOps engineering with a minimum of 3 years of practical experience Knowledge of Azure DevOps CI/CD pipelines, Terraform, and deployment strategies for large infrastructures Expertise in deploying Databricks workflows using Databricks Asset Bundles Competency in developing data pipelines on Azure Databricks with Spark Capability to design and sustain scalable data platforms for large-scale consumers Proficiency in Python programming Skills in collaboration to work effectively with architects and other technical professionals English competency at an intermediate level or higher Nice to have Experience in creating preliminary prototypes for new product functionalities Background in designing data set processes for governance, production, and data modeling Familiarity with multiple programming languages and tools for seamless system integration