Job description
We are seeking a skilled Azure Data Engineer to design, develop, and maintain scalable cloud-based data solutions on the Microsoft Azure platform. The ideal candidate will have expertise in data integration, ETL/ELT pipelines, big data technologies, and cloud data warehousing to support analytics and business intelligence initiatives.
Key Responsibilities
Design and implement scalable data pipelines using Azure services. Develop and maintain ETL/ELT workflows for structured and unstructured data. Build and optimize data solutions using Azure cloud technologies. Integrate data from multiple sources including APIs, databases, flat files, and streaming platforms. Create and manage data lakes, data warehouses, and medallion architectures.
Ensure data quality, governance, security, and compliance standards. Monitor and troubleshoot production data workflows and performance issues. Collaborate with data analysts, DevOps, and business stakeholders. Implement CI/CD pipelines and infrastructure automation for data platforms. Optimize SQL queries and improve overall data processing performance.
Requirements
Azure Data Factory (ADF) Azure Databricks Azure Synapse Analytics Azure Data Lake Storage (ADLS) Azure SQL Database Azure Functions Azure Event Hub / Service Bus Proficiency in: SQL Python / Py. Spark Scala (optional) Experience with: ETL/ELT pipeline development Data modeling and warehousing concepts Spark-based distributed processing REST APIs and data integration Git, CI/CD, and DevOps practices Benefits Standard Company Benefits