Job description
Job Title: Azure Data Engineer (ADF, Databricks, PySpark) Duration: 12 Months Work Model: Hybrid (2 days/week onsite) Experience: 4–6 Years Required Skills Strong hands-on experience with Azure Data Factory (ADF), Azure Databricks (ADB), PySpark, and SQL. Experience designing, developing, and maintaining ETL frameworks and data pipelines.
Expertise in building scalable and efficient data integration solutions. Strong SQL querying and performance optimization skills.
Preferred Skills
3–5 years of Data Analysis experience. Knowledge of Azure Big Data technologies, data mapping, reporting, and data warehousing concepts. Experience with MySQL, SQL Developer, TOAD, Jira, and Confluence. Familiarity with data encryption, logging, monitoring, and security tools.
Key Responsibilities
Design, develop, and support ETL frameworks and enterprise data pipelines. Build and optimize data solutions using ADF, Databricks, PySpark, and SQL. Perform data mapping, transformation, validation, and reporting activities. Ensure data quality, security, scalability, and performance across platforms. Collaborate with business and technical teams to deliver data-driven solutions.
Support Agile delivery processes using Jira and Confluence. Monitor data workflows, troubleshoot issues, and implement improvements. Keywords: Azure Data Factory, Azure Databricks, PySpark, SQL, ETL, Data Engineering, Azure Big Data, Data Warehousing, Data Mapping, MySQL, TOAD, SQL Developer, Jira, Confluence.