Lead Python Data Engineer

We are in search of a skilled Lead Python Data Engineer to join our team. The successful candidate will play a crucial role in developing data pipelines in Azure, with a primary focus on building a Data Quality framework.

Responsibilities

Develop and maintain data pipelines in Azure, with a specific focus on DQ framework development Collaborate with cross-functional teams to design, develop, and implement data solutions Create and implement data models and processes for data extraction, transformation, and loading Optimize and monitor data pipeline performance and reliability Ensure data quality and integrity throughout the data pipeline process Troubleshoot and resolve data pipeline issues in a timely manner Contribute to the continuous improvement of data engineering best practices Provide technical guidance and support to team members as necessary Requirements Minimum of 5 years of experience in Data Software Engineering 1+ years of relevant leadership experience Proficiency in Python and hands-on experience with Azure Data Factory Strong understanding and practical knowledge of Databricks Ability to design, develop, and maintain scalable data pipelines Solid understanding of data modeling, data access, and data storage techniques Experience with data pipeline orchestration and workflow management Strong analytical and problem-solving abilities Excellent written and verbal communication skills B2+ English level proficiency