Senior Data Engineer

Job Description – Senior Data Engineer Role Overview We are seeking a highly skilled Senior Data Engineer to design, build, and optimize scalable data pipelines and data platforms. The ideal candidate will have strong expertise in big data technologies, cloud-based data engineering, and modern data lakehouse architectures.

Key Responsibilities

Design, develop, and maintain scalable data pipelines using Py. Spark and Databricks Build and manage data ingestion and orchestration workflows using Azure Data Factory (ADF) Perform complex data transformations and optimization using SQL and Py. Spark Implement and manage Delta Lake for reliable, high-performance data storage Develop and maintain data models (fact and dimension tables) for analytics and reporting Handle large-scale data processing, ensuring performance, scalability, and reliability Collaborate with cross-functional teams including data analysts, data scientists, and business stakeholders Ensure data quality, consistency, and governance across pipelines Required Skills Strong experience in Py.

Spark and Databricks Hands-on experience with Azure Data Factory (ADF) Proficiency in SQL and data transformation techniques Experience with Delta Lake and Lakehouse architecture Good understanding of data modeling (fact/dimension design) Experience handling large-scale data processing Requirements Preferred Qualifications (Nice to Have) Experience with streaming frameworks (Kafka / Structured Streaming) Knowledge of Azure ecosystem (ADLS, Key Vault, Synapse) Familiarity with data governance and security practices Experience in performance tuning and optimization in Spark