Data Engineer – Databricks (IBU Consumer)

Build and maintain scalable data pipelines on Databricks for consumer-facing IBU data products. Develop ETL/ELT pipelines using Py. Spark, Spark SQL and Delta Lake Implement medallion architecture (bronze/silver/gold), Unity Catalog and Workflows Optimize cluster performance and cost; monitor and troubleshoot jobs in production Requirements Must have: 4+ yrs data engineering, Databricks, Py.

Spark, SQL, Git/CI-CD.

Nice to have

pharma/consumer data, Databricks certification