Senior Data Engineer - Palantir Foundry

We are seeking a Senior Data Engineer to lead the design, implementation, and optimization of enterprise-scale data solutions using Palantir Foundry or Databricks, bringing deep technical expertise in data engineering and strong analytical capabilities to guide delivery teams in developing high-performance data products.

Responsibilities

Design and implement scalable data pipelines and reusable data products Lead the development of complex data transformation frameworks using Py. Spark and SQL Define and promote data engineering best practices across delivery squads Drive performance tuning, data quality improvements, and operational reliability initiatives Optimize large-scale processing workloads and data models Establish monitoring, observability, and troubleshooting standards Provide technical guidance and mentorship to junior and intermediate data engineers Collaborate with architects and business stakeholders on solution design and delivery planning Contribute to platform governance, standards, and engineering excellence initiatives Translate business requirements into scalable technical solutions Support delivery of enterprise analytics and reporting capabilities Requirements Extensive experience (3+ years) in Palantir Foundry Data Engineering or Databricks Expertise in Py.

Spark and SQL Proven experience designing large-scale ETL/ELT pipelines and data architectures Knowledge of distributed data processing and performance optimization Experience leading technical delivery within data engineering teams Understanding of data modeling, governance, and data quality practices English proficiency at B2 level or higher Nice to have Experience with both Palantir Foundry and Databricks Background in reinsurance or insurance industry processes, particularly finance-related data domains Experience working in complex enterprise environments Knowledge of cloud-native analytics and data platforms