Data Engineer

Duties and Responsibilities

Design, build, and maintain data transformation pipelines to produce business-ready datasets to stakeholders. Document data pipelines, data models, and data transformation processes. Collaborate with business stakeholders teams to identify and understand data requirements for various business needs. Required Skills/Qualifications: Experience with Python and Scala.

Experience with big data processing frameworks such as Spark, Flink, or Ray. Experience with dimensional modeling. Experience on building large scale distributed systems in AWS or a similar cloud provider. Experience using AI (e.g., Claude) to accelerate workflows. Experience with data orchestration tools like Airflow or Dagster.

Experience with infrastructure-as-code tools (e.g., Terraform) and modern CI/CD pipelines.