4,305 open roles
Senior Data Engineer
Job description
We are looking for a Senior Data Engineer to design and deliver scalable data pipelines and high-performance analytical solutions using SQL/Big. Query, Spark/Py. Spark, and Python on Google Cloud. This role focuses on building reliable, cloud-native data products that enable advanced reporting, analytics, and decision-making across the organization.
Responsibilities
Design and deliver batch and real-time ETL/ELT pipelines across cloud environments to support analytics and reporting Write and optimize advanced SQL transformations and build performant, cost-efficient Big. Query data models Implement scalable data processing solutions using Python and Py. Spark, ensuring maintainable and high-quality code Build robust data models and apply validation practices to maintain accuracy and reliability Use GCP services such as Big.
Query, Dataflow, Cloud Composer, Pub/Sub, and GCS to build and operate modern data platforms Troubleshoot complex pipeline issues and continuously improve compute, storage, and processing performance Collaborate with engineering, analytics, and business teams while contributing to CI/CD, code reviews, and testing standards Requirements 5+ years of experience as a Data Engineer, building scalable data pipelines and working with cloud-based data ecosystems Expertise in SQL and hands-on experience building performant datasets in Big.
Query or similar cloud data warehouses Proficiency in Python and Py. Spark for scalable data processing in distributed environments Understanding of data modeling, ELT/ETL patterns, and data quality best practices Familiarity with Google Cloud Platform, particularly Big. Query, Dataflow, and Cloud Composer, GCS, or equivalent cloud data services Background in building scalable data pipelines, both batch and near real-time, in a cloud-native environment Proficiency with version control, CI/CD pipelines, and automated testing frameworks Capability to troubleshoot and optimize performance across compute, storage, and processing layers Nice to have Experience with Infrastructure-as-Code, including Terraform, Ansible, and Chef Knowledge of shell scripting Experience in financial services or regulated environments
Description copied from EPAM Systems's careers page. Read the full posting before you apply.
More jobs at EPAM Systems
Senior Functional Tester
EPAM Systems· Remote (Brazil; Argentina; Chile; Colombia; Mexico)Accounting Manager
EPAM Systems· Sao Paulo, BrazilOMS Lead Engineer
EPAM Systems· Lisbon, Distrito de Lisboa, PortugalSenior DevOps Engineer - Azure
EPAM Systems· Remote (Armenia; Azerbaijan; Georgia; Kazakhstan; Kyrgyzstan; Uzbekistan)Lead Cloud Engineer
EPAM Systems· Remote (Armenia; Georgia; Kazakhstan; Kyrgyzstan; Uzbekistan)
Senior Data Engineer jobs at other companies
Senior Data Engineer
ZF Group· Barcelona, ES, 08018Senior Data Engineer
Nordea· Warszawa, PL, 02-460Senior Data Engineer
Universe· Work From Home - California· $152kSenior Data Engineer
Johnson Controls International· Budapest-Hungary-HungarySenior Data Engineer
Johnson Controls· Bratislava Business Center JCI