45 open roles
Senior Data Engineer
Job description
Senior Data Engineer AWS Glue / Databricks LOCATION: Hyderabad, India EXPERIENCE: 6–10 years (preferred) ROLE OVERVIEW Build and operationalize robust data engineering pipelines using AWS Glue, Py. Spark and Delta Lake to create governed, high-quality enterprise datasets.
KEY RESPONSIBILITIES
Develop AWS Glue / Py. Spark transformations from Raw to Refined datasets in Amazon S3. Implement schema enforcement, type conversion, PII tokenization, deduplication and merges. Develop Delta Lake pipelines and, when required, Gold datasets and Redshift loads. Orchestrate jobs using Airflow or AWS Step Functions with completeness and failure checks.
Register datasets in Unity Catalog and support governance, metadata and consumer access. Perform reconciliation, performance tuning, unit testing and production troubleshooting. Prepare CI/CD artifacts, deployment configuration, runbooks and technical documentation.
Requirements
REQUIRED SKILLS
Python, Py. Spark, Spark SQL and strong SQL AWS Glue, Amazon S3, Delta Lake and Databricks ETL/ELT, data modelling and data-quality validation Airflow or AWS Step Functions and failure recovery Git, CI/CD, data reconciliation and production support PREFERRED EXPERIENCE Unity Catalog, Amazon Redshift, Immuta, Service.
Now integration and regulated-data experience.
Description copied from Radcube's careers page. Read the full posting before you apply.
More jobs at Radcube
UI/UX Engineer
Radcube· Bangalore South, Karnataka, IndiaPlatform Integration Engineer
Radcube· Bangalore South, Karnataka, IndiaCareer Coach- Marion South, Indianapolis, IN
Radcube· Indianapolis, Indiana, United StatesSolution Architect
Radcube· Indianapolis, Indiana, United StatesDelivery Lead / Business Analyst
Radcube· Indianapolis, Indiana, United States
Senior Data Engineer jobs at other companies
Senior Data Engineer
TaskUs· Chennai, IndiaSenior Data Engineer
Paramount Skydance· Los Angeles, CA, US, 90038· $110k – $166kSenior Data Engineer
Connor, Clark & Lunn Financial Group· Toronto, Ontario, CanadaSenior Data Engineer
Persistent Systems, LLC· New Jersey, United StatesSenior Data Engineer
Tripledot Studios· London
