113 open roles
Lead Data Engineer
Job description
Job Title: Lead Data Engineer – GCP Experience: 7-12 Years Location: Chennai/Pune/Bangalore/Coimbatore About the Company: Our client is a fast-growing technology-driven organization focused on building scalable, cloud-based data platforms and modern analytics solutions. The company specializes in leveraging cutting-edge cloud technologies and data engineering practices to enable data-driven decision-making.
With a strong focus on innovation, data quality, and governance, the organization fosters a collaborative and high-performance engineering culture. Role Overview: We are looking for a highly skilled Lead Data Engineer with strong expertise in Google Cloud Platform (GCP), Apache Beam/Dataflow, Java, and BigQuery. The ideal candidate will be responsible for designing, developing, and optimizing scalable cloud-based data processing pipelines for enterprise-grade applications.
Key Responsibilities
Design and develop scalable ETL/ELT pipelines using GCP services. Build and maintain real-time and batch data processing pipelines using Dataflow and Apache Beam. Develop robust backend processing solutions using Java. Work extensively with BigQuery for data warehousing, analytics, and performance optimization. Integrate data from multiple sources including APIs, databases, and streaming platforms.
Optimize pipeline performance, cost, scalability, and reliability on GCP. Collaborate with cross-functional teams including Architects, Analysts, DevOps, and Business stakeholders. Ensure data quality, governance, monitoring, and security best practices. Troubleshoot production issues and provide long-term scalable solutions.
Required Skills
Strong hands-on experience with GCP services. Expertise in Google Dataflow / Apache Beam. Strong programming skills in Java. Hands-on experience with BigQuery. Experience in building batch and streaming data pipelines. Good knowledge of SQL and data modeling concepts. Experience with CI/CD, Git, and Agile methodologies.
Strong problem-solving and debugging skills. Eligibility / Qualifications: Education: Bachelor’s degree in IT / Computer Science / Engineering / related field
Description copied from Buildxpartners's careers page. Read the full posting before you apply.
More jobs at Buildxpartners
Product Development – Frontend
Buildxpartners· Jaipur, IndiaFullstack Developer - Java & React/Angular
Buildxpartners· Chennai City Corporation, IndiaSenior Automation Test Engineer
Buildxpartners· Chennai, IndiaJava Lead
Buildxpartners· Saidapet, IndiaTechnical Manager / Architect
Buildxpartners· Saidapet, India
More jobs in Chennai
Chartered Accountant
Mactech Engineers· Chennai, Tamil Nadu, IndiaIndia - Network Engineer
Inchcape Shipping Services· Chennai, Tamil NaduGlobal Billing Operations, Governance and Reporting, Vice President
State Street· Chennai, IndiaFloating Staff - Sales
Make Your Own Perfume (MYOP)· Chennai, IndiaExecutive - Front Office
Cushman & Wakefield· Client Site -IND, Chennai, Porur Infra Estates Private Limited