4,360 open roles
Data Engineer (Databricks)
Job description
We are looking for an experienced Data Integration Engineer specializing in Databricks to join our team. You will design enterprise data products and pipelines that deliver value to users and achieve business goals. You will collaborate with various stakeholders and contribute to creating engaging and delightful solutions by leveraging your design skills and methods.
Come and join us to promote the role of design and achieve positive design outcomes.
Responsibilities
Develop, maintain and support ETL/ELT solutions Implement and manage Databricks pipeline/notebook on Microsoft Azure or AWS Cloud platforms Use SQL/ Python, and Py. Spark or Scala to transform and analyze large datasets Work collaboratively with the team on Microsoft Power BI Ensure the adherence to best practices in development, testing, and deployment Create technical documentation related to the project Requirements Strong experience in Data Integration, proficient in Databricks, and ETL/ELT Solutions Strong SQL/Python skills for data transformation and analysis Experience with Delta Lake concepts (tables, partitions, schema evolution) Familiarity with cloud platforms (Azure, AWS) Have hands-on experience developing data pipelines on Databricks, integrating data from multiple sources, and working closely with analytics, data science, and business teams to deliver reliable, high-quality data products Knowledge of data ingestion techniques and data integration best practices Excellent verbal and written communication skills in English Bachelor’s degree, ideally in Computer Science, Information Technology, or a related discipline No visa sponsorship available Nice to have Experience collaborating with international clients or counterparts, ideally including working with global teams
Description copied from EPAM Systems's careers page. Read the full posting before you apply.
More jobs at EPAM Systems
Senior Cloud Engineer (AWS)
EPAM Systems· Remote (Colombia; Mexico; Argentina)Application Engineer (Energy Data Management)
EPAM Systems· Lausanne, Canton de Vaud, SwitzerlandAI Solution Architect
EPAM Systems· Abu Dhabi, UAEAI Native Delivery Manager (AI/Run practice)
EPAM Systems· Remote (Georgia; Armenia; Kazakhstan; Uzbekistan; Kyrgyzstan)Lead Software Engineer - .NET with Azure, React
EPAM Systems· Coimbatore, Tamil Nadu, India; Chennai, Tamil Nadu, India; Gurgaon, Haryana, India; Bangalore, Karnataka, India; Hyderabad, Telangana, India; Pune, Maharashtra, India
More jobs in Kuala Lumpur
Manager, HR and Talent
Bain & Company· Kuala LumpurResource Planning & Digital Engineering Lead
Subsea 7· Kuala Lumpur, MYQA Operations Senior Technician
JTI (Japan Tobacco International)· KUALA LUMPUR, MY, 50490E-Commerce Intern
Coty· Kuala Lumpur, 10, MY, 47810Client Advisor
Burberry· Kuala Lumpur, Not, MY