Job description
Job Title: Data Engineer Job Description:
- Design, build, and maintain scalable data pipelines using Py. Spark and Python
- Develop and optimize complex SQL queries for large datasets
- Implement and manage ETL/ELT processes ensuring data quality and reliability
- Collaborate with business and product teams to translate data requirements into solutions
- Build and maintain data warehouse solutions
- Handle large-scale data processing using Hadoop/Big Data technologies
- Perform performance tuning and optimization of data workflows Required Skills:
- Strong hands-on experience with Py. Spark and Python
- Advanced proficiency in SQL
- Solid experience in ETL processes and data warehousing
- Familiarity with Hadoop ecosystem and Big Data technologies
- Experience working with large datasets in distributed environments
- Good communication and business understanding Good to Have:
- Experience with Apache Airflow
- Exposure to cloud platforms (AWS, GCP, Azure)
- Knowledge of data lakes and modern data architectures
- Experience with streaming tools (Kafka, Spark Streaming)
More jobs at Indiumsoft
Automation Lead
Indiumsoft· Chennai, Tamil Nadu, IndiaSenior Test Engineer
Indiumsoft· Mumbai, Maharashtra, IndiaTechno-Functional Quality Engineer
Indiumsoft· Chennai, Tamil Nadu, IndiaSenior Automation Engineer
Indiumsoft· Bangalore North, Karnataka, IndiaSenior Test Engineer
Indiumsoft· Mumbai, Maharashtra, India
More jobs in Hyderabad
Localization Vendor Manager (Onsite)
LocalEyes· Hyderabad, IndiaSales Associate
Perceptive Analytics· HyderabadData Entry Operator
The Lakhani Group· Hyderabad, IndiaProgrammer Associate
Everest Technologies· Hyderabad, IndiaPrincipal Solution Architect
OSF Digital· Hyderabad, India