Big Data Developer

Overview

We are seeking a skilled Big Data Developer with expertise in building scalable data pipelines and processing large datasets. The ideal candidate will have hands-on experience with big data technologies, cloud platforms, and data engineering best practices.

Key Responsibilities

Design, develop, and maintain scalable data pipelines. Process and transform large volumes of structured and unstructured data. Develop data ingestion, ETL, and batch/streaming solutions. Optimize data processing performance and reliability. Collaborate with data architects, analysts, and business stakeholders. Ensure data quality, governance, and security standards.

Required Skills

8-10 years of experience in Data Engineering or Big Data development. Strong experience with Hadoop, Spark, Hive, Kafka, and SQL. Hands-on experience with Python, Scala, or Java. Experience with cloud platforms such as AWS, Azure, or GCP. Knowledge of data warehousing and distributed computing concepts. Strong troubleshooting and performance tuning skills.