Data Engineer

Job Overview The role of Data Engineer involves leading complex business reengineering development projects and to solve organizational problems through IT solutions using data modelling/Reporting and Data Extraction concepts and best practices. Platform tools and software engineering languages as required.

Key Responsibilities include

Designing, developing and implementing solutions to customers organizational problems; Providing high quality service delivery on engagements; Designing and developing data reconciliation & metadata driven data processing frameworks; Responsibilities and Duties Key Skills/Experience: Prior experience as a Data Engineer or related roles.

Good understanding and experience/hands-on in Cloud Computing – AWS preferably (S3/KMS/EC2/EMR/Redshift/IAM) Experience in programming and shell scripting eg. SQL/ PLSQL/Python /Unix Shell/CICD-Jenkins/Airflow DAGs Good to have experience on AWS Redshift/ Snowflake and loading from S3 to database and vice versa, Data Modelling/Data Designing/ETL (extract transform and Load).

Good to have experience (minor) in building stream ingestion (kinesis/kafka) or batch ingestion and transformation pipelines Good hands-on experience in in Hadoop Stack eg. Hive, Spark (Core). Experience with Github, Jenkins, Airflow DAG. Experience (Minor) on AWS snowflake, Data Modelling/Data Designing. Experience in building real time or batch ingestion and transformation pipelines ( good to have) Ability to work in a high performing team environment.

The following would be advantageous: AWS certification would be advantageous, not necessary Understanding of Financial Services Industry could be advantageous