211 open roles
Data/ETL Engineer
Job description
About the Role" "Data Engineer" Hybrid -Bangalore Years of EXP - 6+years The below mentioned is the illustrated job description, that we should refer to for a Data Engineer Profile, (highlighted are the key skills we need)- The ideal candidate will have expertise in Glue, Data Catalog, Athena, DynamoDB, Lambda, S3, RDS (PostgreSQL), ECS, SQS, SNS, Cloud.
Front, and IAM roles. Strong proficiency in Python, Py. Spark, Terraform, and Terragrunt, coupled with experience in Agile environments and GitHub, is essential. You will play a pivotal role in building robust data pipelines and infrastructure to support analytics and business intelligence initiatives.
Required Skills
Proficiency in AWS Glue, Data Catalog, Athena, DynamoDB, Lambda, S3, RDS (PostgreSQL), ECS, SQS, SNS, and Cloud. Front. Strong understanding of IAM roles and security best practices. Programming and Frameworks : Advanced proficiency in Python and Py. Spark for data processing. Solid understanding of SQL for querying relational and non-relational databases.
Infrastructure as Code(good to have) Hands-on experience with Terraform and Terragrunt for infrastructure automation. Development Practices : Experience in Agile methodologies (Scrum, Kanban) and version control systems like GitHub. Familiarity with CI/CD pipelines and DevOps practices. Other Skills : Strong analytical and problem-solving skills.
Excellent communication and collaboration abilities. Ability to work independently and in a team-oriented environment.
Key Responsibilities
Develop, deploy, and manage scalable ETL/ELT pipelines using AWS Glue and Py. Spark. Work with AWS Data Catalog for metadata management and data discovery. Optimize query performance and data analysis workflows using AWS Athena. Implement serverless data workflows using AWS Lambda for real-time and batch data processing.
Database and Storage Management : Design and manage relational databases on AWS RDS (PostgreSQL) and non-relational databases on DynamoDB. Store, manage, and optimize data in AWS S3 for performance, security, and cost efficiency. Infrastructure as Code (IaC) (good to have) : Build and deploy AWS infrastructure using Terraform and Terragrunt.
Automate the provisioning of scalable, secure, and reliable resources. Cloud Services and Integrations (good to have) : Manage containerized data applications on AWS ECS for efficient deployment and scaling. Design and implement event-driven architectures using AWS SQS and SNS. Configure AWS Cloud. Front for secure, low-latency content delivery.
Security and Access Management (should understand how its implemented) : Design and implement IAM roles and policies to ensure secure access and compliance. Ensure data security, including encryption at rest and in transit. Collaboration and Agile Practices : Collaborate with cross-functional teams, including data scientists, analysts, and developers, to understand data requirements.
Actively participate in Agile ceremonies, such as sprint planning, standups, and retrospectives. Version Control and Continuous Integration : Utilize GitHub for version control, collaboration, and CI/CD workflows. Ensure best practices in code management and deployment processes. Monitoring and Optimization : Monitor and troubleshoot data workflows and AWS resources using AWS Cloud.
Watch and other tools. Optimize data pipelines and resource configurations for performance and cost.
Description copied from Ascendion's careers page. Read the full posting before you apply.
More jobs at Ascendion
Java Backend Engineer
Ascendion· Mumbai, Maharashtra, IndiaJava Backend Engineer
Ascendion· Mumbai, Maharashtra, IndiaJava Backend Engineer
Ascendion· Mumbai, Maharashtra, IndiaTechnical Product Owner
Ascendion· Bangalore, Karnataka, IndiaProduct Engineering Office
Ascendion· Bangalore, Karnataka, India
More jobs in Bengaluru
Business Development Manager – Infrastructure
Hempel· Bangalore, IndiaSenior Manager - Data Engineering
Bloom Energy· Bangalore, KarnatakaTechnical Support Engineer - Linux, Korean Language Expert
Evertz· Bangalore, Karnataka, IndiaGlobal Billing Operations, Vice President
State Street· Bangalore, IndiaSales Executive
Make Your Own Perfume (MYOP)· Bangalore, India
