Senior Data Engineer

Job Summary

As a Senior Data Engineer you will be responsible for creating effective technological solutions for work with big data. They are also responsible for managing a team of specialists in their field and related IT professions. In addition, their roles include quality control of the work performed. Position – Senior Data Engineer- 5 to 7 Years Technical Skills: Programming Languages: Proficiency in languages like Python, SQL, and possibly Scala or Java.

Database Technologies: Experience with relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra). Big Data Technologies: Knowledge of distributed computing frameworks such as Hadoop, Spark, and Apache Flink. Data Warehousing: Familiarity with data warehousing concepts and tools like Amazon Redshift, Google Big.

Query, or Snowflake. ETL Tools: Experience with ETL tools like Apache Ni. Fi, Apache Airflow, Talend, or Informatica. Data Modeling: Understanding of data modelling principles and experience with tools like ERwin, Lucidchart, or Db. Schema. Version Control: Proficient in version control systems like Git for managing codebase changes.

Cloud Platforms: Experience working with cloud platforms like AWS, Azure, or Google Cloud Platform for deploying and managing data solutions. Data Visualization: Basic understanding of data visualization tools like Tableau, Power BI, or matplotlib/seaborn in Python.

Requirements

Designing, building, and maintaining scalable and robust data pipelines for ingesting, processing, and transforming large volumes of data. Collaborating with cross-functional teams including data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business objectives.

Optimizing and fine-tuning data pipelines for performance, reliability, and efficiency. Implementing data security and privacy measures to ensure compliance with regulations like GDPR or CCPA. Troubleshooting data-related issues and providing timely resolution. Participating in code reviews, documentation, and knowledge sharing sessions within the team.