6 open roles
Senior Data Developer
Job description
Objective: Responsible for designing, developing, and maintaining ETL processes to support our data integration and analysis efforts that enable the efficient and accurate processing of data for analysis and reporting.
Responsibilities
Designing, developing, and maintaining ETL processes to support our data integration and analysis efforts. Understanding data requirements and translating them into ETL specifications. Developing and maintaining ETL documentation, including design documents, technical specifications, and data mappings. Conduct unit testing and integration testing of ETL processes to ensure the accuracy and completeness of data.
Troubleshooting and resolving ETL-related issues, including performance tuning and optimization. Monitoring production ETL processes and proactively identifying and resolving issues to ensure data accuracy and availability. Participating in the design and development of data models, data architecture, and other data-related initiatives.
Conducting training sessions for end-users. Periodically report project status to Tech lead/ principal.
Requirements
Bachelor's degree in computer science, information technology, engineering, or related field. 5–7 years of hands-on experience in data engineering, ETL/ELT development, and data integration. Knowledge of ETL tools and technologies such as DataStage or Informatica.
Strong experience with Apache Spark (Java Spark) and Spark Structured Streaming for large-scale batch and real-time data processing. Strong programming skills in Java and Python, with experience building scalable data processing applications. Solid experience with Apache Hadoop (HDFS) and distributed data processing concepts.
Experience with Apache Kafka and Kafka Connect data pipelines. Hands-on experience implementing Change Data Capture (CDC) solutions using technologies such as Debezium, Oracle Log Miner, and SQL Server CDC. Strong understanding of data warehousing concepts, including dimensional modeling, star and snowflake schemas, fact and dimension tables, and slowly changing dimensions.
Strong SQL skills and experience working with relational databases such as Oracle, SQL Server, PostgreSQL, or MySQL. Knowledge of data modeling, data quality, metadata management, and data governance best practices. Familiarity with Docker, containerization, and Linux environments is a plus. Ability to leverage AI-powered tools and Large Language Models (LLMs).
Experience working in Agile/Scrum development environments.
Benefits
Earn a competitive salary in USD, with growth tied directly to your performance and impact. Comprehensive Benefits: Enjoy full social insurance and healthcare coverage to support your well-being. Continuous Growth: Stay ahead in a rapidly evolving world with access to ongoing learning and development opportunities. Autonomy & Impact: Define success on your terms.
We provide the freedom, tools, and support you need to thrive and make a meaningful difference. Inclusive Culture: Be your authentic self. Join a team that values every voice, celebrates diversity, and fosters innovation through inclusion.
Description copied from KnowledgeNet's careers page. Read the full posting before you apply.
More jobs at KnowledgeNet
Solution/Integration Architect
KnowledgeNet· Cairo, EgyptIntegration Engineer
KnowledgeNet· Cairo, EgyptSoftware Implementation Consultant
KnowledgeNet· Cairo, EgyptQuality Control Lead
KnowledgeNet· Cairo, EgyptSenior Product Owner
KnowledgeNet· Cairo, Egypt
More jobs in Cairo
Electrical Technician-1
Huhtamaki· Cairo, EgyptSenior Product Manager
Procore· EG, Egypt, CairoDistribution Analyst
Abbott Laboratories· Cairo, EgyptSenior Team Lead
IntouchCX· Cairo, Cairo Governorate, EgyptLVS sales specialist - Infrastructure Segment
ABB· Cairo, Egypt