Job description
Duties & Responsibilities: Data Architecture and Strategy:
- Develop and maintain the organization's data architecture strategy and roadmaps.
- Define data standards, principles, and best practices.
- Establish guidelines integrating disparate data sources and systems to ensure seamless data flow and accessibility across QNBAA. Data Pipeline Development and Modelling:
- Lead the design and development of databases and pipelines to guide data ingestion, transformation, and loading from various sources into data repositories.
- Define metadata principles to provide context and understanding of the data stored within systems.
- Implement scalable and efficient ETL processes to handle large volumes of data.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements.
- Creating conceptual, logical, and physical data models to represent data structures and relationships within the organization.
- Designing big data principles for storing and analyzing structured data to support business intelligence and analytics. Data Collection and Integration:
- Identify and inventories data sources, including databases, APIs, and external data providers.
- Collaborate with data scientists and analysts to determine the most suitable methods for data extraction, transformation, and loading (ETL). Data Transformation:
- Coordinate execution of data cleaning, transformation, and enrichment to ensure that the data is in a usable format for analysis.
- Collaborate with data scientists and analysts to define data transformation rules and logic. Data Accessibility Management:
- Oversee the design and maintenance of data structures and repositories (e.g., data warehouses, data lakes) that make data easily accessible to data scientists and analysts.
- Ensure data is organized and stored efficiently for analytics and reporting purposes.
- Monitor data warehouse performance and optimize data storage and retrieval to support fast querying and analysis.
- Establish guidelines for the implementation of security measures to protect sensitive data, including encryption, access controls, and regular security audits.
- Designing and implementing data storage, processing, and management solutions on cloud platforms while ensuring security and compliance.
- Establish processes for the entire data lifecycle, including creation, storage, usage, archival, and deletion, ensuring compliance with legal and regulatory requirements. Performance Optimization:
- Monitor the performance of data pipelines and data storage solutions and optimize them as needed.
- Collaborate with data scientists and analysts to ensure that query performance meets expectations. Data Quality and Governance:
- Establish data quality standards and data governance practices.
- Implement data validation and cleansing processes.
- Ensure data accuracy, consistency, and compliance with regulations. Team Leadership:
- Recruit, mentor, and manage a team of data engineers and data integration specialists.
- Foster a culture of collaboration, innovation, and continuous improvement.
- Set clear goals and expectations for team members.
- Conduct regular performance evaluations and provide feedback. Technology Evaluation and Implementation:
- Stay informed about emerging data engineering technologies and trends.
- Evaluate and select appropriate tools and technologies for data engineering tasks.
- Lead the implementation of data engineering solutions. Collaboration and Communication:
- Collaborate with cross-functional teams, including business teams, data scientists, analysts, and IT teams, to understand data requirements and ensuring IT solutions support these requirements.
- Communicate data engineering strategies, progress, and challenges to senior management and stakeholders.
- Collaborate with data scientists and analysts to troubleshoot data-related issues and find solutions to complex data problems, refine data workflows and optimize data processes.
- Document and maintain data catalogs so as to ensure that all teams have a clear understanding of data structures, transformations, and pipelines. Vendor and Budget Management:
- Manage relationships with data engineering tool vendors and service providers.
- Develop and oversee the data engineering budget, ensuring cost-effectiveness and resource allocation. General
- Ensure the socialization and adoption of the right data culture to uplift data maturity across different lines of businesses. Collaborate with cross functional teams to develop data literacy/skills training initiatives and create awareness about the importance of data governance and data management.
- Ensure correct adoption of policies and procedures to guarantee that QNB ALAHLI business is conducted in compliance with Local Laws, Internal rules and regulations, as well as, International Standards.
- Ensure the correct functioning and implementation of Permanent Supervision system, compliance, operational risk & workplace success guidelines whenever & wherever possible.