Senior Data Engineer(BQ)

Who We Are We seek a highly skilled Senior Big. Query Data Engineer with strong Python expertise to design and deliver high-performance data solutions within OneMIS. This pivotal role supports complex reporting functions and leads the migration of on-premise data platforms to Google Cloud Platform (GCP). You will manage large-scale financial datasets, ensuring secure, compliant, and low-latency data solutions for analytics and decision-making.

This role demands technical mastery, problem-solving acumen, and a deep understanding of data best practices in the financial sector What You’ll Be Doing Design, develop, and maintain scalable Big. Query data warehouse solutions (architecture, schema, data modeling) Lead cloud-native data warehouse design and implementation to replace on-premise infrastructure Optimize Big.

Query datasets, tables, and views for performance, cost, and governance through partitioning, clustering, query tuning, and workload management Build robust data processing pipelines and workflows feeding Big. Query from diverse sources Develop and maintain efficient ETL/ELT processes for large-volume financial data ingestion, transformation, and loading Implement comprehensive data quality checks, validation, and reconciliation processes Utilize and optimize core GCP services: Big.

Query, Cloud Composer (Apache Airflow) for workflow orchestration, Dataflow (Apache Beam) for batch/streaming, and Cloud Storage Develop, test, and deploy high-quality Python code for data processing, automation, API integrations, and custom solutions, adhering to best practices (Git, testing, documentation) Explore and integrate other relevant GCP technologies (e.

g., GKE, Cloud Functions, Pub/Sub) and implement security, access control, and compliance Collaborate with product owners, analysts, and engineering teams to align solutions with business requirements Actively participate in agile ceremonies and foster team collaboration Support data needs for BI tools (Qlik Sense, Tableau, Looker).

Apply strong understanding of banking/financial sector data, regulations, and reporting for compliance. What We’re Looking For Bachelor’s degree in Computer Science, Engineering, or related field At least 5+ years of data engineering experience Strong SQL knowledge, preferably on Google Cloud Platform (GCP). Expert-level Python programming skills for data manipulation, scripting, and application development.

Proven experience with Cloud Computing, demonstrating practical application of cloud services. Direct hands-on experience with core GCP services: Big. Query, Cloud Composer (Apache Airflow) for DAG development/orchestration, Dataflow (Apache Beam) for batch/streaming pipelines, and Cloud Storage Good understanding of data warehousing concepts, data flows, and data feeds Experience with Git-based source control, particularly Bitbucket Experience working in an agile development environment with familiar agile ceremonies Solid understanding of the banking and financial sector, including data types and regulatory landscapes Ability to work collaboratively in a dynamic environment Nice to Have: Experience with other GCP services (GKE, Cloud Functions, Pub/Sub, Dataproc) Familiarity with CI/CD pipelines and DevOps practices Experience with Infrastructure as Code (Terraform) Knowledge of data visualization tools (Qlik Sense, Tableau, Looker) Understanding of data governance, data quality, and metadata management Experience with real-time data processing