Senior GCP Data Engineer

Responsibilities

Data Engineering & Architecture: Design, develop, and maintain scalable data platforms and pipelines using Google Cloud services. Implement data ingestion, transformation, and orchestration workflows using: BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Cloud SQL / PostgreSQL Define data models, partitioning strategies, and storage architectures optimized for large-scale analytics.

Implement batch and near real-time data processing solutions. BigQuery Engineering: Design, optimize, and maintain BigQuery datasets, tables, views, and data marts. Develop complex BigQuery SQL solutions for analytics and operational reporting. Optimize query performance, storage costs, partitioning, clustering, and workload management.

Establish best practices for BigQuery governance, security, and performance monitoring. PostgreSQL Engineering: Design and develop PostgreSQL database solutions on GCP. Create and optimize database schemas, indexes, stored procedures, and PL/pgSQL code. Perform database performance tuning, capacity planning, and troubleshooting.

Support migration and modernization of legacy databases to PostgreSQL. Cloud Migration & Modernization: Support migration of legacy Oracle workloads to PostgreSQL and BigQuery. Assess existing database architectures and recommend modernization approaches. Collaborate with application teams to refactor data solutions for cloud-native environments.

Ensure data integrity, security, and operational readiness during migrations. Data Governance & Security: Implement IAM controls, encryption, auditing, and data protection standards. Apply data governance and compliance requirements across the cloud platform. Collaboration: Participate in architecture reviews, code reviews, and engineering standards definition.

Collaborate with product owners, architects, analysts, and platform teams to deliver business value. Skills Must have: Minimum 5 years of hands-on experience working with relational and analytical databases Minimum 1 year of hands-on experience with Google BigQuery (GCP) Proven expertise in Google BigQuery (GCP), with the ability to build, manage, and optimize data solutions in a cloud environment.

Proven expertise in PostgreSQL administration and development, including schema design, data integrity, performance monitoring, and troubleshooting. Proficiency with GitHub for version control and collaborative development.

Nice to have

Experience migrating Oracle databases to PostgreSQL and/or BigQuery. Oracle SQL and PL/SQL knowledge. Experience with Ora2pg or similar migration tooling. Google Cloud Professional Data Engineer certification. Google Cloud Professional Cloud Architect certification. Experience with Terraform. Experience with containerized deployments using Docker and Kubernetes (GKE).

Experience with Airflow / Cloud Composer. Experience with data governance, metadata management, and data quality frameworks. Experience with Google Cloud Dataflow for building and managing data processing pipelines. Experience with Google Cloud Dataproc for big data processing and analytics workloads. Experience with Google Cloud Pub/Sub for event-driven architectures and real-time data streaming.

Python for data engineering, automation, data processing, and scripting tasks.