Lead Data Engineer

This is a remote position. Shuru is an AI-native technology and engineering company that partners with businesses to build and scale high-impact digital products, platforms, and AI-driven solutions. We work with fast-growing organizations across industries, helping them solve complex technology challenges through strong engineering, product, data, and AI capabilities.

We are looking for a Senior Data Engineer to join Shuru and help design and build scalable, reliable, and high-performance data platforms for complex business environments.

Key Responsibilities

Design, build, and manage scalable multi-cloud data platforms. Develop and optimize real-time and batch data pipelines using Kafka and Spark. Build Lakehouse architectures using Apache Iceberg or Delta Lake. Optimize BigQuery, data models, queries, and warehouse performance. Design reliable and scalable distributed data processing systems.

Automate infrastructure and deployments using Terraform and Kubernetes. Ensure high standards of data reliability, security, governance, and compliance. Drive technical architecture and design reviews. Mentor engineers and contribute to engineering best practices.

Requirements

8+ years of experience in Data Engineering, Data Platforms, or Distributed Systems. 3+ years of experience operating large-scale data platforms in production. Strong hands-on experience with Kafka, Spark, GCP, BigQuery, and Airflow. Experience with Terraform and Kubernetes. Hands-on knowledge of Lakehouse technologies such as Iceberg or Delta Lake.

Strong understanding of data modeling, distributed systems, and data warehouse architecture. Experience leading technical initiatives and mentoring engineers.

Nice to Have

Experience with Debezium, Redpanda, and dbt. Experience with Prometheus and Grafana for monitoring and observability. Exposure to fintech, financial services, or regulated environments. Understanding of data governance, security, and compliance requirements.

Benefits

Work on challenging, large-scale engineering and data problems. Build modern platforms using cutting-edge cloud and data technologies. Work closely with experienced engineering, product, and technology leaders. Opportunity to take ownership of architecture and key technical decisions. Remote-first and collaborative work environment.

Strong opportunities for learning, leadership, and career growth.