Senior Software Engineer - Clickpipes (CDC/Streaming)

Note:. We are hiring for this role remotely in any country Click. House has a hiring presence.

ABOUT THE TEAM

The Click. Pipes

• Database Integrations team builds the platform that enables real-time data replication from databases into Click. House at petabyte scale. As a member of this team, you will be solving complex database-related challenges and distributed systems problems, such as understanding database internals to optimize snapshotting strategy, handling schema evolution during live replication, managing data type compatibility across systems, maintaining low end-to-end latency under unpredictable loads, and leveraging durable execution frameworks to ensure data consistency over unreliable networks. We work in the open — our database integrations are built on PeerDB https://github.com/PeerDB-io/peerdb, an open-source CDC platform we actively maintain and contribute to. See some of our recent work:
• Click. Pipes for Postgres now supports failover replication slots https://clickhouse.com/blog/clickpipes-postgres-failover-replication
• MongoDB CDC to Click. House with Native JSON Support https://clickhouse.com/blog/mongodb-cdc-clickhouse-preview
• Under the Hood: Building MySQL Change Data Capture in Click. Pipes https://clickhouse.com/blog/building-msql-change-data-capture-in-clickpipes WHAT YOU’LL DO:
• Build data-intensive systems
• Design and develop high-throughput integrations with databases (Postgres, MySQL, MongoDB), data lakes (Iceberg, Delta Lake), and data warehouses (Big. Query, Snowflake).
• Handle edge cases in real-world production scenarios: unconventional database setups, internals of data types, database upgrades/failovers, large transactions, etc.
• Design integration solutions to enable users to fully harness Click. House's performance and throughput. Own end-to-end reliability
• Debug complex issues in production leveraging runtime diagnostics (e.g. pprof, parca) and observability tools (e.g. metrics, logging, tracing).
• Build and improve infrastructure and tools to increase system reliability, reduce incident response time, and simplify/automate operations.
• Write clear documentation, both publicly and internally.
• Participate in on-call rotation. Drive product innovation
• Work directly with customers to understand integration requirements and discover gaps in existing product.
• Collaborate cross-functionally with internal teams to ensure operational efficiency.
• Lead technical discussions and influence product roadmaps.

ABOUT YOU

• 5+ years of industry experience building data-intensive software solutions.
• Proficient in Go, or experienced in systems programming with willingness to ramp up quickly in Go.
• Cloud-native experience deploying and operating services on at least one major cloud platform (AWS/GCP/Azure).
• Practical experience with Kubernetes.
• Strong problem solver and solid production debugging skills.
• Clear communication in writing (design docs, code review) and verbally (technical discussions, customer calls, incident response). Bonus Points
• Experience with database replication technologies (CDC, logical replication).
• Experience with durable execution frameworks (Temporal).
• Experience with data formats and protocols (Avro, Parquet, Protobuf).
• Experience with modern data processing frameworks (e.g. Kafka, Spark, Flink).
• Experience with maintaining/contributing to open-source software. WHY JOIN US
• Work on challenging problems at the intersection of database technologies, distributed systems, and cloud-native architecture.
• Work on a team that builds software in the open (PeerDB https://github.com/PeerDB-io/peerdb), and that cares about the craft of engineering, documentations, and continuous learning.
• Be part of a high-visibility team that delivers meaningful impact to customers in a dynamic, hyper-growth environment. #LI-remote PERKS
• Flexible work environment
• Click. House is a globally distributed company and remote-friendly. We currently operate in over 25 countries.
• Healthcare
• Employer contributions towards your healthcare.
• Equity in the company
• Every new team member who joins our company receives stock options.
• Time off
• Flexible time off in the US, generous entitlement in other countries.
• A USD$500 Home office setup if you’re a remote employee.
• Global Gatherings – We believe in the power of in-person connection and offer opportunities to engage with colleagues at company-wide offsites. CULTURE
• WE ALL SHAPE IT As part of a rapidly scaling start-up, you will be instrumental in shaping our culture. Are you interested in finding out more about our culture? Learn more about our values here https://clickhouse.com/company/careers. Check out our blog posts https://clickhouse.com/blog or follow us on LinkedIn https://www.linkedin.com/company/clickhouseinc/life/0c1ee7f4-2129-488d-b413-e7f6270659fd/?view. AsMember=true to find out more about what’s happening at Click. House. EQUAL OPPORTUNITY & PRIVACY Click. House provides equal employment opportunities to all employees and applicants and prohibits discrimination and harassment of any type based on factors such as race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Please see here https://clickhouse.com/legal/applicant-privacy-notice for our Privacy Statement.