AI Systems Engineer

Who are we? Led by MIT CSAIL professors and built on a decade of their research, Sagora is the autonomous engineering platform for AI systems. We compress weeks of expert engineering into hours, continuously improving the performance, cost and quality of customers’ AI models, pipelines and inference. Our agents do what expert engineers do: diagnose problems, form hypotheses, run experiments and ship validated, production-ready code.

You’ll build alongside the founders and recent Ph. Ds from their lab. We’re backed by $13.5M in seed funding and engineering leaders including Jeff Dean and Ion Stoica, and we’re already in production at multiple S&P 500 companies. We’re headquartered in Boston.

About the Role

We are hiring an AI Systems Engineer who blends strong systems instincts with enthusiasm for AI. This is not a role for someone who wishes AI would “go away”; we want engineers who lean into AI as a collaborator and tool for discovering new ideas in computer and networked systems. The goal is to truly transform computer systems design and optimization with AI.

You will help design, build, and ship the first versions of Sagora’s product, working closely with the founders and engineering team to translate deep research into production systems. What You’ll Do Design, build, and deploy core components of Sagora’s AI-driven optimization stack. Collaborate with the founders to translate research insights into real, usable systems.

Own critical pieces of the platform: routing, scheduling, autoscaling, hardware selection, inference engine integrations, and more. Build prototypes quickly, validate them, and iterate based on user and customer feedback. Help establish technical architecture, coding standards, and best practices for a high-velocity engineering culture.

Set up development workflows, infrastructure, tooling, and deployment pipelines. Evaluate third-party tools/services and make key build vs. buy decisions. Document design and development work and help establish the foundation for future engineering hires. What We’re Looking For Because this field is new, we don’t expect years of experience.

We’re looking for engineers with great systems intuition, intellectual curiosity, and a strong desire to embrace AI-driven engineering. Strong signals include: Experience with AI inference, distributed serving, model optimization, and related topics. Hands-on with vLLM, Py. Torch, Triton inference server, Ray Serve, or other inference frameworks Experience with GPU optimization, kernel design, CUDA programming, and low-level systems performance engineering Strong Python and Py.

Torch fundamentals Comfort in building large-scale, high-performance distributed systems PhD or equivalent experience (PhD or equivalent + ~5 years is a good sweet spot) Dislike for rigid bureaucratic engineering processes, but appreciation for disciplined engineering rigor. Why Join Sagora? Strong pedigree: Work alongside a team of renowned experts in AI-driven systems.

Massive impact: Our technology delivers significant improvements in long-running engineering research and design tasks, spanning performance engineering, model pipeline development and efficiency. Robust financials: Our $13.5M seed round closed in September 2025. We’re backed by top-tier VC firms (Pillar, E14 and Neotribe) and luminaries including Jeff Dean, Ion Stoica, Aparna Chennapragada, Nick Mc.

Keown and Srinivas Narayanan. We’re in production at multiple S&P 500 companies and running paid proofs of value with more. Solving hard problems: We’re solving the fundamental bottlenecks of the AI revolution: performance, cost and quality.