Member of Technical Staff, Model Evaluation
Job description
Mirendil Mirendil is a tech-first company focused on solving core bottlenecks that unlock step-change acceleration across science and technology. Our first goal is to democratize frontier AI R&D across scientific disciplines. We are building a frontier AI research company and training our own models end-to-end. The Role We are looking for a research engineer to build the evaluation infrastructure that tells us whether our models are getting better in ways we care about.
You'll own the frameworks, pipelines, and tooling that measure model behavior across capabilities. Some example areas you might work on (not limited to):
- Design and build evaluation frameworks that measure model capabilities along realistic axes, beyond standard benchmarks.
- Build automated eval pipelines and regression-detection systems that run continuously and surface signal quickly.
- Develop agent-assisted workflows for humans to efficiently inspect model behavior.
- Instrument training runs with observability tooling so researchers can understand what's changing in model behavior, and why.
- Partner with post-training and RL teams to close the loop between eval signal and training decisions. If you're excited about the hard problem of knowing whether a frontier AI system is actually improving, we'd love to hear from you. We offer a base salary of $300,000–$400,000 USD and a meaningful equity grant, depending on experience and background, along with competitive benefits.
More jobs at Mirendil
Member of Technical Staff, Distributed Systems Engineer
Mirendil· San Francisco· $300k – $400kExecutive Operations
Mirendil· San Francisco· $150k – $250kMember of Technical Staff, Designer
Mirendil· San Francisco· $300k – $400kMember of Technical Staff — Company Building
Mirendil· San Francisco· $200k – $350kMember of Technical Staff, Inference
Mirendil· San Francisco· $300k – $400k
More jobs in San Francisco
Founding AI Engineer in SF
eth· San Francisco, United StatesSenior Frontend UX Engineer
Hubs· San Francisco - Hybrid / Global - Remote, United StatesChief of Staff
Talentry· San Francisco, United StatesSimulation Scenario Specialist
Your IT Recruiter· San Francisco, United StatesSan Francisco, CA: Court Supervisor
ePlay Digital· San Francisco, United States