Research Scientist Intern
Job description
Trata is hiring a Research Scientist Intern for the summer. If post-grad, contract work is also an option. We are creating very unique benchmarks and evaluations. You will design datasets and evaluation rubrics that directly influence how frontier models learn. You will have the opportunity to co-write a paper that is largely the first of its kind. Your output will feed directly into model training runs at scale. This role requires facetime in NYC and SF (we pay for travel) but can include a remote portion for the right applicant.
What You'll Do
• Design data slices that expose meaningful model failure modes
• Build and refine evaluation rubrics and reward signals for RLHF and RLVR training pipelines
• Develop quantitative frameworks for measuring dataset quality, diversity, and downstream impact on alignment and capability
• Partner with lab research teams to translate training objectives into concrete data and evaluation specifications
What We’re Looking For
• Deep curiosity and motivation around how data structure, selection, and quality drive model behavior
• Ability to design lightweight experiments, move fast, and extract actionable insights from messy results
• A bias toward building over theorizing
• Prior experience at an AI safety org, benchmarking org, or RL environment company is a strong plus
Strong performers will be considered for a full-time offer.
To Apply
Send a brief note and your CV Links to evals you've built, experiments you've run, or writing on post-training are strongly encouraged.
About Trata:
Trata is backed by a VC with a higher unicorn rate than YC and Sequoia, Walter Kortschak (prev. CIO of SignalFire and Managing Partner at Summit Partners), Y Combinator, later-stage founders backed by some of the best VCs (Sequoia, Founders Fund, a16z, Accel, Bain Capital Ventures, YC), Pioneer Fund and 10+ hedge funds.
If interested, please follow on X: @trytrata
More jobs at Trata
Marketplace Operations Manager
Trata· New York, NY, US· $120k – $150kFounding Engineer
Trata· New York, NY, US· $140k – $215kBusiness Operations Intern
Trata· New York, NY, US / Remote (US)· $31k – $62kBusiness Operations Intern
Trata· New York, NY, US / Remote (US)Operations Lead
Trata· New York, NY, US· $130k – $150k
More jobs in San Francisco
Product Marketing Manager (Sr. PMM)
TinyFish· San Francisco, California, US (Hybrid)Founding GTM (Sales/Operations)
Autostep· San Francisco, California, USMember of Technical Staff - ML Research
Causal Labs· San Francisco, California, US· $150k – $250kGeneral Manager / P&L Owner
Reunion· San Francisco, California, US (Hybrid)Forward-Deployed Engineer
Alloy Robotics· San Francisco, California, US (Hybrid)