MP
Research Engineer, Post-Training Model Evaluations
Menlo Ventures PortfolioSan Francisco, CA · full time · Senior
$500,000 – $850,000
Listed on Menlo Ventures Portfolio’s own careers site. You apply with them directly — we never stand between you and the employer.
What this role is
Lead the development of evaluation systems for production large language models at Anthropic, focusing on measurement quality and providing observability into post-training processes. This role suits experienced ML researchers or engineers who care deeply about benchmarking rigor and can advise teams across a complex organization on evaluation methodology.
Our summary, not Menlo Ventures Portfolio’s wording. The full posting is on their site.
Skills this role names
Log in to see which of these are already on your profile.
What they ask for
Required
- Designed and run evaluations for ML models at scale
- Strong focus on measurement quality
- Can synthesize ambiguous results into clear recommendations
- Proficient Python skills
- Experience working with production systems
- Debug complex time-sensitive issues with clarity
- Can influence direction across multiple teams
Nice to have
- Hands-on post-training experience with large language models
- Research background in ML evaluation or benchmarking
- Statistics and experimental design expertise
- Experience building robust evaluation metrics for ML systems