Skill
Model Evaluation
Data Science, Analytics and AI/ML
The practice of systematically assessing a machine learning or AI model's performance using metrics like accuracy, precision, recall, F1 score, or task-specific benchmarks. Data scientists and ML engineers use it to compare candidate models, detect overfitting, and validate that a model meets quality and fairness standards before deployment. It typically involves held-out test sets, cross-validation, and increasingly, human or automated evaluation of qualitative outputs for generative models.
Model Evaluation in the job market
Last checked October 28, 2026
- Open roles
- 18
- Employers
- 13
- Median pay
- —
- Disclose pay
- —
on Career App
hiring for it
not enough disclosed
of these roles
Open roles requiring Model Evaluation (18)
ML & Agentic Systems Engineer [IC4]
Sourcegraph
Remote · $88,000
This role leads machine learning and agentic systems work for a code intelligence platform, owning how AI models and multi-step agent loops power the company's developer tools. You'll set technical direction for model selection, evaluation practices, and cost-efficient agentic architectures while mentoring a senior team and shipping measurable improvements to production systems.
Listed on Sourcegraph’s careers site · Apply there ↗
Lead AI Researcher
Opus Clip
Mountain View, CA · $280,000 – $380,000
OpusClip seeks a hands-on AI researcher to lead the development and optimization of machine learning models powering their video platform, from training through production deployment. This role combines deep technical expertise in model training and inference optimization with team leadership, suited for someone who has shipped AI systems at scale and enjoys both individual technical contribution and mentoring.
Listed on Opus Clip’s careers site · Apply there ↗
Head of Policy Design, Societal Harms
Menlo Ventures Portfolio
Full-time · San Francisco, CA · $330,000 – $395,000
Lead the policy design team that establishes safety boundaries for Claude across consumer harms including child safety, election integrity, and user well-being. This role suits experienced leaders who combine deep expertise in specific harm areas with fluency in how large language models are trained and deployed, and who thrive managing teams and collaborating across organizational boundaries.
Listed on Menlo Ventures Portfolio’s careers site · Apply there ↗
Director of Research, Text to Speech
Deepgram
Ann Arbor, MI · $213,000 – $328,300 · Remote
This role leads Deepgram's text-to-speech research program from strategy through production, owning the technical roadmap and building a team of researchers to advance speech-generation quality. It suits experienced speech-synthesis researchers comfortable with hands-on technical leadership, fast-moving environments, and shipping models to production at scale.
Listed on Deepgram’s careers site · Apply there ↗
Senior AI Infrastructure Platform Engineer, Assistant Vice President
State Street Corporation
Full-time · $90,000 – $157,500
This role combines hands-on platform engineering with technical leadership of generative AI initiatives at a major financial services firm. You'll design and deploy AI-powered automation solutions across the enterprise, working with data scientists and business stakeholders to drive transformational projects from architecture through production.
Listed on State Street Corporation’s careers site · Apply there ↗
AI Principal Engineer
Voya Financial
Full-time · $192,580 – $240,720
Lead the design and delivery of production-grade AI systems at scale, owning major technical components and influencing architectural decisions across the organization. This role suits experienced engineers ready to mentor others and operate with high autonomy while navigating the constraints of a regulated financial services environment.
Listed on Voya Financial’s careers site · Apply there ↗
Staff, Data Science & Applied AI
Warner Bros. Discovery
Atlanta, GA
You'll design and deploy production machine learning models and generative AI solutions across Warner Bros. Discovery's streaming, gaming, and content platforms, working at the intersection of statistical rigor and business impact. This senior individual contributor role suits experienced data scientists who thrive building scalable analytics systems and translating complex business problems into measurable enterprise value.
Listed on Warner Bros. Discovery’s careers site · Apply there ↗
Product Manager, AI
LSEG
New York, NY · $126,900 – $211,500
This role blends product management with hands-on AI engineering, building agentic systems that operate on financial data at scale. It suits someone with deep technical roots in ML or software who has shipped LLM-powered products and can own both the "what" and the "how" of complex AI systems.
Listed on LSEG’s careers site · Apply there ↗
Senior Staff Software Engineer, Perception (R4985)
Shield AI
Full-time · Washington, DC · $233,760 – $350,640
This senior engineer role involves building and deploying machine learning models that help autonomous defense systems perceive and understand their environment, bridging research and production. It suits experienced ML engineers who want to work on vision and vision-language models at scale while solving real-world deployment challenges for military applications.
Listed on Shield AI’s careers site · Apply there ↗
Research Engineer
Ando
Full-time · San Francisco, CA
A research role building evaluation frameworks and benchmarks for AI agents in a messaging platform, working with real production data to measure whether agent behavior improvements actually help teams. Best suited for researchers who have shipped evaluation systems and can bridge the gap between offline benchmarks and live product performance.
Listed on Ando’s careers site · Apply there ↗
Asked for alongside Model Evaluation
Measured from the 18 open roles that name Model Evaluation — not from a curated list.
- Python9 roles50.0%
- Machine Learning8 roles44.4%
- Generative AI4 roles22.2%
- LangChain4 roles22.2%
- Model Deployment4 roles22.2%
- LlamaIndex3 roles16.7%
- Prompt Engineering3 roles16.7%
- Retrieval-Augmented Generation3 roles16.7%
Roles that use Model Evaluation
Employers hiring for Model Evaluation
13 in total, most open roles first.
Related skills
Curated neighbors in the taxonomy, whether or not employers ask for them together.