Skip to main content
CareerApp

Skill

Model Evaluation

Data Science, Analytics and AI/ML

The practice of systematically assessing a machine learning or AI model's performance using metrics like accuracy, precision, recall, F1 score, or task-specific benchmarks. Data scientists and ML engineers use it to compare candidate models, detect overfitting, and validate that a model meets quality and fairness standards before deployment. It typically involves held-out test sets, cross-validation, and increasingly, human or automated evaluation of qualitative outputs for generative models.

Model Evaluation in the job market

Last checked October 28, 2026

Open roles
18

on Career App

Employers
13

hiring for it

Median pay
—

not enough disclosed

Disclose pay
—

of these roles

Open roles requiring Model Evaluation (18)

ML & Agentic Systems Engineer [IC4]

Sourcegraph

Remote · $88,000

This role leads machine learning and agentic systems work for a code intelligence platform, owning how AI models and multi-step agent loops power the company's developer tools. You'll set technical direction for model selection, evaluation practices, and cost-efficient agentic architectures while mentoring a senior team and shipping measurable improvements to production systems.

Listed on Sourcegraph’s careers site · Apply there ↗

Lead AI Researcher

Opus Clip

Mountain View, CA · $280,000 – $380,000

OpusClip seeks a hands-on AI researcher to lead the development and optimization of machine learning models powering their video platform, from training through production deployment. This role combines deep technical expertise in model training and inference optimization with team leadership, suited for someone who has shipped AI systems at scale and enjoys both individual technical contribution and mentoring.

Listed on Opus Clip’s careers site · Apply there ↗

Head of Policy Design, Societal Harms

Menlo Ventures Portfolio

Full-time · San Francisco, CA · $330,000 – $395,000

Lead the policy design team that establishes safety boundaries for Claude across consumer harms including child safety, election integrity, and user well-being. This role suits experienced leaders who combine deep expertise in specific harm areas with fluency in how large language models are trained and deployed, and who thrive managing teams and collaborating across organizational boundaries.

Listed on Menlo Ventures Portfolio’s careers site · Apply there ↗

Director of Research, Text to Speech

Deepgram

Ann Arbor, MI · $213,000 – $328,300 · Remote

This role leads Deepgram's text-to-speech research program from strategy through production, owning the technical roadmap and building a team of researchers to advance speech-generation quality. It suits experienced speech-synthesis researchers comfortable with hands-on technical leadership, fast-moving environments, and shipping models to production at scale.

Listed on Deepgram’s careers site · Apply there ↗

State Street Corporation

Senior AI Infrastructure Platform Engineer, Assistant Vice President

State Street Corporation

Full-time · $90,000 – $157,500

This role combines hands-on platform engineering with technical leadership of generative AI initiatives at a major financial services firm. You'll design and deploy AI-powered automation solutions across the enterprise, working with data scientists and business stakeholders to drive transformational projects from architecture through production.

Listed on State Street Corporation’s careers site · Apply there ↗

Voya Financial

AI Principal Engineer

Voya Financial

Full-time · $192,580 – $240,720

Lead the design and delivery of production-grade AI systems at scale, owning major technical components and influencing architectural decisions across the organization. This role suits experienced engineers ready to mentor others and operate with high autonomy while navigating the constraints of a regulated financial services environment.

Listed on Voya Financial’s careers site · Apply there ↗

Staff, Data Science & Applied AI

Warner Bros. Discovery

Atlanta, GA

You'll design and deploy production machine learning models and generative AI solutions across Warner Bros. Discovery's streaming, gaming, and content platforms, working at the intersection of statistical rigor and business impact. This senior individual contributor role suits experienced data scientists who thrive building scalable analytics systems and translating complex business problems into measurable enterprise value.

Listed on Warner Bros. Discovery’s careers site · Apply there ↗

Product Manager, AI

LSEG

New York, NY · $126,900 – $211,500

This role blends product management with hands-on AI engineering, building agentic systems that operate on financial data at scale. It suits someone with deep technical roots in ML or software who has shipped LLM-powered products and can own both the "what" and the "how" of complex AI systems.

Listed on LSEG’s careers site · Apply there ↗

Senior Staff Software Engineer, Perception (R4985)

Shield AI

Full-time · Washington, DC · $233,760 – $350,640

This senior engineer role involves building and deploying machine learning models that help autonomous defense systems perceive and understand their environment, bridging research and production. It suits experienced ML engineers who want to work on vision and vision-language models at scale while solving real-world deployment challenges for military applications.

Listed on Shield AI’s careers site · Apply there ↗

Research Engineer

Ando

Full-time · San Francisco, CA

A research role building evaluation frameworks and benchmarks for AI agents in a messaging platform, working with real production data to measure whether agent behavior improvements actually help teams. Best suited for researchers who have shipped evaluation systems and can bridge the gap between offline benchmarks and live product performance.

Listed on Ando’s careers site · Apply there ↗

View all 18 on Jobs

Asked for alongside Model Evaluation

Measured from the 18 open roles that name Model Evaluation — not from a curated list.

Employers hiring for Model Evaluation

13 in total, most open roles first.

Related skills

Curated neighbors in the taxonomy, whether or not employers ask for them together.

Turn on analytics and we load Google Analytics: Google gets the pages you open and what you do here — searches, jobs you view, jobs you apply to — and sets its own cookies. Leave it off and the only cookies we set are your login, your theme, and this answer. Accept All also records a yes to advertising, which nothing uses yet. Privacy Policy.