# User Researcher, AI Evaluations

Hiring organization: [Notion](https://career.thegoodapps.co/organizations/notion)

Canonical page: https://career.thegoodapps.co/jobs/94278821-b4a0-4a62-bcf0-25120125f686

Listed on Notion's own careers site. Applications go to them directly.

- Employment type: full time
- Seniority: Senior
- Location: San Francisco, CA
- Remote: yes
- Salary: 196000 – 230000 USD per year

## Summary

This role leads the research and measurement strategy for evaluating Notion's AI-powered features, translating user needs into evaluation frameworks and operationalizing them across product teams. It suits experienced UX researchers who combine qualitative rigor with systems thinking and can bridge research insights into scalable evaluation processes that product, design, and engineering teams can apply consistently.

_Our summary, not Notion's wording._

## Skills named

Data Analysis, Python, Qualitative Research, Quantitative Research, SQL, Statistical Analysis, Survey Design

## Required

- 5+ years of UX research in industry
- Ability to translate soft user expectations into concrete rubrics and measurable criteria
- Experience evaluating AI-enabled products and working with data science teams
- Strong research craft across both qualitative and quantitative methods
- Skill in aligning diverse stakeholders around shared quality definitions
- Pragmatism and ability to prioritize in fast-moving environments

## Nice to have

- Familiarity with LLM-as-judge methods, prompt design, or golden dataset creation
- Experience with AI research tools like Dovetail, Listen Labs, Maze, or Outset
- Experience with AI observability tooling like Braintrust
- Proficiency in SQL, Python, R, SAS, or Matlab
- Master's or PhD in HCI, Psychology, Behavioral Science, Anthropology, or Sociology
- Familiarity with computing pioneers like Douglas Engelbart, Alan Kay, and Bret Victor

Apply on Notion's site: https://jobs.ashbyhq.com/notion/0e9114bd-4603-4bdf-a86f-a7a4f390fae8/application