Skip to main content
CareerApp

User Researcher, AI Evaluations

Notion

San Francisco, CA · Remote · full time · Senior

$196,000 – $230,000

Listed on Notion’s own careers site. You apply with them directly — we never stand between you and the employer.

What this role is

This role leads the research and measurement strategy for evaluating Notion's AI-powered features, translating user needs into evaluation frameworks and operationalizing them across product teams. It suits experienced UX researchers who combine qualitative rigor with systems thinking and can bridge research insights into scalable evaluation processes that product, design, and engineering teams can apply consistently.

Our summary, not Notion’s wording. The full posting is on their site.

Skills this role names

Log in to see which of these are already on your profile.

What they ask for

Required

  • 5+ years of UX research in industry
  • Ability to translate soft user expectations into concrete rubrics and measurable criteria
  • Experience evaluating AI-enabled products and working with data science teams
  • Strong research craft across both qualitative and quantitative methods
  • Skill in aligning diverse stakeholders around shared quality definitions
  • Pragmatism and ability to prioritize in fast-moving environments

Nice to have

  • Familiarity with LLM-as-judge methods, prompt design, or golden dataset creation
  • Experience with AI research tools like Dovetail, Listen Labs, Maze, or Outset
  • Experience with AI observability tooling like Braintrust
  • Proficiency in SQL, Python, R, SAS, or Matlab
  • Master's or PhD in HCI, Psychology, Behavioral Science, Anthropology, or Sociology
  • Familiarity with computing pioneers like Douglas Engelbart, Alan Kay, and Bret Victor

Turn on analytics and we load Google Analytics: Google gets the pages you open and what you do here — searches, jobs you view, jobs you apply to — and sets its own cookies. Leave it off and the only cookies we set are your login, your theme, and this answer. Accept All also records a yes to advertising, which nothing uses yet. Privacy Policy.