Skip to main content
CareerApp

Cyber Evaluations Engineer

Menlo Ventures Portfolio

San Francisco, CA | Washington, DC · full time

$300,000 – $405,000

Listed on Menlo Ventures Portfolio’s own careers site. You apply with them directly — we never stand between you and the employer.

What this role is

Anthropic is seeking an engineer to design and execute security evaluations for AI systems, focusing on detecting cyber misuse and measuring safeguard robustness. This role suits someone with hands-on security research experience who enjoys translating policy requirements into detection systems and analyzing adversarial attack patterns.

Our summary, not Menlo Ventures Portfolio’s wording. The full posting is on their site.

Skills this role names

Log in to see which of these are already on your profile.

What they ask for

Required

  • Experience building or running evaluations, benchmarks, or test suites for software or ML systems
  • Hands-on cybersecurity experience such as CTF participation, vulnerability research, exploit development, or security research
  • Proficiency in Python
  • Ability to communicate evaluation results to cross-functional stakeholders
  • Bachelor's degree or equivalent education and professional experience

Nice to have

  • Deep offensive-security or security-research experience including AI security benchmarks
  • Experience analyzing adversarial or abuse data like jailbreaks or prompt bypasses
  • Experience working onsite with government partners on testing or evaluation engagements
  • Experience with AI/ML evaluation frameworks
  • Familiarity with coordinated vulnerability disclosure practices
  • Experience testing pre-release or pre-deployment software or models under confidentiality constraints
  • Experience authoring detection content or building ML-based abuse detection
  • Active secret security clearance or eligibility to obtain one

Turn on analytics and we load Google Analytics: Google gets the pages you open and what you do here — searches, jobs you view, jobs you apply to — and sets its own cookies. Leave it off and the only cookies we set are your login, your theme, and this answer. Accept All also records a yes to advertising, which nothing uses yet. Privacy Policy.