# Staff + Senior Software Engineer, Inference Infrastructure

Hiring organization: [Menlo Ventures Portfolio](https://career.thegoodapps.co/organizations/menlo-ventures-portfolio)

Canonical page: https://career.thegoodapps.co/jobs/1dac9aca-b937-480a-accd-168e0e1c82f9

Listed on Menlo Ventures Portfolio's own careers site. Applications go to them directly.

- Employment type: full time
- Seniority: Senior
- Location: New York, NY
- Salary: 320000 – 485000 USD per year

## Summary

This role leads the inference infrastructure systems that deliver Claude to millions of users, focusing on distributed systems architecture, request routing, load balancing, and fleet orchestration across diverse AI hardware. It suits experienced distributed systems engineers who want to work on large-scale production challenges where performance directly impacts both business growth and AI research capability.

_Our summary, not Menlo Ventures Portfolio's wording._

## Skills named

Amazon Web Services (AWS), Autoscaling, Kubernetes, Load Balancing, Microsoft Azure, Python, Rust

## Required

- Significant software engineering experience with distributed systems
- Results-oriented approach with focus on flexibility and impact
- Willingness to take on work outside formal job description
- Desire to learn about machine learning systems and infrastructure
- Bachelor's degree or equivalent education and professional experience

## Nice to have

- High-performance large-scale distributed systems experience
- Machine learning systems deployment at scale
- Load balancing, request routing, or traffic management implementation
- LLM inference optimization, batching, and caching knowledge
- Kubernetes and cloud infrastructure experience
- Python or Rust proficiency

Apply on Menlo Ventures Portfolio's site: https://job-boards.greenhouse.io/anthropic/jobs/5245851008