# Engineering Manager, Inference Infrastructure

Hiring organization: [Menlo Ventures Portfolio](https://career.thegoodapps.co/organizations/menlo-ventures-portfolio)

Canonical page: https://career.thegoodapps.co/jobs/546bda7a-bbe4-4c14-b182-9586b3830bb6

Listed on Menlo Ventures Portfolio's own careers site. Applications go to them directly.

- Employment type: full time
- Seniority: Senior
- Location: New York, NY
- Salary: 405000 – 625000 USD per year

## Summary

Lead the technical strategy and day-to-day operations of the team that manages traffic routing, capacity allocation, and load balancing across Anthropic's Claude inference infrastructure. This role requires deep systems expertise to make architectural decisions about fleet coordination, ship measurable performance improvements, and develop a strong team of infrastructure and distributed-systems engineers.

_Our summary, not Menlo Ventures Portfolio's wording._

## Skills named

Autoscaling, Kubernetes, Load Balancing

## Required

- Engineering management experience leading teams on critical-path production infrastructure at scale
- Deep systems background in areas like load balancing, scheduling, cluster orchestration, autoscaling, or distributed state management
- Track record shipping performance or efficiency improvements in large-scale systems with measured impact
- Experience operating production infrastructure with on-call, incident response, and capacity management
- Ability to build strong relationships across team boundaries in a seam role
- Curiosity about machine learning systems and how transformer inference shapes systems problems

## Nice to have

- 5+ years of engineering management experience
- Experience with LLM inference serving including KV caching, continuous batching, and request scheduling
- Background in cluster schedulers, autoscalers, load balancers, or Borg-style fleet control planes
- Experience running workloads across multiple clouds with understanding of reliability and cost trade-offs
- Familiarity with heterogeneous accelerator fleets and hardware-aware workload placement
- Leadership experience at supercomputing or hyperscaler scale
- Track record leading multiple teams through rapid growth with hiring and org restructuring

Apply on Menlo Ventures Portfolio's site: https://job-boards.greenhouse.io/anthropic/jobs/5411560008