Engineering Manager, Inference Infrastructure

New York, NY · full time · Senior

$405,000 – $625,000

Listed on Menlo Ventures Portfolio’s own careers site. You apply with them directly — we never stand between you and the employer.

What this role is

Lead the technical strategy and day-to-day operations of the team that manages traffic routing, capacity allocation, and load balancing across Anthropic's Claude inference infrastructure. This role requires deep systems expertise to make architectural decisions about fleet coordination, ship measurable performance improvements, and develop a strong team of infrastructure and distributed-systems engineers.

Our summary, not Menlo Ventures Portfolio’s wording. The full posting is on their site.

Skills this role names

What they ask for

Required

Engineering management experience leading teams on critical-path production infrastructure at scale
Deep systems background in areas like load balancing, scheduling, cluster orchestration, autoscaling, or distributed state management
Track record shipping performance or efficiency improvements in large-scale systems with measured impact
Experience operating production infrastructure with on-call, incident response, and capacity management
Ability to build strong relationships across team boundaries in a seam role
Curiosity about machine learning systems and how transformer inference shapes systems problems

Nice to have

5+ years of engineering management experience
Experience with LLM inference serving including KV caching, continuous batching, and request scheduling
Background in cluster schedulers, autoscalers, load balancers, or Borg-style fleet control planes
Experience running workloads across multiple clouds with understanding of reliability and cost trade-offs
Familiarity with heterogeneous accelerator fleets and hardware-aware workload placement
Leadership experience at supercomputing or hyperscaler scale
Track record leading multiple teams through rapid growth with hiring and org restructuring