MP
Staff + Senior Software Engineer, Inference Infrastructure
Menlo Ventures PortfolioNew York, NY · full time · Senior
$320,000 – $485,000
Listed on Menlo Ventures Portfolio’s own careers site. You apply with them directly — we never stand between you and the employer.
What this role is
This role leads the inference infrastructure systems that deliver Claude to millions of users, focusing on distributed systems architecture, request routing, load balancing, and fleet orchestration across diverse AI hardware. It suits experienced distributed systems engineers who want to work on large-scale production challenges where performance directly impacts both business growth and AI research capability.
Our summary, not Menlo Ventures Portfolio’s wording. The full posting is on their site.
Skills this role names
Log in to see which of these are already on your profile.
What they ask for
Required
- Significant software engineering experience with distributed systems
- Results-oriented approach with focus on flexibility and impact
- Willingness to take on work outside formal job description
- Desire to learn about machine learning systems and infrastructure
- Bachelor's degree or equivalent education and professional experience
Nice to have
- High-performance large-scale distributed systems experience
- Machine learning systems deployment at scale
- Load balancing, request routing, or traffic management implementation
- LLM inference optimization, batching, and caching knowledge
- Kubernetes and cloud infrastructure experience
- Python or Rust proficiency