Staff + Sr. Software Engineer, Cloud Inference

San Francisco, CA · full time · Senior

$320,000 – $485,000

Listed on Menlo Ventures Portfolio’s own careers site. You apply with them directly — we never stand between you and the employer.

What this role is

This role leads the infrastructure that delivers Claude AI across multiple cloud platforms, balancing performance and cost at massive scale. It's ideal for backend engineers who excel at cross-platform system design and can navigate the complexity of serving billions of inference requests across AWS, GCP, Azure, and beyond.

Our summary, not Menlo Ventures Portfolio’s wording. The full posting is on their site.

Skills this role names

What they ask for

Required

Significant experience building or operating large-scale distributed systems serving millions of users
Experience with at least one major cloud platform (AWS, GCP, or Azure)
Experience with Kubernetes, Infrastructure as Code, or container orchestration
Cross-functional collaboration with internal teams and external partners
Ability to work with external partners and align goals
Fast learner who can quickly master new technologies and provider ecosystems
Autonomous problem-solver who takes end-to-end ownership

Nice to have

Direct experience scaling infrastructure across multiple cloud platforms and managing differences in networking, security, billing, and managed services
Hands-on capacity management, cost optimization, or resource planning at scale across diverse environments
Understanding of multi-region deployments, geographic routing, and global traffic management
Proficiency in Python or Rust
Prior inference or ML experience