MP
Staff+ Software Engineer, Inference Velocity
Menlo Ventures PortfolioNew York, NY · Remote · Lead / Staff / Principal
$405,000 – $485,000
Listed on Menlo Ventures Portfolio’s own careers site. You apply with them directly — we never stand between you and the employer.
What this role is
Anthropic seeks a Staff engineer to lead technical strategy for developer productivity across its inference platform, which runs Claude on heterogeneous accelerators (GPUs, TPUs, Trainium). The role suits someone with deep infrastructure or platform experience who thrives designing systems that remove friction from engineering workflows.
Our summary, not Menlo Ventures Portfolio’s wording. The full posting is on their site.
What they ask for
Required
- 8+ years software engineering experience as a technical lead on infrastructure, platform, or developer productivity teams
- Deep systems engineering background with hands-on ability in toolchains, CI/CD, and developer workflow optimization
- Experience owning development environments or toolchains for compute-intensive workloads like ML training or inference
- Proven depth in at least one accelerator ecosystem (CUDA/GPU, TPU, or Trainium/AWS Neuron)
- Track record defining and using engineering metrics to drive measurable velocity improvements
- Experience driving technical alignment across organizational boundaries
- Strong written and verbal communication with ability to influence without formal authority
Nice to have
- ML compiler toolchain experience (XLA, Triton, NeuronX) or accelerator driver/firmware management at scale
- Background building shared development environments for hardware-dependent workflows
- CI/CD systems experience at scale with accelerator hardware
- Kubernetes-based development and job scheduling environment familiarity
- Prior tech lead experience on developer productivity or platform engineering teams at AI/ML companies