# Lead Member of Technical Staff, Inference Infrastructure

Hiring organization: [Cohere](https://career.thegoodapps.co/organizations/cohere)

Canonical page: https://career.thegoodapps.co/jobs/c053ffae-9bdc-42dd-a761-2a8086107c07

Listed on Cohere's own careers site. Applications go to them directly.

- Employment type: full time
- Seniority: Lead
- Location: New York, NY
- Remote: yes
- Salary: 235000 – 325000 USD per year

## Summary

Lead the design and operation of high-performance ML infrastructure systems at an AI company, directing technical strategy for deploying large language models at scale across multiple cloud platforms. This role suits experienced infrastructure engineers who thrive in technical leadership, mentoring teams, and solving complex distributed systems challenges in production environments.

_Our summary, not Cohere's wording._

## Skills named

Amazon Web Services (AWS), C++, Go, Kubernetes, Linux, Microsoft Azure

## Required

- 8+ years production infrastructure engineering experience at scale
- Technical leadership track record
- Architecture and design of highly available distributed systems with Kubernetes and GPU workloads
- Deep Kubernetes expertise with production coding and support
- Experience across GCP, Azure, AWS, OCI, and multi-cloud/hybrid environments
- Design, deployment, and troubleshooting of large-scale Linux computing environments
- Ownership of compute, storage, and network resource management and cost optimization
- Mentoring and cross-functional leadership capabilities
- Understanding of GPU, TPU, and accelerator computational characteristics for latency and throughput optimization
- Distributed systems expertise with ability to establish team-wide patterns and practices
- Proficiency in Go, C++, or similar high-performance server languages

Apply on Cohere's site: https://jobs.ashbyhq.com/cohere/5806a521-8584-4bbe-b60a-49031b919251/application