TA
$190,000 – $270,000
Listed on Together AI’s own careers site. You apply with them directly — we never stand between you and the employer.
What this role is
Build and operate massive GPU infrastructure systems at Together AI, where you'll write software to autonomously manage tens of thousands of accelerators for AI training and inference. This role combines systems engineering with software development, focusing on automation, monitoring, and fleet intelligence rather than manual operations.
Our summary, not Together AI’s wording. The full posting is on their site.
Skills this role names
Log in to see which of these are already on your profile.
What they ask for
Required
- 3+ years building distributed systems, infrastructure platforms, or large-scale backend software
- Strong software engineering in Python, Go, or Rust
- Experience with Linux, Kubernetes, Terraform, Ansible, or similar infrastructure technologies
- Systems thinking across hardware and software
- Automation-first mindset
Nice to have
- GPU infrastructure experience
- CUDA and NCCL knowledge
- InfiniBand or RoCE networking
- Bare-metal provisioning and lifecycle management
- Large-scale AI training or inference cluster experience
- Hardware health monitoring and predictive failure detection
- Distributed storage systems
- AI agents and autonomous infrastructure operations