Senior Software Engineer - AI Compute, Together Cloud
Together AISan Francisco, CA · full time · Senior
$220,000 – $270,000
Listed on Together AI’s own careers site. You apply with them directly — we never stand between you and the employer.
What this role is
This role involves designing and building the virtualization and infrastructure layers for Together AI's GPU cloud platform, including hypervisor work, Kubernetes operators, distributed scheduling, and fault-tolerance systems that power high-performance AI compute across global data centers. It suits experienced backend engineers who thrive owning large distributed systems end-to-end and have deep expertise in cloud infrastructure, networking, or GPU compute.
Our summary, not Together AI’s wording. The full posting is on their site.
Skills this role names
- Amazon Web Services (AWS)
- Ansible
- ArgoCD
- CUDA
- Docker
- GitHub Actions
- Grafana
- Kubernetes
- Linux Kernel
- Microsoft Azure
- Prometheus
- Terraform
- VLAN
Log in to see which of these are already on your profile.
What they ask for
Required
- 5+ years professional software development
- Proficiency in at least one backend programming language
- Ownership of large-scale projects end-to-end
- Production-quality code writing and testing
- High-performance and globally distributed microservice architecture experience
- Strong systems knowledge: compute, networking, storage, concurrency, memory management
- Clear technical communication and design documentation
- Production system reliability and infrastructure automation experience
Nice to have
- Kubernetes internals: operators, device/storage/network plugins, custom schedulers
- VM/hypervisor proficiency: QEMU/KVM, cloud-hypervisor, VFIO, virtio, SR-IOV
- Data center networking: VLAN, VXLAN, VPN, VPC, OVS/OVN
- Cluster API experience
- High-performance compute, networking, or storage work
- GPU and InfiniBand virtualization
- IaaS or PaaS systems at scale
- DPU/SmartNIC experience
- GPU programming and CUDA knowledge