TA
Senior Software Engineer - Together Cloud Infrastructure
Together AISan Francisco, CA · full time · Senior
$220,000 – $290,000
Listed on Together AI’s own careers site. You apply with them directly — we never stand between you and the employer.
What this role is
Together AI seeks a senior backend engineer to design and operate the infrastructure layer of their AI cloud platform, managing GPU clusters and distributed systems across global data centers. This role suits experienced systems engineers comfortable with Kubernetes, networking, and cloud infrastructure at scale.
Our summary, not Together AI’s wording. The full posting is on their site.
Skills this role names
- Amazon Virtual Private Cloud (VPC)
- Amazon Web Services (AWS)
- Ansible
- ArgoCD
- CUDA
- GitHub Actions
- Grafana
- Kubernetes
- Microsoft Azure
- Prometheus
- Terraform
- VLAN
- VPN Clients
Log in to see which of these are already on your profile.
What they ask for
Required
- 5+ years professional software development experience
- Proficiency in at least one backend programming language
- 5+ years writing high-performance, production-quality code with demonstrated ownership of large-scale projects
- Experience building and operating globally distributed microservice architectures across cloud providers
- Excellent written and verbal communication skills
- Strong systems knowledge across compute, networking, and storage
- Experience with infrastructure automation, monitoring/observability stacks, and CI/CD pipelines
Nice to have
- Deep experience with Kubernetes internals and operators
- Deep experience with VMs/hypervisors like QEMU/KVM and Kubevirt
- Deep experience with datacenter networking technologies
- Experience with Cluster API
- High-performance compute, networking, or storage work
- GPU virtualization and Infiniband experience
- IaaS or PaaS systems design
- DPU/SmartNIC experience
- GPU programming and CUDA knowledge