TA
$200,000 – $290,000
Listed on Together AI’s own careers site. You apply with them directly — we never stand between you and the employer.
What this role is
A backend engineer role focused on building and optimizing the inference platform that serves large language models and multimodal AI at scale. Ideal for someone who thrives on low-latency optimization, distributed systems design, and making cutting-edge ML research production-ready across thousands of GPUs.
Our summary, not Together AI’s wording. The full posting is on their site.
Skills this role names
Log in to see which of these are already on your profile.
What they ask for
Required
- 5+ years building large-scale distributed systems and API microservices
- Strong understanding of OS fundamentals: multi-threading, memory management, networking, storage performance
- Expert-level programming in Rust, Go, Python, or TypeScript
- Bachelor's or Master's degree in Computer Science, Computer Engineering, or equivalent practical experience
Nice to have
- Knowledge of how modern LLMs and generative models are served in production
- Experience with open source inference tools like SGLang, vLLM, or NVIDIA Dynamo
- Kubernetes or container orchestration experience
- Familiarity with GPU software stacks (CUDA, Triton, NCCL) and HPC technologies (InfiniBand, NVLink, MPI)