TA
Staff Machine Learning Engineer, Voice AI
Together AISan Francisco, CA · full time · Lead / Staff / Principal
$220,000 – $280,000
Listed on Together AI’s own careers site. You apply with them directly — we never stand between you and the employer.
What this role is
This role leads the model serving infrastructure for real-time voice AI applications, optimizing how large language and speech models run on GPU hardware with minimal latency. It suits experienced ML engineers who have shipped inference systems at scale and want to shape the technical direction of a fast-growing voice platform.
Our summary, not Together AI’s wording. The full posting is on their site.
What they ask for
Required
- 8+ years of ML engineering experience with focus on model serving and inference optimization at production scale
- Deep expertise in LLM serving engines such as vLLM, SGLang, or TensorRT-LLM, including modifying engine internals
- Expert-level Python and PyTorch proficiency with CUDA optimization knowledge
- Proven system design judgment with architectural decisions that scaled
- Technical leadership operating with high autonomy
- Strong product intuition for developer tooling needs
Nice to have
- Strong foundation in speech and audio ML architecture (ASR/TTS)
- Familiarity with audio codec and tokenization schemes like SNAC or Encodec
- Experience training or fine-tuning speech models at scale
- Bachelor's or Master's in Computer Science, Electrical Engineering, or related field