Skip to main content
CareerApp

Research Engineer, Post-Training Inference

Together AI

San Francisco, CA · full time

$200,000 – $290,000

Listed on Together AI’s own careers site. You apply with them directly — we never stand between you and the employer.

What this role is

Research Engineer building systems at Together AI that enable developers to customize open-source language models for their specific applications, working across model training and inference infrastructure. This role suits engineers experienced with production ML services who want to contribute to foundational AI infrastructure and work on cutting-edge inference optimization problems.

Our summary, not Together AI’s wording. The full posting is on their site.

Skills this role names

Log in to see which of these are already on your profile.

What they ask for

Required

  • 2+ years deploying ML-based services in production
  • Experience with modern inference engines like SGLang, vLLM, or TensorRT-LLM
  • Familiarity with LLM fine-tuning methods
  • Strong software engineering background in Python or Go
  • Awareness of current ML community advances

Nice to have

  • Experience serving low-precision models (FP4/FP8)
  • Multi-LoRA adapter experience
  • Multi-node distributed model serving
  • RL training workload optimization
  • CUDA/Triton/CuTE kernel development
  • Large-scale production system experience
  • Open-source ML project contributions
  • Kubernetes ML workload management

Turn on analytics and we load Google Analytics: Google gets the pages you open and what you do here — searches, jobs you view, jobs you apply to — and sets its own cookies. Leave it off and the only cookies we set are your login, your theme, and this answer. Accept All also records a yes to advertising, which nothing uses yet. Privacy Policy.