Skip to main content
CareerApp

Forward Deployed Engineer, Strategic Inference

Together AI

San Francisco, CA · full time · Mid

$270,000 – $300,000

Listed on Together AI’s own careers site. You apply with them directly — we never stand between you and the employer.

What this role is

A hands-on technical role working directly with Together AI's strategic customers to optimize their production AI inference systems. This position combines deep expertise in inference engines and performance tuning with customer partnership, making it ideal for someone who enjoys solving complex technical problems at scale while maintaining close relationships with key clients.

Our summary, not Together AI’s wording. The full posting is on their site.

Skills this role names

Log in to see which of these are already on your profile.

What they ask for

Required

  • 5+ years in a technical role focused on system optimization
  • Recent hands-on experience with inference systems and open-source LLM deployments
  • Expert-level proficiency with inference engines like vLLM, TensorRT-LLM, or SGLang
  • Deep knowledge of KV cache tuning, speculative decoding, tensor parallelism, and quantization techniques
  • Strong Python skills and production environment experience
  • Project management and communication skills for complex initiatives

Nice to have

  • Broad knowledge of state-of-the-art open-source models and model selection expertise

Turn on analytics and we load Google Analytics: Google gets the pages you open and what you do here — searches, jobs you view, jobs you apply to — and sets its own cookies. Leave it off and the only cookies we set are your login, your theme, and this answer. Accept All also records a yes to advertising, which nothing uses yet. Privacy Policy.