Skip to main content
CareerApp

Machine Learning Engineer - Inference

Together AI

San Francisco, CA · full time · Mid

$200,000 – $300,000

Listed on Together AI’s own careers site. You apply with them directly — we never stand between you and the employer.

What this role is

A Machine Learning Engineer role optimizing AI inference systems at scale, building production systems for large language models using PyTorch. This suits engineers with deep systems knowledge who want to work on the infrastructure powering AI applications.

Our summary, not Together AI’s wording. The full posting is on their site.

Skills this role names

Log in to see which of these are already on your profile.

What they ask for

Required

  • 3+ years writing production-quality code
  • Proficiency with Python and PyTorch
  • Experience building high-performance libraries and tooling
  • Understanding of low-level OS concepts including multi-threading, memory management, networking, and storage

Nice to have

  • Knowledge of AI inference systems like TGI, vLLM, TensorRT-LLM, or Optimum
  • Knowledge of AI inference techniques such as speculative decoding
  • Knowledge of CUDA or Triton programming
  • Knowledge of Rust, Cython, or compilers

Turn on analytics and we load Google Analytics: Google gets the pages you open and what you do here — searches, jobs you view, jobs you apply to — and sets its own cookies. Leave it off and the only cookies we set are your login, your theme, and this answer. Accept All also records a yes to advertising, which nothing uses yet. Privacy Policy.