Skip to main content
CareerApp
NVIDIA

Senior Deep Learning Software Engineer, Inference

NVIDIA

Senior

$152,000 – $287,500

Listed on NVIDIA’s own careers site. You apply with them directly — we never stand between you and the employer.

What this role is

NVIDIA is hiring a senior software engineer to optimize deep learning inference frameworks and GPU-accelerated pipelines for large language models and generative AI applications. This role suits experienced systems engineers who want to work on high-performance open-source tools and tackle complex performance optimization challenges across NVIDIA's accelerator hardware.

Our summary, not NVIDIA’s wording. The full posting is on their site.

Skills this role names

Log in to see which of these are already on your profile.

What they ask for

Required

  • Master's or PhD in Computer Science, Computer Engineering, EECS, or AI (or equivalent experience)
  • 5+ years of software development experience
  • Excellent C/C++ programming and software design skills

Nice to have

  • Python experience
  • Agile software development
  • Production experience training, deploying, or optimizing deep learning model inference
  • Performance modeling, profiling, debugging, and code optimization experience
  • CPU and GPU architectural knowledge
  • GPU programming with CUDA, Triton, or CUTLASS
  • Contributions to PyTorch, vLLM, or SGLang
  • Multi-GPU communication experience with NCCL or NVSHMEM

Turn on analytics and we load Google Analytics: Google gets the pages you open and what you do here — searches, jobs you view, jobs you apply to — and sets its own cookies. Leave it off and the only cookies we set are your login, your theme, and this answer. Accept All also records a yes to advertising, which nothing uses yet. Privacy Policy.