# Senior Deep Learning Software Engineer, Inference

Hiring organization: [NVIDIA](https://career.thegoodapps.co/organizations/nvidia)

Canonical page: https://career.thegoodapps.co/jobs/3621565a-c1f0-43d0-98db-58c377e13947

Listed on NVIDIA's own careers site. Applications go to them directly.

- Seniority: Senior
- Salary: 152000 – 287500 USD per year

## Summary

NVIDIA is hiring a senior software engineer to optimize deep learning inference frameworks and GPU-accelerated pipelines for large language models and generative AI applications. This role suits experienced systems engineers who want to work on high-performance open-source tools and tackle complex performance optimization challenges across NVIDIA's accelerator hardware.

_Our summary, not NVIDIA's wording._

## Skills named

C++, CUDA, Python, PyTorch

## Required

- Master's or PhD in Computer Science, Computer Engineering, EECS, or AI (or equivalent experience)
- 5+ years of software development experience
- Excellent C/C++ programming and software design skills

## Nice to have

- Python experience
- Agile software development
- Production experience training, deploying, or optimizing deep learning model inference
- Performance modeling, profiling, debugging, and code optimization experience
- CPU and GPU architectural knowledge
- GPU programming with CUDA, Triton, or CUTLASS
- Contributions to PyTorch, vLLM, or SGLang
- Multi-GPU communication experience with NCCL or NVSHMEM

Apply on NVIDIA's site: https://nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAExternalCareerSite/job/US-CA-Remote/Senior-Deep-Learning-Software-Engineer--Inference_JR2003655