# Senior Deep Learning Frameworks CUDA Software Engineer

Hiring organization: [NVIDIA](https://career.thegoodapps.co/organizations/nvidia)

Canonical page: https://career.thegoodapps.co/jobs/561f8e68-9fb3-4005-b2e2-f58917e069e0

Listed on NVIDIA's own careers site. Applications go to them directly.

- Seniority: Senior
- Salary: 184000 – 356500 USD per year

## Summary

This role involves integrating CUDA features and distributed runtime technologies into AI frameworks like PyTorch and vLLM, working on the performance and scalability of deep learning systems across multi-GPU clusters. It suits experienced systems engineers who combine deep learning knowledge with low-level optimization expertise and want to shape the infrastructure that powers modern AI.

_Our summary, not NVIDIA's wording._

## Skills named

C++, CUDA, JAX, Python, PyTorch

## Required

- Bachelor's, Master's or PhD in Computer Science, Computer Engineering, Electrical Engineering, or related field
- 8+ years of industry experience or equivalent after degree
- Development experience with deep learning frameworks like PyTorch and JAX
- Development experience with inference engines like TRT-LLM, vLLM, or sgLang
- Rapid prototyping in Python, C++, or CUDA
- Understanding of AI models, parallelism, and compiler technologies
- Performance benchmarking experience on AI clusters
- Familiarity with PyTorch profiler or NVIDIA Nsight Systems
- Understanding of HPC/AI communication concepts
- Knowledge of computer architecture, hardware-software interactions, and operating systems

## Nice to have

- Deep expertise in performance internals of PyTorch, JAX, TensorRT, vLLM, sgLang, Nemo, Megatron, or MaxText
- Hands-on experience with NCCL, MPI, UCX, and distributed ML techniques like pipeline or tensor parallelism
- Expertise in training, distributed inference, MoE, reinforcement learning, or kernel authoring
- Background in deep learning compilers at graph or codegen level
- Experience with compute and communication overlap in distributed systems

Apply on NVIDIA's site: https://nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAExternalCareerSite/job/US-CA-Santa-Clara/Senior-Deep-Learning-Frameworks-CUDA-Software-Engineer_JR2017369