# AI Infrastructure Engineer

Hiring organization: [NIO](https://career.thegoodapps.co/organizations/nio)

Canonical page: https://career.thegoodapps.co/jobs/5e309978-beb7-4669-b798-d163844ce25a

Listed on NIO's own careers site. Applications go to them directly.

- Employment type: full time
- Seniority: Senior
- Location: San Jose, CA
- Salary: 192100 – 249600 USD per year

## Summary

NIO is hiring a senior engineer to build production inference systems for large language and vision models across cloud and edge devices in their autonomous vehicle platform. This role suits someone with deep experience optimizing AI workloads on accelerators who wants to ship real-world impact at scale.

_Our summary, not NIO's wording._

## Skills named

C++, CUDA, Model Compression & Quantization, Model Optimization, PyTorch, TensorFlow

## Required

- 5+ years building and optimizing AI inference systems at scale
- Deep knowledge of LLM/VLM model internals and Transformer architectures
- Performance engineering expertise in kernel development and memory optimization
- GPU/NPU programming proficiency
- Strong C/C++ skills with track record of production software
- Computer architecture and systems programming foundation
- BS/MS in Computer Science or related field

## Nice to have

- Master's or PhD in Computer Science, Electrical/Computer Engineering, or related field plus 5 years industry experience
- Experience building inference serving systems with batching, scheduling, and caching
- Hardware-aware model optimization expertise
- Edge and embedded AI experience with real-time constraints
- Open source or proprietary framework contributions

Apply on NIO's site: https://nio.wd3.myworkdayjobs.com/en-US/NIO_Careers/job/San-Jose-US/Sr-AI-LLM-Infrastructure-SW-Engineer_R-000123