# Senior Machine Learning Engineer - LLM Quantization & Deployment

Hiring organization: [XPeng](https://career.thegoodapps.co/organizations/xpeng)

Canonical page: https://career.thegoodapps.co/jobs/c86d1ba9-8874-460c-9b7e-12f5fe790be6

Listed on XPeng's own careers site. Applications go to them directly.

- Employment type: full time
- Seniority: Senior
- Location: Santa Clara, CA
- Salary: 174720 – 295680 USD per year

## Summary

This role focuses on developing and optimizing large language models for deployment on XPENG's custom AI chip, with emphasis on quantization techniques to reduce model size and inference latency. It suits experienced machine learning engineers who have shipped quantized models in production and want to work on real-world autonomous driving applications.

_Our summary, not XPeng's wording._

## Skills named

Python, PyTorch

## Required

- Master's degree in CS, CE, EE or equivalent
- 1-3 years of industry experience or new graduate
- Understanding of Transformer architectures and LLM inference
- Hands-on experience quantizing or deploying deep learning models in production
- PyTorch proficiency
- Proficiency with at least one inference or compilation stack
- Strong Python programming and software engineering skills
- Ability to collaborate across research, systems, infrastructure, and product teams
- Excellent communication and problem-solving skills

## Nice to have

- Experience with weight-only, activation, KV-cache, dynamic, static, or mixed-precision quantization
- Experience with AWQ, GPTQ, SmoothQuant or related methods
- Strong numerical analysis and systems engineering skills
- Experience with LLM runtimes such as TensorRT-LLM, vLLM, SGLang, llama.cpp, ONNX Runtime, TVM, MLIR, or custom runtimes
- Experience deploying LLMs on resource-constrained or heterogeneous hardware
- Contributions to model optimization, inference, compiler, or serving projects
- Publications at NeurIPS, ICML, ICLR, ACL, or related conferences

Apply on XPeng's site: https://job-boards.greenhouse.io/xpengmotors/jobs/8710019002