Skip to main content
CareerApp

Embedded AI Engineer, On-Device Models

Deepgram

USA | Remote · Remote · Senior

$219,300 – $274,100

Listed on Deepgram’s own careers site. You apply with them directly — we never stand between you and the employer.

What this role is

This role focuses on adapting Deepgram's speech AI models to run efficiently on resource-constrained devices like phones, wearables, and edge hardware. You'll optimize models for low power and memory through techniques like quantization and pruning, write performance-critical embedded code, and integrate with hardware accelerators to bring real-time voice AI to consumer devices.

Our summary, not Deepgram’s wording. The full posting is on their site.

Skills this role names

Log in to see which of these are already on your profile.

What they ask for

Required

  • Production experience on resource-constrained embedded systems, mobile, or edge AI
  • Strong C, C++, or Rust proficiency for performance-critical constrained code
  • Hands-on model optimization for on-device deployment including quantization or pruning
  • Familiarity with edge inference runtimes like ONNX Runtime, TensorRT, or TFLite
  • Understanding of CPU, GPU, NPU, DSP architectures and memory hierarchies
  • Experience in bare-metal or RTOS environments such as FreeRTOS or Zephyr
  • Strong communication and ability to scope and drive optimization problems to measurable results

Nice to have

  • Real-time audio processing on embedded platforms or wake-word detection
  • Depth in ML optimization techniques like mixed-precision inference or neural architecture search
  • Hardware evaluation and benchmarking experience across accelerators and SoCs
  • Shipped AI features in consumer products at scale
  • Experience with model compilation toolchain tradeoffs across hardware targets
  • Secure on-device deployment practices including code signing and encrypted model storage

Turn on analytics and we load Google Analytics: Google gets the pages you open and what you do here — searches, jobs you view, jobs you apply to — and sets its own cookies. Leave it off and the only cookies we set are your login, your theme, and this answer. Accept All also records a yes to advertising, which nothing uses yet. Privacy Policy.