D
$180,000 – $240,000
Listed on Deepgram’s own careers site. You apply with them directly — we never stand between you and the employer.
What this role is
Deepgram seeks a senior engineer to design and build evaluation systems that measure the quality of speech, text, and multimodal AI models before they reach customers. This role combines infrastructure engineering with model quality reasoning, requiring someone comfortable building test pipelines and working across research and product teams in a fast-moving AI environment.
Our summary, not Deepgram’s wording. The full posting is on their site.
Skills this role names
- CI/CD
- Containerization
- Data Pipelines
- Go
- Grafana
- Python
- React Native
- Rust
- Statistical Analysis
- Test Automation
Log in to see which of these are already on your profile.
What they ask for
Required
- Bachelor's degree or equivalent experience in Computer Science, AI, or related field
- 5+ years of professional software or QA engineering experience with test infrastructure or evaluation systems shipped
- Proficiency in Python, Rust, Go, or similar backend/scripting language
- Experience designing and building automated test pipelines or evaluation frameworks
- Strong analytical skills for reasoning about metrics, thresholds, and statistical variation
- Ability to handle ambiguous technical challenges and communicate across research, engineering, and product teams
Nice to have
- Hands-on experience evaluating modern AI systems like LLMs, RAG pipelines, or multimodal models
- Experience with React Native or cross-platform mobile frameworks
- Track record building evaluation frameworks or ML infrastructure used by other teams
- Strong focus on evaluation correctness, reproducibility, and consistency
- Experience with voice, audio, speech recognition, real-time systems, or metrics like WER and MOS
- Open-source project contributions or maintenance
- Technical bridge-building experience across multiple teams and platforms
- Familiarity with cloud infrastructure, containerized environments, monitoring tools like Grafana, and anomaly detection