D
$150,000 – $220,000
Listed on Deepgram’s own careers site. You apply with them directly — we never stand between you and the employer.
What this role is
This role involves designing and maintaining automated test frameworks and evaluation systems for Deepgram's voice AI platform, APIs, and machine learning models. It suits engineers who enjoy building robust testing infrastructure, working across research and product teams, and validating AI systems at scale.
Our summary, not Deepgram’s wording. The full posting is on their site.
Skills this role names
Log in to see which of these are already on your profile.
What they ask for
Required
- BS, MS, or PhD in Computer Science, AI, Applied Math, or equivalent experience
- 5+ years of software or QA engineering experience with shipped test infrastructure or evaluation systems
- Backend/scripting experience in Python, Rust, Go, or similar language
- Experience designing and building automated test pipelines or evaluation frameworks
- Strong analytical skills and ability to reason about metrics and statistical variation
- Ability to handle ambiguous technical challenges and communicate across research, engineering, and product teams
Nice to have
- Hands-on testing and evaluation experience with AI systems such as LLMs, RAG pipelines, agents, or multimodal models
- Experience with voice, audio, speech recognition, or real-time systems and metrics like WER, MOS, latency, or TTFB
- Experience building test, evaluation, benchmarking, or ML infrastructure used by multiple teams or external users
- Strong focus on test quality including correctness, reproducibility, determinism, and consistency
- Test tooling experience for React Native, mobile applications, or cross-platform environments
- Familiarity with cloud infrastructure, containers, CI/CD systems, and monitoring tools like Grafana
- Experience as a technical bridge across teams including product, QA, evaluation, training, inference, data, or agent frameworks
- Prior open-source project involvement through contributions, reviews, maintenance, or community engagement