# Senior Software Engineer - Model Evaluation & AI Systems

Hiring organization: [Deepgram](https://career.thegoodapps.co/organizations/deepgram)

Canonical page: https://career.thegoodapps.co/jobs/0491ff9d-5456-425f-b89b-eece2a25651a

Listed on Deepgram's own careers site. Applications go to them directly.

- Seniority: Senior
- Location: USA | Remote
- Remote: yes
- Salary: 180000 – 240000 USD per year

## Summary

Deepgram seeks a senior engineer to design and build evaluation systems that measure the quality of speech, text, and multimodal AI models before they reach customers. This role combines infrastructure engineering with model quality reasoning, requiring someone comfortable building test pipelines and working across research and product teams in a fast-moving AI environment.

_Our summary, not Deepgram's wording._

## Skills named

CI/CD, Containerization, Data Pipelines, Go, Grafana, Python, React Native, Rust, Statistical Analysis, Test Automation

## Required

- Bachelor's degree or equivalent experience in Computer Science, AI, or related field
- 5+ years of professional software or QA engineering experience with test infrastructure or evaluation systems shipped
- Proficiency in Python, Rust, Go, or similar backend/scripting language
- Experience designing and building automated test pipelines or evaluation frameworks
- Strong analytical skills for reasoning about metrics, thresholds, and statistical variation
- Ability to handle ambiguous technical challenges and communicate across research, engineering, and product teams

## Nice to have

- Hands-on experience evaluating modern AI systems like LLMs, RAG pipelines, or multimodal models
- Experience with React Native or cross-platform mobile frameworks
- Track record building evaluation frameworks or ML infrastructure used by other teams
- Strong focus on evaluation correctness, reproducibility, and consistency
- Experience with voice, audio, speech recognition, real-time systems, or metrics like WER and MOS
- Open-source project contributions or maintenance
- Technical bridge-building experience across multiple teams and platforms
- Familiarity with cloud infrastructure, containerized environments, monitoring tools like Grafana, and anomaly detection

Apply on Deepgram's site: https://jobs.ashbyhq.com/Deepgram/6f3d761e-4873-43af-a9b1-daeb147661f9/application