# Member of Technical Staff, Data Analysis and Evaluation

Hiring organization: [Cohere](https://career.thegoodapps.co/organizations/cohere)

Canonical page: https://career.thegoodapps.co/jobs/d5db7b23-b765-44c8-b021-13c16469015c

Listed on Cohere's own careers site. Applications go to them directly.

- Employment type: full time
- Location: New York, NY
- Remote: yes
- Salary: 250000 – 535000 CAD per year

## Summary

This role focuses on ensuring the quality and robustness of large language models through data collection design, statistical evaluation, and experimental analysis. It suits researchers or engineers with strong ML fundamentals who want to bridge data science and model development at a frontier AI company.

_Our summary, not Cohere's wording._

## Skills named

JAX, Machine Learning, Python, PyTorch, Statistical Analysis, TensorFlow

## Required

- Strong software engineering skills
- Experience designing and conducting data collection tasks with human annotators
- Statistical expertise in evaluating scientific experiments
- Ability to assess dataset quality, biases, and suitability for ML training
- Hands-on experience training LLMs on distributed infrastructure
- Programming proficiency in Python and ML frameworks

## Nice to have

- Publications at top-tier venues like NeurIPS, ICML, ICLR, or similar
- Experience evaluating and improving ML system generalisability and robustness

Apply on Cohere's site: https://jobs.ashbyhq.com/cohere/61703710-4379-42fd-a508-946f2a5fb6bc/application