# Member of Technical Staff, Training Infra Engineer

Hiring organization: [Cohere](https://career.thegoodapps.co/organizations/cohere)

Canonical page: https://career.thegoodapps.co/jobs/adfa17be-d7ac-4fb8-9e55-738008656b87

Listed on Cohere's own careers site. Applications go to them directly.

- Employment type: full time
- Location: New York, NY
- Remote: yes
- Salary: 250000 – 535000 CAD per year

## Summary

This role focuses on building and optimizing the infrastructure that trains Cohere's large language models at scale, working closely with researchers to improve training pipelines and performance. It suits engineers with strong software fundamentals and hands-on experience in distributed systems who want to bridge research and production in a compute-rich environment.

_Our summary, not Cohere's wording._

## Skills named

JAX, Kubernetes, Python, PyTorch, V-Ray

## Required

- Extremely strong software engineering skills
- Proficiency in Python and ML frameworks (JAX, PyTorch, XLA/MLIR)
- Experience with distributed training infrastructures (Kubernetes, Slurm) and frameworks like Ray
- Experience with large-scale distributed training strategies
- Hands-on experience training large models at scale and contributing to training infrastructure tooling or setup

## Nice to have

- Publication at top-tier ML and systems venues (NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP)

Apply on Cohere's site: https://jobs.ashbyhq.com/cohere/a13207e7-dc82-473f-8ca4-e832452fe8c3/application