Machine Learning Engineer jobs in New York
32 open roles classified as Machine Learning Engineer and placed in New York, read from employers’ own careers sites.
Audio Inference Engineer, Model Efficiency
Cohere
Full-time · New York, NY · CA$250,000 – CA$535,000 · Remote
Cohere seeks an engineer to optimize audio model inference performance across latency, throughput, and quality metrics. This role suits someone with deep systems expertise in machine learning inference who can identify bottlenecks and deliver solutions for real-time audio processing at scale.
Listed on Cohere’s careers site · Apply there ↗
Staff Research Engineer, Model Efficiency
Cohere
Full-time · New York, NY · CA$250,000 – CA$535,000 · Remote
Cohere is seeking a Staff Research Engineer to develop and deploy techniques that improve the speed and efficiency of large language model inference in production. This role is ideal for someone with advanced ML expertise and a track record of publishing optimization research who wants to tackle the practical challenge of making AI systems run faster and more efficiently at scale.
Listed on Cohere’s careers site · Apply there ↗
Member of Technical Staff, Agent Code
Cohere
Full-time · New York, NY · CA$250,000 – CA$535,000 · Remote
Cohere seeks a senior researcher-engineer to develop code-generating language models and autonomous agent systems for enterprise applications. This is a hands-on role blending research and production engineering, requiring deep expertise in code LLMs and the ability to push frontier models at scale.
Listed on Cohere’s careers site · Apply there ↗
Member of Technical Staff, Pre-Training Data
Cohere
Full-time · New York, NY · CA$250,000 – CA$535,000 · Remote
This Machine Learning Engineer role focuses on building and optimizing data pipelines for large language model training, with responsibility for data quality assessment, mixture design, and curation techniques. It suits engineers who want to combine infrastructure work with research to directly improve AI model performance.
Listed on Cohere’s careers site · Apply there ↗
Member of Technical Staff, Post-Training
Cohere
Full-time · New York, NY · CA$250,000 – CA$535,000 · Remote
This role focuses on improving large language models through post-training techniques, combining research and production engineering. It suits experienced ML engineers who want to work on state-of-the-art model optimization at significant scale.
Listed on Cohere’s careers site · Apply there ↗
Member of Technical Staff, Training Infra Engineer
Cohere
Full-time · New York, NY · CA$250,000 – CA$535,000 · Remote
This role focuses on building and optimizing the infrastructure that trains Cohere's large language models at scale, working closely with researchers to improve training pipelines and performance. It suits engineers with strong software fundamentals and hands-on experience in distributed systems who want to bridge research and production in a compute-rich environment.
Listed on Cohere’s careers site · Apply there ↗
Member of Technical Staff, Modeling
Cohere
Full-time · New York, NY · CA$250,000 – CA$535,000 · Remote
This role involves designing and deploying frontier AI models for enterprise use, blending research innovation with production engineering. It suits researchers and engineers who want to work on large-scale foundation models with access to significant compute resources and collaborative teams.
Listed on Cohere’s careers site · Apply there ↗
Machine Learning Engineer jobs in other states
Other roles hiring in New York
Reports on Machine Learning Engineer hiring
- Texas Postings Doubled This Week: 585 New Roles vs 285, Second Only to CaliforniaSep 16, 2026
- New York Added 386 New Roles This Week, Up 11.6% While the National Week Rose 22.6%Sep 13, 2026
- Minnesota Postings Triple to 213 New Roles This Week, the Biggest Jump of Any State We TrackSep 9, 2026
Canonical: https://career.thegoodapps.co/jobs/in/new-york/machine-learning-engineer