Machine Learning Engineer jobs in New York

AssemblyAI

New York, NY · $270,000 – $310,000 · Remote

A Senior Research Engineer role focused on optimizing large-scale distributed training, data processing, and inference systems for a voice AI platform. This suits engineers with deep expertise in JAX, TPUs, and ML infrastructure who want to directly impact both research velocity and production systems at a capital-efficient, fast-moving company.

Listed on AssemblyAI’s careers site · Apply there ↗

Plug n Play Portfolio

Full-time · New York, NY · $200,000 – $235,000 · Remote

EvolutionIQ is seeking an experienced engineer to lead the development of AI and machine learning systems for their insurance claims product, focusing on large language models, retrieval-augmented generation, and hybrid machine learning approaches. This role suits someone with 5+ years of Python experience, proven success shipping LLM-powered products, and the technical leadership skills to drive complex projects from conception through production deployment.

Listed on Plug n Play Portfolio’s careers site · Apply there ↗

Vercel

New York, NY · $250,000 – $330,000

Vercel seeks a staff-level machine learning scientist to architect and lead the company's consumption forecasting systems, which inform financial planning and infrastructure decisions across their platform. This role combines advanced modeling expertise—particularly in time-series and probabilistic forecasting—with technical leadership, requiring you to set ML standards, mentor senior data scientists, and partner directly with finance and engineering leadership.

Listed on Vercel’s careers site · Apply there ↗

Patreon

Full-time · New York, NY · $212,000 – $318,000

This role builds and maintains the machine learning infrastructure that powers Patreon's creator discovery and content ranking systems, handling high-throughput inference pipelines and feature stores. It suits engineers with deep production ML systems experience who excel at designing scalable backend architectures and thrive on building foundational infrastructure.

Listed on Patreon’s careers site · Apply there ↗

Cohere

Full-time · New York, NY · CA$250,000 – CA$535,000 · Remote

Cohere is hiring research scientists and engineers to advance multilingual language models that work effectively across languages. This role suits experienced ML researchers or senior engineers with a publication track record who want to lead technical work on large-scale NLP systems serving global users.

Listed on Cohere’s careers site · Apply there ↗

Confido

New York, NY · $200,000 – $250,000

This senior role builds AI systems that extract structured data from messy financial documents and forecast demand across e-commerce supply chains. It suits someone with production ML experience who enjoys end-to-end ownership of complex, real-world problems in a fast-growing startup.

Listed on Confido’s careers site · Apply there ↗

LangChain

Full-time · New York, NY

This research engineer role focuses on building benchmarks and running experiments to improve LangChain's autonomous agent system, with an emphasis on real-world performance, production costs, and system efficiency. It suits researchers with deep LLM experience who can bridge the gap between ML innovation and reliable production systems.

Listed on LangChain’s careers site · Apply there ↗

Menlo Ventures Portfolio

Full-time · New York, NY · $350,000 – $500,000

This infrastructure engineer role owns the systems that researchers use to train and evaluate AI safeguard detection methods, bridging rapid experimentation with production reliability. You'll build the pipelines, tooling, and abstractions that let detection research scale as Anthropic's models evolve.

Listed on Menlo Ventures Portfolio’s careers site · Apply there ↗

Modal

New York, NY · $200,000 – $350,000

Modal is seeking an engineer to optimize machine learning inference and fine-tuning workloads on their GPU infrastructure platform. This role suits someone with deep experience in ML systems performance who enjoys debugging GPU bottlenecks and shipping optimizations at scale.

Listed on Modal’s careers site · Apply there ↗

Zencastr

New York, NY · Remote

A machine learning engineer role focused on building AI systems for podcast creation, particularly in speech processing and personalization. This suits engineers with deep ML experience who want to work on large-scale systems impacting millions of users.

Listed on Zencastr’s careers site · Apply there ↗

Plug n Play Portfolio

Full-time · New York, NY · $190,000 – $225,000 · Remote

EvolutionIQ seeks a Senior Machine Learning Engineer to build production ML models for insurance claims, working on novel problems in time series forecasting and NLP with access to large structured and unstructured datasets. This role suits engineers who thrive on unsolved technical challenges and want to own the full lifecycle from data exploration through model deployment in a high-growth insurtech environment.

Listed on Plug n Play Portfolio’s careers site · Apply there ↗

Confido

Full-time · New York, NY · $210,000 – $300,000

Own the ML infrastructure layer at Confido, building the pipelines, serving systems, and cloud foundation that turn AI models into reliable, cost-efficient production systems at scale. This role suits someone who thrives at the intersection of software engineering and infrastructure, ready to give an AI/ML team a smooth path from research to production in a fast-growing startup.

Listed on Confido’s careers site · Apply there ↗

Menlo Ventures Portfolio

Full-time · New York, NY · $350,000 – $850,000

Research engineer role focused on making Claude excel at domain-specific knowledge work in finance, healthcare, and legal. Combines applied AI research with hands-on data strategy, requiring experience with large language model fine-tuning, reinforcement learning, and managing technical vendor relationships.

Listed on Menlo Ventures Portfolio’s careers site · Apply there ↗

Cohere

Full-time · New York, NY · CA$250,000 – CA$535,000 · Remote

This role involves developing safety mechanisms and evaluation methods for large language models that can interact with external systems, focusing on data generation, post-training techniques, and robustness assessment. It suits machine learning engineers with strong software engineering skills, research experience, and a commitment to building trustworthy AI systems.

Listed on Cohere’s careers site · Apply there ↗

Modal

Full-time · New York, NY · $180,000 – $250,000

Modal is seeking a Forward Deployed ML Engineer to work directly with leading AI companies optimizing production workloads on their GPU infrastructure platform. The role combines hands-on technical work in inference and training optimization with customer-facing partnership and open-source contribution.

Listed on Modal’s careers site · Apply there ↗

Confido

Full-time · New York, NY · $250,000 – $330,000

Build AI systems that transform messy financial documents and enterprise data into clean, structured intelligence for a CPG platform used by major brands. This role suits someone with deep production ML experience who enjoys ownership across the full lifecycle of systems—from research to monitoring—and wants to tackle real-world data complexity.

Listed on Confido’s careers site · Apply there ↗

Menlo Ventures Portfolio

New York, NY · $350,000 – $850,000

This role owns the complete pipeline of creating training data and reinforcement learning environments to improve visual reasoning in large language models, partnering across teams to translate research into real-world capabilities. You'll combine applied research with hands-on data work, managing vendor relationships, designing reward systems, and running experiments to measure how data strategy improvements enhance multimodal model performance.

Listed on Menlo Ventures Portfolio’s careers site · Apply there ↗

Cohere

Full-time · New York, NY · CA$250,000 – CA$535,000 · Remote

This role focuses on ensuring the quality and robustness of large language models through data collection design, statistical evaluation, and experimental analysis. It suits researchers or engineers with strong ML fundamentals who want to bridge data science and model development at a frontier AI company.

Listed on Cohere’s careers site · Apply there ↗

Menlo Ventures Portfolio

Full-time · New York, NY · $500,000 – $850,000 · Remote

This role involves building training environments and evaluations for AI agents that can handle complex, long-horizon tasks in realistic settings. You'll blend research and engineering work, contributing to both novel approaches and research direction in reinforcement learning and safe AI development.

Listed on Menlo Ventures Portfolio’s careers site · Apply there ↗

Cohere

Full-time · New York, NY · CA$250,000 – CA$535,000 · Remote

Cohere seeks a senior engineer to design and maintain the training framework for frontier-scale language models, focusing on distributed systems, HPC infrastructure, and the tooling that connects research to thousands of GPUs. This role suits someone with deep experience in large-scale distributed training who enjoys working across the full ML systems stack to solve performance and reliability challenges.

Listed on Cohere’s careers site · Apply there ↗

Cohere

Full-time · New York, NY · CA$250,000 – CA$535,000 · Remote

This role develops the synthetic data pipelines that power Cohere's language models, combining research methods with engineering to improve model quality and efficiency. You'll work on data curation, ablation studies, and inference optimization across large-scale datasets and GPU clusters.

Listed on Cohere’s careers site · Apply there ↗

Menlo Ventures Portfolio

New York, NY · $350,000 – $500,000

This role involves building ML systems to detect and prevent misuse of AI models, from individual policy violations to coordinated attacks, plus developing defenses and safety evaluations for increasingly capable AI systems. It suits engineers or researchers with 4+ years of ML experience who want to work on AI safety and are comfortable moving from research prototypes to deployed systems.

Listed on Menlo Ventures Portfolio’s careers site · Apply there ↗