Skip to main content
CareerApp

Research Engineer, LangSmith Engine

LangChain

New York, NY · full time · Senior

Listed on LangChain’s own careers site. You apply with them directly — we never stand between you and the employer.

What this role is

This research engineer role focuses on building benchmarks and running experiments to improve LangChain's autonomous agent system, with an emphasis on real-world performance, production costs, and system efficiency. It suits researchers with deep LLM experience who can bridge the gap between ML innovation and reliable production systems.

Our summary, not LangChain’s wording. The full posting is on their site.

What they ask for

Required

  • 4+ years ML/AI research experience
  • Master's or Ph.D. in relevant scientific field
  • Hands-on experience with LLMs and AI agents
  • Experience designing benchmarks and evaluations for AI systems
  • Strong software engineering skills with research-to-production track record
  • Research judgment and ability to work through ambiguity

Nice to have

  • Ph.D. in Machine Learning, Computer Science, or Physics
  • LLM-as-a-judge or automated grader experience
  • Synthetic data generation or human evaluation experience
  • Post-training techniques experience (reinforcement learning, preference optimization, RLHF/RLAIF)
  • LLM agent cost or latency optimization in production
  • Model serving, inference optimization, or distributed systems experience

Turn on analytics and we load Google Analytics: Google gets the pages you open and what you do here — searches, jobs you view, jobs you apply to — and sets its own cookies. Leave it off and the only cookies we set are your login, your theme, and this answer. Accept All also records a yes to advertising, which nothing uses yet. Privacy Policy.