# Research Engineer, LangSmith Engine

Hiring organization: [LangChain](https://career.thegoodapps.co/organizations/langchain)

Canonical page: https://career.thegoodapps.co/jobs/77851667-09f5-4ec4-9fd0-8d891df5f2a4

Listed on LangChain's own careers site. Applications go to them directly.

- Employment type: full time
- Seniority: Senior
- Location: New York, NY

## Summary

This research engineer role focuses on building benchmarks and running experiments to improve LangChain's autonomous agent system, with an emphasis on real-world performance, production costs, and system efficiency. It suits researchers with deep LLM experience who can bridge the gap between ML innovation and reliable production systems.

_Our summary, not LangChain's wording._

## Skills named

Benchmarking, Fine-tuning, LLMs (Large Language Models), Machine Learning, Prompt Engineering, Reinforcement Learning

## Required

- 4+ years ML/AI research experience
- Master's or Ph.D. in relevant scientific field
- Hands-on experience with LLMs and AI agents
- Experience designing benchmarks and evaluations for AI systems
- Strong software engineering skills with research-to-production track record
- Research judgment and ability to work through ambiguity

## Nice to have

- Ph.D. in Machine Learning, Computer Science, or Physics
- LLM-as-a-judge or automated grader experience
- Synthetic data generation or human evaluation experience
- Post-training techniques experience (reinforcement learning, preference optimization, RLHF/RLAIF)
- LLM agent cost or latency optimization in production
- Model serving, inference optimization, or distributed systems experience

Apply on LangChain's site: https://jobs.ashbyhq.com/langchain/bdc96ffd-2a95-4d63-bf8f-193574961e00/application