Back to Featured
LangChain:Blog2026-10-19 23:0028 days ago

How Numan built the evaluation-first AI health coach Nu with LangGraph and LangSmith

How Numan Built an Eval-First AI Health Coach with LangGraph and LangSmith

AI Briefing

The UK digital health company Numan reviews the development of its AI health coach Nu's evaluation system. The core conclusion is that the scarce asset is not prompts but evaluation standards. Single-turn static datasets and scripted multi-turn conversations both struggle to cover real-world conversations, so Nu switched to a topic-based dataset scored by category, a simulated conversation layer in which a less expensive model plays the patient, and automatic safety regression checks that block releases.

Source: LangChain: Blog · langchain.com

Event follow-up1

View all event coverage

Finished reading the news? Let’s talk about your business.

Leave your contact details, and I’ll get in touch with you personally.

WECHAT

Add me on WeChat

Press and hold or select the WeChat ID below to copy it.