How Numan built the evaluation-first AI health coach Nu with LangGraph and LangSmith
How Numan Built an Eval-First AI Health Coach with LangGraph and LangSmith
AI BriefingThe UK digital health company Numan reviews the development of its AI health coach Nu's evaluation system. The core conclusion is that the scarce asset is not prompts but evaluation standards. Single-turn static datasets and scripted multi-turn conversations both struggle to cover real-world conversations, so Nu switched to a topic-based dataset scored by category, a simulated conversation layer in which a less expensive model plays the patient, and automatic safety regression checks that block releases.
Source: LangChain: Blog · langchain.com
Event follow-up1
View all event coverage- How Numan built the evaluation-first AI health coach Nu with LangGraph and LangSmithLangChain:Blog · 28 days ago