Back to Featured
OpenRouter:AnnouncementsKenny Rogers2026-09-22 08:00September 22

OpenRouter’s Hands-On Measurement of Jev 1.13 and Claude Opus 5 on Accuracy, Latency, and Cost for the Banking77 Classification Task

Is Jev as Accurate as Frontier Models at Classification?

AI Briefing

OpenRouter compared the intent-classification performance of Jev 1.13 and Claude Opus 5 using 3,080 customer-service utterances from the Banking77 test set. Jev's accuracy was 81.0%, 3.3 percentage points below Opus's 84.4%, but its median latency was 175 ms, approximately 1/13 of Opus's 2,266 ms. The cost per 1,000 requests was $0.11 versus $2.42 with prompt caching enabled.

Source: OpenRouter: Announcements · openrouter.ai

Event follow-up1

View all event coverage

Finished reading the news? Let’s talk about your business.

Leave your contact details, and I’ll get in touch with you personally.

WECHAT

Add me on WeChat

Press and hold or select the WeChat ID below to copy it.