Back to Featured
Cognition Models / Devin Blog2024-03-15 00:00March 15

Cognition Releases Devin’s SWE-bench Technical Report

SWE-bench technical report

AI Briefing

Cognition released a technical report on Devin’s performance on SWE-bench. Devin solved 79 problems in a randomly sampled set of 570 tests, achieving a success rate of 13.86%, higher than the previous best baseline of 4.80% for Claude 2 with assistance and 1.96% without assistance.

Source: Cognition model / Devin blog · cognition.com

Finished reading the news? Let’s talk about your business.

Leave your contact details, and I’ll get in touch with you personally.

WECHAT

Add me on WeChat

Press and hold or select the WeChat ID below to copy it.