Epoch AI evaluates frontier models on internal work tasks: Claude Fable 5.1 and GPT-6 Astra average only 65%
We tried to automate Epoch
AI BriefingEpoch AI released Epoch Automation Reports, testing AI on real internal tasks such as chart design and research planning against the standards used to evaluate human employees. The leading models, Claude Fable 5.1 and GPT-6 Astra, averaged 65%, falling short of the 100% threshold for automation.
Source: Epoch AI: Gradient Updates · epochai.substack.com
Event follow-up1
View all event coverage- Epoch AI evaluates frontier models on internal work tasks: Claude Fable 5.1 and GPT-6 Astra average only 65%Epoch AI:Gradient Updates · 21 days ago