ARC-AGI-3 was saturated by Astra just six months after launch, progressing twice as fast as François Chollet expected
Progress continues to surprise even the best of us. ARC-AGI-3 was the first ARC-AGI benchmark that I...
AI BriefingSherwin Wu says he once thought ARC-AGI-3 was very difficult, but Astra has now saturated the benchmark. Quoting François Chollet, he notes that when ARC 3 launched, Chollet expected frontier models to take about a year to saturate it; in fact, it took only 6 months, roughly 2 times faster than expected. The capabilities of the new generation of models will challenge views of AI formed around older models.
Source: Sherwin Wu · x.com