MineExplorer: The First Benchmark for Minute-Scale Long-Horizon Tasks in Minecraft
Taking AI Out of the Greenhouse and Into a Dynamic World: MineExplorer Reveals an Overlooked Capability Gap in Leading Multimodal Models
AI BriefingMeituan's LongCat team has released MineExplorer, the first benchmark for minute-scale long-horizon tasks in the open world of Minecraft, with 813 human-verified instances. Evaluation of 18 leading multimodal models found that the strongest, Claude-Opus-4.6, achieved an overall task success rate of just 41%. Success dropped sharply from 77% on 1-hop tasks to 12% on 4-hop tasks, with navigation failures accounting for nearly 60% of failures. MineExplorer is fully open source.
Source: WeChat Official Account: LongCat · mp.weixin.qq.com