Back to Featured
Ai2 / Allen Institute for AI2026-10-27 16:0020 days ago

Ai2 releases Old Ideas, Novel Problems research and benchmark, revealing instability in LLM novelty judges

Can we trust LLMs to judge whether a research idea is novel?

AI Briefing

Ai2 releases the study Old Ideas, Novel Problems, along with a benchmark, data, code, and an automated pipeline, to test the reliability of LLMs as judges of research idea novelty.

Also reported by 1 other source

Source: Ai2 / Allen Institute for AI · allenai.org

Event follow-up1

View all event coverage

Finished reading the news? Let’s talk about your business.

Leave your contact details, and I’ll get in touch with you personally.

WECHAT

Add me on WeChat

Press and hold or select the WeChat ID below to copy it.