Back to Featured
UK AI Security Institute: Blog2026-10-26 07:0022 days ago

UK AISI tests show that filtering ESM-2 pretraining data can weaken targeted capabilities, but around $80 in compute can restore them

Pretraining data filtering in open-weight biological models

AI Briefing

The UK's AI Security Institute Chem-Bio team pretrained ESM-2 protein language models with 8M to 3B parameters from scratch to test the effects of pretraining data filtering on specialized scientific models.

Source: UK AI Security Institute: Blog · aisi.gov.uk

Event follow-up1

View all event coverage

Finished reading the news? Let’s talk about your business.

Leave your contact details, and I’ll get in touch with you personally.

WECHAT

Add me on WeChat

Press and hold or select the WeChat ID below to copy it.