Impact of modeling assumptions on time horizon results

researchMETR BlogMar 20, 2026

As METR’s time horizon task suite saturates, the results are becoming more sensitive to analysis choices. One example of this was the recent update to fix a modeling mistake with regularization, which decreased recent models’ 50% time horizon results by up...

Impact: MediumConfidence: MediumNovelty: Material
researchsource-feed-1bdee3f1-6eca-4e71-a9df-4f6430ba5051agentscodingopen-source

See the whole story

Read the original on METR Blog

Sens.ai aggregates and assesses published reporting. The assessment above is machine generated; the original source is authoritative.