Impact of modeling assumptions on time horizon results
researchMETR BlogMar 20, 2026
As METR’s time horizon task suite saturates, the results are becoming more sensitive to analysis choices. One example of this was the recent update to fix a modeling mistake with regularization, which decreased recent models’ 50% time horizon results by up...
Impact: MediumConfidence: MediumNovelty: Material
researchsource-feed-1bdee3f1-6eca-4e71-a9df-4f6430ba5051agentscodingopen-source