AI R&D-relevant model capabilities are improving rapidly and are getting harder to measure
benchmarksMETR ResearchNov 20, 2026
Contents Overview 1 Background 2 Methodology 3 Results 4 Robustness Checks 5 Discussion 6 Acknowledgments Appendices A Difficulty Estimation and Baselining B Time Horizon Diagnostics C MCI Modelling Methodology D Limitations of IRT E MCI Robustness Checks F...
Impact: MediumConfidence: MediumNovelty: Material
benchmarkssource-feed-92851532-c6c4-4203-933d-ecc01d4e1171agentscodingmultimodalopen-source