The benchmark is a material warning that long-horizon coding agents may be approaching useful autonomous software-engineering capability, but the reported results do not yet establish reliable general autonomy.
Limits of the evidence: The source is an analysis newsletter summarizing benchmark authors' results; the supplied text does not provide independent replication, full methodology, or details of the robotics demonstration.
What to watch
Taken from the first report; the whole story has not been re-assessed yet.
Import AI 466: The bitter lesson for robotics, AIs complete week-long programming tasks; and OpenAI's accidental AI hacker
Import AIJul 27, 2026First report
No revisions yet.
No maturity ladder applies to this desk.
Sens.ai aggregates and assesses published reporting. The assessment above is machine generated; the original sources are authoritative.