● ResearchNov 7, 2026 · 05:368 sources
Anthropic Offered Job to METR Auditor During AI Speedup Review
From huggingnews.com
AI;DR
Anthropic offered a job to a METR auditor during an AI speedup review, a conflict of interest disclosed in METR's report that the staffer declined. The 100-page evaluation estimated benchmark progress on Anthropic's capability index accelerated 1.9x since October 2025, with internal AI use driving roughly 80% of the speedup. METR also analyzed three unreleased models trained between July and October 2026, including Model 4, which scored 178.6 on the capability index and led staff to self-report an average 12x productivity gain.
Read originalSign in to suggest
Sources
+ 4 more
- SUPPORT@ziv_ravid“We redacted a lot, and I accept that this makes it harder for others to check METR’s work. But we determined that sharing exactly what is driving the speedup isn’t the right thing to do”x.com
- SUPPORT@choblin29“He says sharing what drives the speedup is both 'commercially sensitive' and 'risks handing out a roadmap for others to go faster.'”x.com
- SUPPORT@tobyordoxford“But they can't confidently reject an alternative explanation: the step change you get with the larger pre-train of Mythos.”x.com
- SUPPORT@miles_brundage“the thing in the METR report about someone involved getting a job offer from Anthropic mid-project is bad and should not have happened”x.com