METR finds Anthropic is likely improving its models on well-specified tasks about twice as fast as before, mostly because of AI

METR · Research report

Read the source (opens in a new tab)
What happened
METR published on November 5, 2026, its assessment of how much AI is accelerating AI research at Anthropic, after an August 12 to October 29 engagement with access to internal data.
Key points
  • Benchmark scores for Anthropic's models have grown 1.9x faster since October 2025 (95% interval 1.5 to 2.8x), roughly two years of historical progress in one year.
  • METR guesses a majority, perhaps about 80%, of the October 2026 acceleration is due to AI, and is confident faster growth in training compute did not cause it.
  • Finding no clear bottlenecks for the next 12 months, METR sees "a significant risk that further capabilities progress could lead to even faster acceleration."
  • Anthropic redacted "a majority of the evidence we found most informative" and canceled a planned check of how its compute is split between capabilities and safety.
Evidence
Independent evaluator's assessment built on Anthropic's internal data, interviews and benchmarks, done without payment and subject to Anthropic's redaction rights. It is not an evaluation of a specific model.
Uncertain
METR gives the twofold estimate "with high uncertainty"; 1.3x or 3x would not surprise it. Because of redactions, it says the public must rely on its judgment more than is ideal.

See it in the latest record