METR agrees Anthropic's automated R&D risk was low but says an early warning threshold may already have been crossed

METR · Research report

Read the source (opens in a new tab)
What happened
METR published on November 5, 2026, its review of the "Risks from automated R&D" section of Anthropic's August 2026 Risk Report, written at Anthropic's request with access to the unredacted report.
Key points
  • METR agrees the July 15 models posed low risk but finds it plausible they had crossed Anthropic's 2x acceleration threshold, which Anthropic treats as an early warning.
  • The public report puts leading indicators' acceleration "less than a factor of 2"; METR calculates the private report's figures imply 1.97, and its own estimates span 1.3 to 2.8.
  • The private report called it "plausible" that AI-driven acceleration exceeded a factor of 2; METR says the public version implied confidence that only a smaller share came from AI.
  • METR "cannot rule out a substantial further acceleration in the pace of capabilities progress over the next 6 months," which it says could rapidly lead to high risk.
Evidence
Independent evaluator's review of a company risk report, comparing its public wording with the private version. It weighs Anthropic's arguments and evidence; it is not a new evaluation of the models.
Uncertain
Most researchers at METR and Anthropic lean toward the threshold not having been crossed. Anthropic could redact the review; METR says every redaction important to its conclusions is described.

See it in the latest record