Jacob Coxon resigns from Anthropic, saying neither Anthropic nor OpenAI is acting responsibly

X · Personal post

Read the source (opens in a new tab)
What happened
Jacob Coxon, who did pretraining research at OpenAI and Anthropic, posted that he had resigned from Anthropic and that "Neither company is acting responsibly."
Key points
  • He writes that the two companies are "racing straight to self-improving superintelligence and gambling with our lives."
  • He says people building AI "earnestly believe that it could kill us all by the end of the decade," and that executives who sound measured in the press "express fear privately."
  • He says many at OpenAI have not "deeply internalized the civilizational stakes," while Anthropic understands them but is "locked in a race to get there first."
  • He says warning shots such as the Hugging Face attack have made pacing agreements between US labs more viable, but avoiding a global race may require costly steps such as "a temporary ban on improving model capabilities."
Evidence
Personal thread by a researcher who just left, giving his judgment of both companies. Apart from citing the Hugging Face attack as a warning shot, it gives no specific examples.
Uncertain
His account of what executives and researchers say in private is his own and cannot be checked from the thread.

See it in the latest record