Google engineer Robert O'Callahan resigns, saying AI progress is far too rapid

Robert O'Callahan · Personal post

Read the source (opens in a new tab)
What happened
Robert O'Callahan wrote that he resigned from Google because his team's goal was to make AI "much cheaper and lower-latency," and he believes "AI progress is currently far too rapid."
Key points
  • He says the main impact of his chip-design tools would be faster design of AI chips, making AI "much cheaper and faster," more pervasive and more capable.
  • He writes that many phenomena predicted by "doomers" have come to pass, naming "reward hacking, misalignment, deceptive models, model eval awareness, psychotic swarms."
  • He says the risk is most likely high enough that aiming for superintelligence soon is "inherently irresponsible," and that AI is developing faster than people can understand it and adapt.
  • He says almost all of the many Google DeepMind people he talked with have "sincere and serious concerns," and that national and international regulation is "desperately needed."
Evidence
Personal blog post by an engineer who just left Google. He worked on chip design tools, not AI models.

See it in the latest record