Google engineer Robert O'Callahan resigns, saying AI progress is far too rapid
Robert O'Callahan · Personal post
Read the source (opens in a new tab)- What happened
- Robert O'Callahan wrote that he resigned from Google because his team's goal was to make AI "much cheaper and lower-latency," and he believes "AI progress is currently far too rapid."
- Key points
- He says the main impact of his chip-design tools would be faster design of AI chips, making AI "much cheaper and faster," more pervasive and more capable.
- He writes that many phenomena predicted by "doomers" have come to pass, naming "reward hacking, misalignment, deceptive models, model eval awareness, psychotic swarms."
- He says the risk is most likely high enough that aiming for superintelligence soon is "inherently irresponsible," and that AI is developing faster than people can understand it and adapt.
- He says almost all of the many Google DeepMind people he talked with have "sincere and serious concerns," and that national and international regulation is "desperately needed."
- Evidence
- Personal blog post by an engineer who just left Google. He worked on chip design tools, not AI models.