Google DeepMind Engineer Quits, Saying His Chip Work Could Speed Up AI

Robert O’Callahan says his tools could make AI cheaper and faster. He sees the risks as uncertain, but serious enough to change his work.

By 2 min read
Google DeepMind Engineer Quits, Saying His Chip Work Could Speed Up AI
Google DeepMind Engineer Quits, Saying His Chip Work Could Speed Up AI

Listen to this story

The audio brief

About 1:26
0:001:26
Read transcript
Robert O’Callahan has resigned from Google DeepMind after concluding that the chip-design tools he built could help make AI cheaper and faster. He wasn’t building AI models. But he came to see tools for designing chips as a way to accelerate the hardware behind them—and decided he could no longer justify that contribution. In a resignation email shared on his blog, O’Callahan called AI progress far too rapid. He says the risk of artificial superintelligence, or ASI, is real but uncertain; he is not claiming catastrophe is inevitable. His concern is that engineers may need to act before the outcome is clear. He also points to risks including overreliance on AI, loneliness, concentrated power, economic disruption, cybersecurity threats and weak accountability. He says regulation is urgently needed. Leaving came with a cost: he described the job as an amazing chance to solve interesting problems and earn well. A transfer wasn’t practical, he said, because Google had no other engineering teams in New Zealand. He expects his departure to have only a small effect, though not zero, given his rare skills. He isn’t leaving AI-related work altogether. He plans to maintain the debugging tools rr and Pernosco, and study how AI agents debug code. He says he wants his next project to be unambiguously pro-human. The open question is whether other people building tools that could speed AI development will draw the same line.

Story brief

3 key points

Robert O’Callahan has resigned from Google DeepMind, where he built chip-design tools rather than AI models, after deciding those tools could help accelerate AI hardware development. The New Zealand-based engineer says a transfer was impractical because Google had no other engineering teams there, and he expects his departure to have only a small—but nonzero—effect given his rare skills. He plans to remain in...

  1. 01

    O’Callahan describes the risk of artificial superintelligence as real but uncertain; he does not claim catastrophe is inevitable.

  2. 02

    His concerns also include overreliance on AI, loneliness, concentrated power, economic disruption, cybersecurity, and weak accountability; he says regulation is urgently needed.

  3. 03

    He says many DeepMind colleagues share his concerns, but that is his account—not a public position from those colleagues.

The work Robert O’Callahan once considered relatively harmless now looks to him like a way to speed up AI. The Google DeepMind engineer has resigned after concluding that his chip-design tools could help make AI cheaper, faster and more capable. His decision turns on a difficult judgment: how much certainty about future harm should an engineer need before stepping away?

The work behind the models

O’Callahan worked on tools for designing hardware chips, not on building AI models. For a time, he told himself that distinction made his job relatively harmless. He later concluded that the tools could accelerate the design of AI chips, a contribution he could no longer justify.

His objection is partly about pace. In a resignation email shared on his blog, O’Callahan called AI progress “far too rapid.” He said his team’s goal of making AI much cheaper and quicker to use was not good for people right now.

Leaving carried a personal cost. O’Callahan described the job as an “amazing” chance to be well paid for solving interesting problems. He said a transfer was impractical because Google had no other engineering teams in New Zealand, where he was based.

aiming for ASI in the near future is inherently irresponsible.

Robert O’Callahan, as quoted by The Decoder

A warning without a certainty claim

ASI means artificial superintelligence. O’Callahan calls its risk “real but uncertain”; he does not say catastrophe is inevitable. He linked to the book If Anyone Builds It without endorsing its claim that superintelligent AI must bring catastrophe. His case for leaving rests on taking a possible danger seriously before its outcome is known.

His concerns extend beyond that worst-case scenario. O’Callahan warned about people surrendering their thinking to AI, AI-related psychosis and loneliness, concentrated power, economic disruption, cybersecurity threats and weak accountability.

O’Callahan said many colleagues at DeepMind share his concerns but rarely speak publicly. That is his account of their views, rather than a public position from those colleagues. He also said regulation is “desperately needed.”

Leaving DeepMind, not leaving AI

O’Callahan does not plan to abandon AI-related work. He intends to keep maintaining the debugging tools rr and Pernosco and to study how AI agents debug code. He says he wants his next project to be “unambiguously pro-human.” For him, the line is not between touching AI and avoiding it altogether, but between kinds of work he can and cannot defend.

He expects his resignation to have a very small effect, though he argues it will not have none because some of his skills are rare. Whether others who build tools that could speed AI development would make the same choice remains an open question.

Sources

  1. timesofindia.indiatimes.comGoogle engineer quits his "amazing" job over AI, and says the doomers have it wrong: I am not convinced the chance of ASI doom is…
  2. the-decoder.comAnother Google Deepmind researcher quits, says building superintelligent AI soon is "inherently irresponsible"

Loading discussion...

YOUR READING SPACE

Notifications