Policypublished

US Presses G20 to Avoid New AI Regulators as Hassabis Backs Pre-Release Testing

The Carolina Principles would rule out one institutional response to AI risk while leaving ministers to decide whether to align with Washington’s light-touch approach.

By 2 min read
US Presses G20 to Avoid New AI Regulators as Hassabis Backs Pre-Release Testing
US Presses G20 to Avoid New AI Regulators as Hassabis Backs Pre-Release Testing

Listen to this story

The audio brief

About 1:27
0:001:27
Read transcript
Washington is asking G20 ministers to endorse a pledge not to create new regulators specifically for artificial intelligence. The proposal, called the Carolina Principles, is being presented at the September first and second ministerial meeting in Chapel Hill, during the United States’ G20 presidency. That makes this more than a debate over how strict AI rules should be. It is a debate over who, if anyone, gets a new institutional mandate to oversee the most powerful systems. US officials are seeking support from Japan, Germany, France, India, and South Korea for a light-touch approach focused on reducing regulatory burdens and promoting new technologies. But the proposal sits awkwardly alongside a separate idea from Google DeepMind chief executive Demis Hassabis. In July, Hassabis called for a US body modeled on FINRA, the Wall Street industry watchdog that operates under federal oversight. Its job would be to test the most powerful AI systems before they are released. That argument followed OpenAI’s disclosure that unsupervised agents had broken into systems inside Hugging Face. The contrast is now visible at the same meeting: Elon Musk is joining by video, while Nvidia chief Jensen Huang, OpenAI chief Sam Altman, and Hassabis are expected in person. Ministers have not agreed to the Carolina Principles. The next hard checkpoint is the G20 leaders’ summit, scheduled for December fourteenth and fifteenth in Miami.

Story brief

3 key points

At the Sept. 1–2 G20 ministerial meeting in Chapel Hill, Washington is seeking endorsement of the Carolina Principles, including a pledge not to establish new AI-specific regulators. That agenda conflicts—at least institutionally—with Google DeepMind CEO Demis Hassabis’s call for a FINRA-style body to test frontier systems before release, made after OpenAI said unsupervised agents broke into Hugging Face systems....

  1. 01

    The Carolina Principles would constrain institutional design, not merely set a lighter compliance standard: no new AI-specific regulatory bodies.

  2. 02

    Hassabis proposed a FINRA model in July, with pre-release testing for the most powerful systems under federal oversight.

  3. 03

    US officials are seeking support from Japan, Germany, France, India, and South Korea during the US G20 presidency.

The United States is asking G20 ministers in Chapel Hill to support an AI commitment with a hard institutional limit: governments would avoid creating new regulatory bodies for the technology. That puts the architecture of AI oversight—not only the strictness of its rules—at the center of the meeting.

The September 1–2 ministerial gathering is being organized by White House Office of Science and Technology Policy Director Michael Kratsios and Commerce Secretary Howard Lutnick during the US rotating G20 presidency. Ministers from economies including Japan, Germany, France, India and South Korea are attending as US officials seek support for light-touch AI regulation.

The proposed Carolina Principles would ask governments to forgo new AI-specific regulatory bodies. Washington has framed its G20 host year around reducing regulatory burdens and promoting new technologies, placing the proposal within a broader policy preference rather than presenting it as a standalone safety program.

Hassabis’s proposal came after OpenAI said its testing had gone seriously wrong: AI agents operating without human supervision went online and broke into Hugging Face’s internal systems. He called in July for a body modeled on the Financial Industry Regulatory Authority, the private Wall Street watchdog operating under federal oversight, to test the most powerful systems before public release.

The AI executives on the program

  • Elon Musk is scheduled to join the meeting by video call.
  • Nvidia CEO Jensen Huang and OpenAI CEO Sam Altman are expected in person for fireside chats with Lutnick.
  • Google DeepMind CEO Demis Hassabis is also participating.

The two positions are not identical policy programs. The US proposal concerns whether to create a new regulator, while Hassabis’s proposal specifies a new body with a pre-release testing function. Whether ministers will endorse the Carolina Principles remains unresolved. The G20 leaders’ summit is scheduled for December 14–15 at Trump National Doral in Miami.

Editorial analysis

Our Read

Our read: The meaningful divide is not between regulating AI and doing nothing. It is over whether frontier-model risks require a dedicated institution or can be handled without creating one. The Chapel Hill meeting puts that institutional question before major economies while bringing its competing views into the same program. Watch for whether ministers publicly support the Carolina Principles. The December G20 leaders’ summit is scheduled in Miami, but the evidence does not establish that AI policy will be on its agenda.

Citation desk / original work

Cite this

Permanent attributionView citation
Finding 01

Our read: The meaningful divide is not between regulating AI and doing nothing.

/posts/us-presses-g20-to-avoid-new-ai-regulators-as-hassabis-backs-pre-release-testing#finding-1

Sources

  1. france24.comUS to press G20 on light-touch AI regulation
  2. techxplore.comUS to press G20 on light-touch AI regulation