OpenAI Seeks Congress’s View on a Coordinated AI Slowdown

The company wants shared safety standards that could determine when frontier AI development slows or stops. But an agreement among competing labs may itself create an antitrust problem.

By 3 min read
OpenAI Seeks Congress’s View on a Coordinated AI Slowdown
OpenAI Seeks Congress’s View on a Coordinated AI Slowdown

Listen to this story

The audio brief

About 1:32
0:001:32
Read transcript
OpenAI is asking Congress for guidance on a legally sensitive question: could leading AI labs voluntarily coordinate a slowdown in frontier AI development if new capabilities fail to meet agreed safety thresholds? The request highlights a tension at the center of OpenAI’s safety strategy. The company wants shared standards for when development should slow or stop, but an agreement that limits development could be viewed under US antitrust law as an output restriction. The exact terms would matter, and the uncertainty alone could discourage rival labs from participating. OpenAI chief scientist Jakub Pachocki has argued that research organizations should coordinate on slowing future development until common safety bars are in place. But John Schulman, an OpenAI cofounder now at Thinking Machines, draws a legal distinction: competitors might be able to develop a shared pacing proposal without signing a binding agreement to restrict output. Congress has one possible route under consideration. The bipartisan, bicameral Collaboration on Adversarial Threats and Security Risks Act would create an antitrust safe harbor for defined safety and security collaboration. But its House version had only been referred to the Judiciary Committee when WIRED reported the story. OpenAI also supports mandatory, capability-based federal safety rules alongside industry standards. The key constraint is still unresolved: will Washington define a lawful path for safety coordination before competing labs try to define one themselves?

Story brief

3 key points

OpenAI is asking Congress whether frontier AI labs could legally coordinate a voluntary slowdown or shared safety thresholds, exposing a regulatory risk to its preferred safety strategy. Antitrust scholars caution that agreements limiting development could be viewed as output restrictions, though a joint proposal is not necessarily a binding pact. A bipartisan, bicameral bill introduced in July would protect...

  1. 01

    OpenAI supports shared standards for when development should slow or stop if capability gains fail to meet safety thresholds.

  2. 02

    The Collaboration on Adversarial Threats and Security Risks Act would provide an antitrust safe harbor for defined safety collaboration.

  3. 03

    The bill’s House version was referred to the Judiciary Committee and had not advanced when WIRED reported the story.

A voluntary pact among leading AI labs to slow development could face a legal barrier before it faces a technical one. OpenAI has asked members of Congress for guidance on whether a coordinated industry-wide slowdown in frontier-AI development would be lawful, according to people close to the company.

The request puts a sharp constraint on a growing safety argument. OpenAI has publicly said it wants to work with other frontier labs on voluntary standards, including shared standards for when development should slow or stop. Its policy position is that safety requirements should set the pace when capability growth cannot meet necessary safety bars.

A safety proposal that can resemble market coordination

The legal concern is not abstract. Legal scholars have warned that an agreement to limit AI development might be treated as a restriction on output under US antitrust law. Whether it would violate the law would depend on the agreement’s exact terms, but uncertainty alone can deter companies from joining a safety arrangement.

That creates an awkward split between setting a common safety goal and agreeing on conduct that achieves it. OpenAI chief scientist Jakub Pachocki has argued that research organizations should coordinate to slow future development, expecting voluntary slowdowns to become common until shared safety bars are in place.

Congress has a narrow proposal, not a settled answer

Lawmakers have already introduced one possible route around the problem. A bipartisan, bicameral group introduced the Collaboration on Adversarial Threats and Security Risks Act in July. The bill would allow AI labs to coordinate on safety and security work without risking antitrust liability.

But the measure is not yet a solution available to companies. Its House version was referred to the Judiciary Committee and had not been taken up when WIRED published its report. OpenAI has separately called for mandatory, capability-based national AI safety regulation, while saying industry standards should complement rather than replace federal safeguards.

Agreement on a proposal is not agreement on a pause

The antitrust issue may be narrower than it first appears. John Schulman, an OpenAI cofounder now serving as chief scientist at Thinking Machines, argued that OpenAI and Anthropic could jointly develop a pacing proposal even if some agreements between competitors are prohibited. His point was that a proposal and a binding arrangement to restrict development are different acts.

The choices now in view

  • Labs could develop voluntary standards while avoiding commitments that could be seen as restricting output.
  • Congress could create a legal safe harbor for specified safety and security collaboration.
  • Federal rules could establish mandatory safety requirements instead of leaving pacing solely to private agreements.

OpenAI’s outreach does not establish that a coordinated slowdown would be illegal, or that rival labs would agree to one. It does show that the company sees the law as a potential obstacle to the collective safety system it is urging. The unresolved question is whether Washington will define a permitted path before private competitors attempt to define one themselves.

Sources

  1. openai.comThe AI policy window is open. We need to act.
  2. wired.comOpenAI Wants to Know if an AI Industry Slowdown Would Even Be Legal

Loading discussion...