Scott Wiener wins Pelosi’s House seat and calls for stronger federal AI rules
The incoming San Francisco representative backs testing requirements, whistleblower protections and emergency shutoffs. Turning those priorities into law remains an uncertain task.
Scott Wiener’s California record now offers a test case for how federal AI oversight could coexist with state rules: he authored SB 1047, which Gov. Gavin Newsom vetoed, and later sponsored the lighter SB 53, which Newsom signed. After winning San Francisco’s open House seat, Wiener told MIT Technology Review on Nov. 9 that he wants federal enforcement, audits, whistleblower protections, and shutdown options while resisting federal preemption. These are policy priorities, not introduced legislation, and he no longer expects Congress to act decisively before year-end.
01
Public First Action gave Wiener’s campaign more than $3 million; the nonprofit receives substantial funding from Anthropic, and Wiener said its support reflected his regulatory record.
02
Wiener cited recursive self-improvement as a possible path to AI loss of control, describing a risk rather than an event that has occurred.
03
He distinguishes catastrophic-AI concerns from local data-center opposition, which he associates mainly with development, electricity bills, and water use.
Congress is gaining an advocate for mandatory AI safeguards who wants Washington to regulate without pushing states aside. Scott Wiener, the California state senator who won Nancy Pelosi’s open San Francisco House seat, says his federal priorities include a powerful regulator, testing and auditing requirements, whistleblower protections and emergency shutoffs.
Wiener outlined that agenda to MIT Technology Review’s Grace Huckins in an interview published November 9. They spoke Friday, just hours after he was declared the winner. His remarks describe the policies he wants Congress to pursue, rather than a newly introduced federal measure.
A regulator with enforcement power
Wiener called for a strong, empowered and nimble federal regulator, pointing to legislation proposed by fellow California Democrat Ro Khanna. He also wants Congress to use its oversight powers to hold AI laboratories accountable and give the public more visibility into their work.
Beyond creating an agency, he highlighted several requirements he wants lawmakers to consider:
Whistleblower protections for people who raise concerns about AI.
Testing and auditing requirements for AI systems.
A kill-switch requirement, providing a way to shut systems down.
He would also be eager to serve on a select committee on artificial intelligence if Congress creates one. Democrats have discussed that possibility since September. Wiener said he had hoped Congress would take decisive action before the end of this year, but no longer expected that to happen.
California’s record—and a campaign funding dispute
Wiener reaches Washington with a legislative record on AI safety. He authored California’s SB 1047 in 2024, which Governor Gavin Newsom vetoed. He then sponsored the lighter-touch SB 53, which Newsom signed. Both measures have inspired proposed federal legislation.
He opposes broad federal preemption of state AI laws—national legislation that would displace state rules. Some proposed federal bills would require that approach. Wiener argues states should remain able to move quickly in ways Congress sometimes cannot, even as Washington builds its own oversight system.
His campaign backing has also drawn scrutiny. MIT Technology Review reported that his congressional campaign received more than $3 million from Public First Action, a nonprofit supporting AI regulation that receives substantial funding from Anthropic. Opponents cited that support to argue he was too close to the industry.
Wiener rejected that characterization in a message after the interview. He said Public First supported him because of his work introducing and passing AI regulation, and called the attacks cynical. His defense rested on his record of regulating AI over objections from major technology companies.
AI catastrophe is not the same fight as a data center
Wiener’s urgency centers on the possibility of losing control over AI. He singled out recursive self-improvement—AI contributing meaningfully to its own advancement—as a potential route to that outcome. That is his assessment of the risk, not a finding that such a loss of control has occurred.
He sees a different motivation behind opposition to data centers. In his view, that movement is driven more by nearby development, electricity bills and water use than by catastrophic AI risk. He described local opposition as an area where people concerned about AI can take concrete action.
For all his ambitions, Wiener described himself as only cautiously optimistic about Congress’s ability to rein in AI, citing its poor record regulating technology. He also expressed concern about getting legislation past President Donald Trump, who called concerns about catastrophic AI risk a hoax in September.
Reader comments
Newest comments first. Replies stay oldest first.