Scott Wiener Aims to Shape Federal AI Policy Following Pelosi Seat Win
Scott Wiener, a California state senator known for authoring legislation aimed at curbing advanced AI risks, has recently secured former Speaker of the House Nancy Pelosi’s open San Francisco congressional seat. This victory positions him to play a pivotal role in shaping federal AI policy, a prospect he is already actively pursuing, warning that "we could sleepwalk into a disaster."

Wiener's immediate focus on AI risk was evident shortly after his election victory. He cited a report released by the AI nonprofit METR, which was widely interpreted as evidence that Anthropic had achieved recursive self-improvement. This phenomenon, where AI meaningfully contributes to its own advancement and progress potentially spirals beyond control, deeply concerns Wiener, who sees it as a clear indication that Congress is rapidly losing time to act decisively. He expressed disappointment that "Congress would take decisive action before [the end of] this year," which "does not appear to be happening."
Having previously influenced AI policy at the state level, Wiener authored SB 1047 in 2024, a bill intended to be the country's first frontier AI legislation, though it was vetoed by California Governor Gavin Newsom. He subsequently sponsored SB 53, a lighter-touch bill that Newsom signed, both of which have served as inspirations for proposed federal legislation. Wiener’s congressional campaign received over $3 million from Public First Action, a nonprofit advocating for AI regulation with substantial funding from Anthropic. Despite criticism of being too close to the AI industry, Wiener countered, stating Public First supported him because he was "the first lawmaker in the country to introduce AI regulation and the first to pass it and get it implemented."
Wiener advocates for robust federal oversight, pushing for a powerful, empowered, and nimble federal AI regulator, echoing proposals from Representative Ro Khanna. He also emphasizes the critical need for whistleblower protections, comprehensive testing and auditing requirements, and a "kill switch" mandate. Furthermore, he seeks to leverage Congress's oversight powers to hold AI labs accountable, stressing the importance of public involvement and transparency in decisions concerning "the future of humanity." As a former state legislator, Wiener is firmly against federal preemption of state AI laws, viewing states as "laboratories" that can remain nimble where Congress sometimes cannot.
He articulates the dangers of AI catastrophe in language often used by AI safety experts, asserting, "We’re in a moment that is very dangerous in terms of the risk of loss of control over AI." He specifically highlights recursive self-improvement as "potentially a recipe for total loss of control." Wiener finds allies in this fight, such as Senator Bernie Sanders, who has engaged with influential figures in the AI safety movement. However, a significant disparity exists between Wiener’s "Bay Area, AGI-pilled perspective" and the broader national sentiment on AI, which often centers on opposition to data centers rather than existential risk.
What to watch: The progress of federal legislation on AI regulation, particularly concerning the establishment of a powerful regulator and the implementation of safeguards like kill switches and auditing requirements, will be a key indicator of Congress's willingness to address the rapidly evolving challenges posed by advanced AI.
Editor's note: The article is comprehensive, well-structured, and captures the nuance of Wiener's policy positions and political context provided in the text.
AI-generated and fact-checked against the original report; claims the gate cannot verify are held back.