California considers unique safety regulations for AI companies, but faces tech firm opposition
California lawmakers are weighing a bill that would regulate powerful artificial intelligence systems
SACRAMENTO, Calif. (AP) — California lawmakers are considering legislation that would require artificial intelligence companies to test their systems and add safety measures so they can't be potentially manipulated to wipe out the state's electric grid or help build chemical weapons — scenarios that experts say could be possible in the future as technology evolves at warp speed.
Legislators plan to vote Tuesday on this first-of-its-kind bill, which aims to reduce risks created by AI. It is fiercely opposed by tech companies, including Meta, the parent company of Facebook and Instagram, and Google. They say the regulations take aim at developers and instead should be focused on those who use and exploit the AI systems for harm.
Democratic state Sen. Scott Wiener, who authors the bill, said the proposal would provide reasonable safety standards by preventing “catastrophic harms” from extremely powerful AI models that may be created in the future. The requirements would only apply to systems that cost more than $100 million in computing power to train. No current AI models have hit that threshold as of July.
“This is not about smaller AI models,” Wiener said at a recent legislative hearing. “This is about incredibly large and powerful models that, as far as we know, do not exist today but will exist in the near future.”
