October 13, 2025
The GIST California enacts first US law requiring AI chatbot safety measures 
Andrew Zinin
lead editor
Editors' notes
This article has been reviewed according to Science X's editorial process and policies. Editors have highlighted the following attributes while ensuring the content's credibility:
fact-checked
reputable news agency
proofread
California Governor Gavin Newsom on Monday signed into law a first-of-its-kind law regulating artificial intelligence chatbots, defying a push from the White House to leave such technology unchecked.
"We've seen some truly horrific and tragic examples of young people harmed by unregulated tech, and we won't stand by while companies continue without necessary limits and accountability," Newsom said after signing the bill into law.
The landmark law requires chatbot operators to implement "critical" safeguards regarding interactions with AI chatbots and provides an avenue for people to file lawsuits if failures to do so lead to tragedies, according to state Senator Steve Padilla, a Democrat who sponsored the bill.
The law comes after revelations of suicides involving teens who used chatbots prior to taking their lives.
"The tech industry is incentivized to capture young people's attention and hold it at the expense of their real world relationships," Padilla said prior to the bill being voted on in the state Senate.
Padilla referred to recent teen suicides including that of the 14-year-old son of Florida mother Megan Garcia.
Megan Garcia's son, Sewell, had fallen in love with a "Game of Thrones"-inspired chatbot on Character.AI, a platform that allows users—many of them young people—to interact with beloved characters as friends or lovers.
When Sewell struggled with suicidal thoughts, the chatbot urged him to "come home."
Seconds later, Sewell shot himself with his father's handgun, according to the lawsuit Garcia filed against Character.AI.
"Today, California has ensured that a companion chatbot will not be able to speak to a child or vulnerable individual about suicide, nor will a chatbot be able to help a person to plan his or her own suicide," Garcia said of the new law.
"Finally, there is a law that requires companies to protect their users who express suicidal ideations to chatbots."
National rules aimed at curbing AI risks do not exist in the United States, with the White House seeking to block individual states from creating their own.
© 2025 AFP
Citation: California enacts first US law requiring AI chatbot safety measures (2025, October 13) retrieved 13 October 2025 from https://techxplore.com/news/2025-10-california-law-requiring-ai-chatbot.html This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.
Explore further
Death of 'sweet king': AI chatbots linked to teen tragedy
Feedback to editors
