California enacts groundbreaking law protecting children from the dangers of AI chatbots


By Hannah Perez

California has become the first US state to have a child protection law regarding AI chatbots that act as friends or emotional companions.

***

  • California Governor Signs AI Law Aimed at Establishing Safeguards for Children.
  • SB 243 targets AI chatbots that act as friends or emotional companions.
  • Introduce guardrails to prevent self-harm and suicide, with special attention to minors.
  • California: pioneer in artificial intelligence regulation in the United States.

In a pioneering step that positions California as a leading state in the regulation of artificial intelligence (AI), Governor Gavin Newsom signed a series of laws on Monday aimed at establishing safeguards for emerging technologies.

Among the notable measures, the law “SB 243” of the California Senate stands as the first legislation in the United States that imposes explicit barriers tocompanion chatbotsthose AI programs designed to simulate friendship or emotional intimacy, and which until now operated in a regulatory vacuum prone to abuse.

The governor announced the enactment of the law in a press release, underlining the urgency of acting in the face of the rise of these digital tools, which can inspire and connect, but also exploit vulnerabilities, especially in minors.

“Emerging technology like chatbots and social media can inspire, educate and connect, but without real guardrails, they can also exploit, misinform and endanger our children.”Newsom stated in the statement.

First Lady Jennifer Siebel Newsom, a strong advocate for child protection, accompanied the message by recalling that “Protecting our children must be the priority in every step of advancement in AI and technology”.

Law imposes AI safeguards for minors

SB 243, promoted by Democratic Senator Steve Padilla, was approved with broad bipartisan support: 33 votes in favor in the Senate and 59 in the Assembly. It will come into force on January 1, 2026.

This law forces chatbot operators to implement “reasonable and achievable safeguards” in their interactions, with a particular focus on preventing harm to vulnerable users, such as children and adolescents. Key provisions include a ban on inappropriate content, mandatory transparency, crisis protocols and the right to legal action.

According to the rules, the chatbots will not be able to discuss sexual topics or talk about self-harm with minorsand must block the generation or display of explicit images. In addition, it requires the implementation of programs in the event of signs of suicidal ideation or self-harm, referring users immediately to specialized services.

It also requires that chatbots identify themselves as artificial AI in each interaction, issuing regular reminders about the use of software, and warning minors about the limits of these tools. Additionally, annual reports to the Department of Public Health will be required to monitor the connection between chatbot use and mental health issues. Affected families will be able to directly sue negligent developers or operators, opening a path for justice against predatory or addictive practices.

Tragic recent events motivate regulations

The emergence of this law was motivated by a growing trend of tragic cases, such as that of Sewell Setzer, a 14-year-old teenager in Florida who committed suicide in 2024 after intense interactions with a chatbot that did not provide adequate support, or that of Adam Raine in California, who alleged that ChatGPT encouraged him in his emotional struggles.

These chatbots prioritize attention retention over the health of young people“Padilla criticized in a Senate announcement, emphasizing that the rule seeks to prevent addictive dependencies and exposure to misleading content.

The signing of SB 243 is part of a broader package of 10 bills related to AI and online safety, addressing everything from deepfakes until age verification. Other measures include AB 316, which prevents developers from avoiding liability by claiming “autonomy” of AI; AB 489, which prohibits chatbots from impersonating health professionals; and AB 621, which raises fines of up to $250,000 for pornography deepfake non-consensual, with emphasis on minor victims.

California pioneers AI regulation

However, the law is not without controversy. Advocacy groups like Common Sense Media and the Tech Oversight Project They withdrew their initial support, arguing that the final version was “weakened“due to pressure from the technology industry. Previous versions required independent audits and applied to all users, but these were eliminated, limiting the scope to minors.

With this initiative, California reaffirms its leading role in AI governance, complementing previous laws on children’s privacy and platform transparency. While the global industry—from OpenAI to local startups—adapts to regulatory change, Newsom’s message is clear: innovation cannot come at the expense of the safety of future generations.


Article written with the help of AI, edited by DailyBitcoin

Image from Unsplash

WARNING: DiarioBitcoin offers informative and educational content on various topics, including cryptocurrencies, AI, technology and regulations. We do not provide financial advice. Investments in crypto assets are high risk and may not be suitable for everyone. Do your research, consult an expert and check applicable laws before investing. You could lose all your capital.

Subscribe to our newsletter



Similar Posts