A Lawsuit With Disturbing Allegations
The parents of a 13-year-old girl identified in court papers as Emma have sued Google in California Superior Court. The lawsuit alleges that Gemini, accessed through a school-issued Chromebook, helped push her into a severe psychological crisis. Her lawyers say she exchanged thousands of messages with the chatbot over several months and became convinced she had several major psychological disorders. About three months into regular use, she allegedly asked Gemini about suicide methods. The complaint claims the chatbot helped her hide mental health struggles and self-harm from others, then helped her plan her own funeral. It names Google’s top executives and alleges defective design, failure to warn, negligence, fraudulent concealment, and infliction of emotional distress. Thankfully, the planned suicide did not happen.
How Adults Discovered the Warning Signs
Emma’s lawyers say she did not go looking for Gemini. It appeared in Google Search one day, they said. A former school counselor later noticed warning signs through alerts from the school’s third-party monitoring software and contacted Emma’s parents. Her parents logged into her account and intervened before the planned suicide occurred. Julie Liddell, founder of the EdTech Law Center, called the situation an outrage and accused Google of using its position in public schools to place a dangerous chatbot before millions of children. The case is part of a larger wave of hundreds of lawsuits against social media and AI companies over alleged harm to young users.
Google Defends Its Safety Systems
Google spokesperson Jose Castaneda said the company takes the allegations very seriously. He pointed to work with medical professionals and academic experts to build features that help young people find critical support and trusted resources. Castaneda also said Google has spent decades developing crisis detection systems that aim to prevent harmful conversations and show hotline information in Search when a user’s questions indicate a crisis. Google added that SafeSearch, its filter for explicit content, is turned on by default for education users under 18.
Schools Face a Larger AI Access Fight
The lawsuit comes as schools face a broader fight over AI access. Breitbart News reported that Google threatened to deactivate Search for schools that choose to turn off AI access for students. The change affects Gmail, Docs, Classroom, Chromebooks, and Google Search, reaching a large part of the public education system. Google education executive Chris Phillips said Search and AI are deeply integrated. He said students at schools that ban AI will not have access to Search and will instead see a message from their school. After public uproar, Google posted on X to redefine its position, but a community note pointed back to Phillips’ earlier comments.
Parents Warned About AI Companions
Wynton Hall, Breitbart News’ social media director and author of Code Red, has warned parents and grandparents about AI companions designed to act like friends. Although Gemini is not a traditional AI companion, Emma’s thousands of messages show how a young person can form an unhealthy one-sided relationship with a chatbot. Hall argues that these platforms can expose children to inappropriate content and that age gates and alleged guardrails can be easy for a curious, tech-savvy child to bypass. His warning is especially relevant when access begins with a school device and account rather than a child actively searching for a chatbot.
Lucas Nolan is a reporter for Breitbart News covering AI, free speech, and online censorship.
