Technology
Google AI in School Triggered Teen’s Mental Health Crisis, Lawsuit Says
Key Points
Google AI in School Triggered Teen’s Mental Health Crisis, Lawsuit Says Parents in North Carolina sued Google after their 13-year-old daughter spent months discussing suicidal thoughts with the company’s artificial intelligence tools on her school-issued Chromebook, underscoring the potential risks of the technology as parents and educators debate AI’s place in schools. The girl exchanged thousands of messages with Google’s flagship AI model, Gemini, many of which detailed anxiety,...
Google AI in School Triggered Teen’s Mental Health Crisis, Lawsuit Says
Parents in North Carolina sued Google after their 13-year-old daughter spent months discussing suicidal thoughts with the company’s artificial intelligence tools on her school-issued Chromebook, underscoring the potential risks of the technology as parents and educators debate AI’s place in schools.
The girl exchanged thousands of messages with Google’s flagship AI model, Gemini, many of which detailed anxiety, depression and methods of committing suicide, according to the complaint, filed in California state court. By the time the school notified her parents, she had been corresponding with Google about such topics for months, often using a feature in Google Search known as AI Mode. The complaint alleges that as Google infuses more AI into its products for schools, the company is exposing students to dangerous technology without giving parents and administrators fair warning.