AI Safety
Lawsuit: Man created thousands of AI child abuse images using Grok, xAI resisted investigation
A court filing details how one user allegedly generated 7,000 sexually explicit synthetic images of a child using Grok—and claims xAI obstructed law enforcement's attempts to identify and apprehend him.
Ars Technica
An expanded class-action lawsuit against X and xAI brings fresh allegations that the company's Grok AI tool enabled the creation of child sexual abuse material and that the company then interfered with police investigations into the abuse.
The case involves a man who, according to court documents, used Grok to generate thousands of explicit synthetic images depicting his stepdaughter using a photograph from when she was 11 years old. The man later died by suicide after law enforcement discovered the material.
The scope of the alleged abuse#
The amended complaint, filed this week, describes a troubling pattern: the suspect produced approximately 7,000 sexually explicit synthetic images and videos using Grok. The lawsuit claims the AI system failed to prevent the creation of images depicting incest and rape—until the user entered a prompt specifically requesting a "gang rape" scene. Only that final request triggered Grok's safety systems and generated a report to the National Center for Missing and Exploited Children (NCMEC), which then alerted police.
The plaintiff's family argues that without Grok's "undressing" and image-manipulation capabilities, the volume and nature of the abuse material would never have been generated.
xAI's alleged obstruction of the investigation#
The lawsuit centers another serious claim: that xAI actively obstructed law enforcement's investigation. Despite legal obligations to share identifying information—such as a user's IP address—when child abuse material is flagged, xAI allegedly resisted police and NCMEC requests for weeks. According to the complaint, the company "obstructed this investigation at every turn" and made it substantially harder for authorities to locate and identify the perpetrator.
Law enforcement ultimately obtained a warrant to seize the suspect's devices, which revealed the full scope of the AI-generated collection. The case is part of a broader class action filed in March, in which girls also accuse X and xAI of building tools that enable abuse and of fostering a platform culture that endangers minors.
The allegations raise questions about both the design of AI systems and corporate responsibility when law enforcement seeks to investigate serious crimes involving children.
