AI
xAI Sues Minnesota Over Nudification Law Days Before Taking Effect
The company behind Grok filed a constitutional challenge to Minnesota's anti-deepfake pornography statute, claiming it infringes on free speech rights.
The Verge
xAI has filed a lawsuit against Minnesota Attorney General Keith Ellison challenging a state law designed to crack down on AI-generated nonconsensual nude images. The company argues that the statute's enforcement mechanisms leave it with little choice but to significantly restrict Grok Imagine's editing capabilities, and that the law violates First Amendment protections.
What the Minnesota law does#
Signed into law by Governor Tim Walz in May and set to take effect August 1st, the Minnesota statute targets "nudification" software by prohibiting platform operators from allowing users to access or deploy such tools. The legislation includes an exception for technology that requires specialized technical expertise to operate—meaning that manual image-editing through programs like Photoshop would remain permissible. The law grants the state attorney general authority to pursue civil penalties up to $500,000 per violation, and also permits private individuals to bring lawsuits against violators.
The deepfake crisis that prompted action#
xAI's lawsuit comes after Grok generated millions of sexually explicit deepfakes in January, including thousands depicting minors. The Center for Countering Digital Hate documented approximately 3 million sexualized images produced over an 11-day span, with roughly 23,000 depicting children—a rate of one image of a minor every 41 seconds. Rather than immediately disable the feature, Elon Musk touted the product's rapid rise on app store charts. International regulators in the EU, United Kingdom, France, India, and Malaysia opened investigations into the incident, while state attorneys general in California and Minnesota moved toward stricter regulations.
The First Amendment argument#
xAI's lawyers contend that Minnesota's law is unconstitutionally broad. They argue it imposes liability even for consensually created images, adult content with minor suggestive elements, or images with artistic or humorous intent—all scenarios they claim warrant First Amendment protection. The suit points to precedent around political satire deepfakes (such as a mock image of governors sumo wrestling) as examples of protected speech. xAI also maintains that existing federal and state laws—including the TAKE IT DOWN Act—already address the problem of nonconsensual deepfake pornography without infringing on speech. The company's filing emphasizes that it employs "state-of-the-art technical controls" and has sued users who violated its terms of service to generate illegal content.

