AI
San Francisco Targets Apple and Google Over AI "Nudify" Apps in App Stores
City attorney David Chiu has issued cease-and-desist letters demanding the removal of 13 apps that generate nonconsensual nude images using AI technology.
WIRED — AI
San Francisco's city attorney has escalated enforcement action against artificial intelligence tools designed to create nonconsensual sexual imagery, directly confronting Apple and Google over their role in distributing the technology. Legal notices sent to both companies demand removal of 13 apps capable of generating fake nude images and warn against further profiting from the practice.
David Chiu, the city attorney, contends that Apple and Google are violating California law by "aiding and abetting" the distribution of deepfake pornography. The companies have generated millions in revenue through commission fees on in-app purchases tied to these nudification tools, according to Chiu's office.
The Scale of the Problem#
Research has consistently documented the prevalence of these apps across mainstream platforms. In recent investigations, the Tech Transparency Project found roughly 100 nudifying apps across both the App Store and Google Play, with combined downloads potentially reaching 480 million and revenues around $120 million.
A separate academic study from Cornell and Georgetown University identified 420 face-swapping apps on the two major app stores. When researchers tested 155 of these applications, approximately 70 percent could be repurposed to create nude image swaps—often without built-in safety guardrails despite the obvious misuse potential.
The Scope of Harm#
The impact has extended into schools globally. Previous investigations have uncovered incidents in at least 90 schools involving deepfake sexual abuse imagery of minors. Victims have reported severe psychological consequences, including harassment, humiliation, and mental health crises.
According to Chiu, "These images are used to bully, humiliate, and threaten women and girls. This industry has a horrific impact on one's reputation, mental health, loss of autonomy. There have been victims who've been suicidal."
App Store Responses#
Google stated it has removed "hundreds" of violating apps and suspended search terms like "nudify" from its store. The company noted that five of the apps targeted in Chiu's action had already been deleted.
Apple declined to comment before publication. Both platforms maintain policies prohibiting sexually explicit content, but enforcement has proven inconsistent—many apps circumvent detection by disguising themselves as general face-swapping tools rather than advertising nudification capabilities directly.
