Meta scraps Instagram AI tool that modified photos without user consent

Meta pulled the plug on an AI image tool for Instagram just days after launching it, acknowledging the feature fell short of its intended purpose. The capability allowed people to edit photographs from public accounts by tagging them directly, without alerting those whose images were being used.

What the tool did#

The feature came bundled with Meta's new Muse Image generator, developed by Meta Superintelligence Labs. The core idea was straightforward: users could @-mention public Instagram accounts and use their photos as references for generating new images. However, the tool contained no notification system to inform creators whose content was being modified.

Why it sparked outrage#

The approach quickly drew criticism for treating public photos as raw material without consent or knowledge. Privacy advocates and industry groups, including talent agency CAA, raised concerns about potential misuse—particularly around generating non-consensual edited images. The technology's vulnerability to abuse mirrored a broader pattern of AI-generated nude imagery that has become rampant online, with efforts to combat it consistently proving insufficient.

Meta's reversal#

In a blog post on Friday, Meta stated it intended to "provide a useful creative tool and to give people control over whether their public content could be referenced." The company acknowledged that "this feature missed the mark" and removed it from availability. The decision marks a rare reversal for the platform, following days of user pushback and scrutiny.