X bows to backlash: Grok AI’s image editing tool will stop undressing people

What started as an innovative tool for creative expression has quickly spiraled into controversy. Elon Musk’s Grok AI, which was designed to edit images of fictional characters, is now under fire after users began exploiting it to create sexualised deepfakes of real people.

In response to widespread abuse, X has announced it will implement stricter controls, blocking users from altering images of actual individuals to appear in revealing clothing in jurisdictions where such content is illegal. This move aims to curb the misuse of the tool while still allowing some degree of creative freedom.

In a statement issued on Wednesday, X said it would “geoblock” the ability for users to create these types of images in jurisdictions where they are prohibited. This update applies to both free and paid users of the Grok tool. An article by BBC said that social media platform X has also said that the changes would help prevent abuse and hold users accountable for violating the platform’s rules or local laws.

The crackdown follows a significant public outcry, including an investigation by California’s Attorney General into AI-generated deepfakes, some of which involved children. The state’s top prosecutor warned of the dangers of these digital manipulations, which have been used for harassment across the internet.

X also noted that Grok will still allow some degree of adult-themed imagery, but it is limited to fictional characters and must adhere to the norms of what is considered acceptable in R-rated films in the US. Musk defended the AI tool, calling it a matter of free speech, and posted an AI-generated image of UK Prime Minister Sir Keir Starmer in a bikini, fueling further controversy.

The outrage sparked international action, with Malaysia and Indonesia becoming the first countries to outright ban Grok. In the UK, officials are considering whether X has violated local laws, while some British politicians, including Sir Keir, have suggested that X could lose its “right to self-regulate” if the issue is not addressed.

The debate over Grok has also led to some UK lawmakers leaving the platform entirely, with the media regulator Ofcom pledging an investigation into the matter.

While Musk has continued to downplay the concerns, experts like policy researcher Riana Pfefferkorn have criticised X for not acting sooner. She argued that the platform should have removed the photo-altering features as soon as reports of abuse surfaced.

The new safeguards will require X to enforce stricter content moderation policies, but questions remain about how effectively the platform can detect and act on violations, especially when it comes to distinguishing between real people and AI-generated images.