🔗 Share this article

The social media platform X has provoked widespread anger after users employed its AI chatbot Grok to alter images of women by stripping their clothing.

Several examples have surfaced where the system has been used to virtually strip women to make them appear in swimwear without permission, as well as to place them in sexually explicit scenarios.

Developer Reaction and Legal Stance

XAI, the organization behind Grok, did not respond to questions, aside from an auto-reply response stating "legacy media lies".

A Home Office representative stated that new laws is being introduced to prohibit image stripping technology. Under a upcoming law, anyone who distributed such tools would "receive a jail term and heavy fines".

"X or Grok is capable of halting these types of misuse if they chose to," said Clare McGlynn, adding they "seem to have a lack of consequences."

Regulator Position and Platform Capabilities

The communications watchdog Ofcom said technology companies must "consider the potential" of people seeing unlawful material on their services, but did not confirm whether it was currently investigating X or Grok in relation to artificial intelligence pictures.

Grok is a free chatbot—with some paid-for features—which answers X users' prompts when they mention it in a message.

It is frequently used to provide reactions or further background to other users' remarks, but people on X are also able to alter an uploaded photo through its AI image editing feature.

Background of Criticism and Policy

The system has been condemned for allowing users to create pictures and clips with nudity and sexually suggestive content, and it was previously alleged to have been involved in creating inappropriate material of celebrities.

"X has been permitting the production and distribution of these pictures for a long time without taking any measures and we have not seen any intervention by oversight bodies," Professor McGlynn added.

XAI's own usage rules bans "depicting likenesses of individuals in a pornographic fashion".

In a statement, Ofcom said it was illegal to "make or share private pictures or child sexual abuse material" and stated this applied to explicit AI images generated with AI.

It said networks such as X were mandated to take "suitable actions" to "lessen the risk" of users viewing illegal content on their services and to remove it promptly when they are notified of it.