The online network X has sparked widespread backlash after users utilized its AI chatbot Grok to change images of females by stripping their garments.
Multiple instances have surfaced where the technology has been used to virtually strip female subjects to show them in bikinis non-consensually, as well as to insert them in sexually explicit contexts.
Developer Reaction and Legal Stance
XAI, the organization behind Grok, offered no comment to inquiries, aside from an standard message stating "traditional news outlets lies".
A Home Office official stated that legislation is being proposed to outlaw image stripping technology. Under a proposed law, anyone who supplied such technology would "be subject to a jail term and heavy fines".
"X or Grok could prevent these forms of abuse if they wanted to," said a law professor, adding they "operate with impunity."
Regulator Position and Tool Functionality
The regulator Ofcom said platforms must "consider the danger" of people viewing unlawful material on their services, but stopped short of confirming whether it was currently investigating X or Grok in relation to artificial intelligence pictures.
Grok is a no-cost artificial intelligence—with some paid-for functions—which reacts to X users' queries when they reference it in a post.
It is frequently used to offer reactions or additional background to other users' comments, but people on X are also capable of alter an posted picture through its artificial intelligence picture modification tool.
History of Criticism and Policy
The tool has been criticised for permitting users to generate photos and clips with explicit content and sexualised content, and it was previously accused of making sexually explicit material of public figures.
"X has been enabling the generation and spread of these pictures for a long time without taking any steps and we have yet to see any intervention by oversight bodies," Professor McGlynn added.
XAI's own usage rules prohibits "showing likenesses of people in a pornographic way".
In a comment, Ofcom said it was against the law to "generate or distribute private pictures or child sexual abuse material" and confirmed this included sexual deepfakes generated with AI.
It said platforms such as X were obligated to take "necessary actions" to "reduce the risk" of users encountering illegal content on their platforms and to remove it quickly when they become aware of it.
