The United Kingdom’s media regulator, Ofcom, has launched a formal investigation into Elon Musk-owned social media platform X over concerns surrounding its artificial intelligence chatbot, Grok, and its image-generation feature, which has reportedly been used to create sexualised deepfake images.
Grok has come under increasing international scrutiny for enabling users to generate and circulate sexualised images of women and children using simple text prompts. Ofcom described the reports as “deeply concerning,” warning that such content could constitute serious criminal offences.
In a statement, the regulator said that the creation and sharing of undressed or manipulated images of individuals “may amount to intimate image abuse or pornography,” while sexualised images involving children could qualify as child sexual abuse material under UK law.
X did not immediately respond to requests for comment from AFP.
Regulatory Scrutiny Under Online Safety Act
Ofcom disclosed that it contacted X on January 5, requesting detailed explanations of the safeguards in place to protect users in the UK. While the regulator confirmed that X responded within the stipulated timeframe, it declined to provide details of the exchange.
The ongoing probe will assess whether X has “failed to comply with its legal obligations” under Britain’s Online Safety Act, which came into force in July. The legislation requires social media platforms, websites, and video-sharing services hosting potentially harmful content to implement robust age-verification measures, including tools such as facial recognition or credit card checks.
The law also makes it illegal to create or distribute non-consensual intimate images or child sexual abuse material, including AI-generated sexual deepfakes.
Ofcom has the authority to impose penalties of up to 10 percent of a company’s global annual revenue for breaches of the Act.
International Backlash Grows
Amid mounting criticism, Grok appeared to shift course late last week by introducing a new monetisation policy, announcing on X that access to its image-generation feature would be restricted to paying subscribers. The announcement included a link to X’s premium subscription service.
UK Prime Minister Keir Starmer strongly criticised the move, describing it as “not a solution” and an affront to victims affected by online abuse.
The backlash has extended beyond the UK. On Saturday, Indonesia became the first country to block access to Grok entirely, with Malaysia following on Sunday. Meanwhile, the European Commission has confirmed that it is reviewing complaints related to the AI tool.
The unfolding investigation places renewed pressure on tech platforms to balance innovation with responsibility, as governments worldwide tighten regulations around AI-generated content and online safety.
About the Author
