The UK media regulator Ofcom has launched an investigation into Elon Musk’s social media platform X over the use of its artificial intelligence chatbot Grok to generate sexually explicit and non-consensual images.
In a statement, Ofcom said it had received “deeply concerning reports” about the chatbot being used to create and distribute nude images of individuals, as well as sexualized images of children.
Grok has been free to use on platform X since 2023. Last summer, the company introduced the Grok Imagine feature, which includes a so-called “spicy mode” capable of generating adult content.
The platform was recently blocked in Malaysia and Indonesia, after authorities in those countries concluded that it was being misused to produce non-consensual sexual deepfakes.
Ofcom warned that if X fails to meet regulatory requirements, it could seek a court order forcing internet service providers to completely block access to the platform in the United Kingdom.
In the event of a legal breach, Ofcom may impose a fine of up to 10% of the company’s global revenue or £18 million (around €20 million).
The investigation comes amid growing global concern over the abuse of artificial intelligence in the production of non-consensual sexual content.
