Elon Musk’s AI startup xAI has limited the image generation functionality of its Grok chatbot on social media platform X to paying subscribers, following a surge of criticism over the tool’s use in creating sexualized content, Reuters reports. The restriction comes after widespread concern that the chatbot was being used to produce images of women and children in minimal clothing, often without their consent.
Grok’s image generation feature had previously allowed users on X to edit or create photos, including sexualized images. According to Reuters, these capabilities were exploited to generate explicit content, prompting European lawmakers to call for legal action. German media minister Wolfram Weimer described the phenomenon as the “industrialisation of sexual harassment,” while the European Commission labeled the images illegal.
On Friday, Grok notified users that image generation and editing tools on X would now only be available to paying subscribers. The standalone Grok application, which operates independently from X, continues to allow image creation without a subscription. A Reuters reporter attempting to use Grok to create a sexualized image received an automated response indicating that the feature was restricted to subscribers.
xAI responded to an emailed request for comment with the phrase “Legacy Media Lies,” but did not provide further clarification. The European Commission reiterated on Monday that sexually explicit images generated by the tool were unlawful and appalling. Meanwhile, the United Kingdom’s data regulator stated it had asked the platform to explain how it was complying with data protection laws in light of concerns over the sexually abusive content produced by Grok.
Musk previously stated that users attempting to generate illegal material with Grok would face the same consequences as if they had uploaded such content directly, emphasizing the company’s zero-tolerance stance on illicit use.
The move to restrict Grok’s image generation to paid subscribers reflects xAI’s attempt to curb misuse of the platform while responding to mounting regulatory pressure in Europe and the United Kingdom.
