Elon Musk’s X Faces Regulatory Probes After Grok Generates Explicit Images

Social media platform X, owned by Elon Musk, is facing regulatory scrutiny in Europe, India and Malaysia after its AI chatbot Grok was used to generate explicit deepfake images, including sexualised content involving women and children.

Authorities launched probes following a rise in the use of Grok to create and circulate non-consensual intimate images derived from real photos and videos. Some of the content allegedly depicted child sexual abuse, raising concerns among regulators and safety groups.

In the UK, media watchdog Ofcom confirmed it has requested information from X regarding the chatbot’s image-generation features. In Brazil, a member of parliament said she had asked federal prosecutors and the national data protection authority to suspend Grok until an investigation is completed.

The controversy follows recent updates to Grok’s image-generation tools, which made it easier for users to create images from text prompts directly on X. Critics said the changes lacked sufficient safeguards to prevent misuse.

At a press conference on Monday, a spokesperson for the European Commission said regulators were examining the issue closely. Officials said content involving explicit sexual imagery, particularly where children are concerned, violates EU law.

“This is illegal and unacceptable,” the spokesperson said, adding that such content has no place on platforms operating in Europe.

In India, the Ministry of Electronics and Information Technology ordered X to conduct a comprehensive technical and governance review of Grok and submit its findings by January 5.

Malaysia’s communications regulator, the Malaysian Communications and Multimedia Commission, said it is investigating the platform and will summon company representatives. The regulator urged online platforms to strengthen safeguards for AI-powered tools in line with local laws.

In the United States, the National Center on Sexual Exploitation called on the Department of Justice and the Federal Trade Commission to investigate. The group said existing federal laws prohibit the creation and distribution of child sexual abuse material, including AI-generated content.

A Department of Justice spokesperson said authorities take AI-generated child sexual abuse material “extremely seriously” and will pursue enforcement actions where applicable. The FTC declined to comment.

X made its first public statement on the issue over the weekend, saying it removes illegal content, suspends offending accounts, and cooperates with law enforcement. Musk separately warned that users prompting Grok to create illegal material would face the same consequences as those uploading such content directly.

Despite the controversy, data from mobile analytics firm Apptopia showed downloads of Grok and X rose sharply in recent days.