Malaysia and Indonesia have become the first countries to block access to Elon Musk’s AI chatbot Grok over concerns that it was being misused to create sexually explicit deepfake images.
The bans follow reports that the AI tool was used to make non-consensual sexualized images of real women and children. Authorities said such misuse violates human dignity, human rights, and online safety standards.
Grok is integrated into Elon Musk’s social media platform X, formerly Twitter. The chatbot allows users to generate images from text prompts. Regulators said the tool had been exploited to digitally alter photos of real people, showing them in revealing or sexualized clothing without consent.
The Malaysian Communication and Multimedia Commission said it had warned X after repeated misuse of Grok to produce harmful content. The commission criticized X for relying only on user reporting instead of addressing design flaws that enable abuse. Grok will remain blocked in Malaysia until effective safeguards are in place.
Indonesia has taken a similar approach. Minister for Communications and Digital Affairs Meutya Hafid said generating sexual content using Grok is unacceptable and harmful. Authorities have asked the platform to explain how the tool is being used. Indonesia already enforces strict rules against online adult content.
Several Indonesian content creators reported discovering sexualized versions of their photos generated using Grok. Users said attempts to report the content often made it more visible.
Globally, Grok is under growing scrutiny. In the United Kingdom, media regulator Ofcom is reviewing possible action against X for online safety violations. UK Prime Minister Keir Starmer condemned the misuse of the AI tool as “disgraceful” and “disgusting.”
Elon Musk rejected the criticism, saying users are responsible for how AI tools are used and claiming opponents are using the issue as a pretext for censorship.
The bans highlight rising concern over AI-generated deepfakes and the challenges governments face in regulating fast-changing AI technologies, especially when privacy, consent, and child protection are involved.
