Malaysia and Indonesia have taken action to block Grok, the AI chatbot developed by Elon Musk’s xAI company, amid concerns that it is being misused to create sexually explicit and nonconsensual content. This move comes as authorities worldwide are increasingly scrutinizing generative AI tools that can generate realistic images, sound, and text, and questioning the effectiveness of current safeguards in preventing abuse.
Grok, accessed through Musk’s social media platform X, has faced criticism for producing manipulated images, including those depicting women in bikinis, sexually explicit poses, and images involving children. While the chatbot recently limited image generation and editing to paying users in response to global backlash over sexualized deepfakes, critics argue that this action did not fully address the underlying issue.
In response to concerns about the proliferation of fake pornographic content, particularly involving women and minors, regulators in Malaysia and Indonesia have temporarily blocked access to Grok. The Indonesian Communication and Digital Affairs Minister emphasized that non-consensual sexual deepfakes violate human rights, dignity, and digital safety. The Indonesian government’s decision aims to protect vulnerable groups from AI-generated fake pornographic content, which poses risks to privacy, image rights, and overall well-being.
Similarly, the Malaysian Communications and Multimedia Commission imposed a temporary restriction on Grok following reports of misuse to create obscene, sexually explicit, and non-consensual manipulated images. The regulator highlighted that their requests for stronger safeguards from X Corp. and xAI were not adequately met, leading to the decision to block access until effective measures are in place.
Grok, introduced in 2023 on X, allows users to interact with the chatbot on the social media platform and utilize an image generator feature called Grok Imagine. Recent restrictions in Southeast Asia coincide with increased scrutiny of Grok globally, with other countries like the UK, EU, India, and France also examining the chatbot’s operations.
In the UK, the media regulator Ofcom has launched an investigation into whether Grok has fulfilled its obligations to protect individuals from illegal content. Concerns have been raised about Grok-generated images potentially constituting pornography or child sexual abuse material, prompting a formal review of its compliance with regulatory standards.
Despite these developments, Canada has not proposed a ban on X, as confirmed by AI Minister Evan Solomon. However, discussions on addressing the deepfake controversy are ongoing within the Canadian government.