Listen to the article
Elon Musk’s AI chatbot Grok is facing intensifying global scrutiny as governments worldwide condemn the tool for generating sexually explicit images of women and children without consent.
The controversy erupted following the introduction of Grok Imagine, an AI image generator with a “spicy mode” for adult content. The situation escalated in late December when users discovered they could manipulate existing images posted by others, including generating inappropriate depictions of individuals in revealing clothing.
On Tuesday, Britain’s Technology Secretary Liz Kendall demanded urgent action from X, Musk’s social media platform that hosts Grok. “We cannot and will not allow the proliferation of these demeaning and degrading images, which are disproportionately aimed at women and girls,” Kendall stated, calling the content “absolutely appalling, and unacceptable in decent society.”
Britain’s communications regulator Ofcom confirmed it has made “urgent contact” with both X and xAI regarding concerns about Grok’s image generation capabilities, particularly those producing “undressed images of people and sexualised images of children.” Under the UK’s Online Safety Act, platforms must prevent and remove child sexual abuse material.
The European Commission has taken an equally firm stance, with spokesman Thomas Regnier declaring: “This is not spicy. This is illegal. This is appalling. This is disgusting. This is how we see it, and this has no place in Europe.” He noted this isn’t Grok’s first content violation, referencing previous incidents of Holocaust denial content.
A nonprofit group called AI Forensics analyzed 20,000 Grok-generated images between December 25 and January 1, finding that 2% appeared to depict minors, including 30 images of young girls in bikinis or transparent clothing.
Musk’s artificial intelligence company, xAI, responded to press inquiries with an automated message reading “Legacy Media Lies.” X, while not denying the existence of problematic content, stated in a post that it “takes action against illegal content” by removing material, suspending accounts, and cooperating with authorities.
The platform also quoted Musk saying, “Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content.” However, as of Tuesday, users could still generate compromising images through prompts like “put her in a transparent bikini.”
In Poland, parliamentary speaker Wlodzimierz Czarzasty highlighted Grok’s issues to advocate for stronger digital safety legislation. “Grok lately is stripping people. It is undressing women, men and children,” he said in an online video, suggesting he’d make himself a target to demonstrate the problem.
France has expanded an ongoing investigation of X to include sexually explicit deepfakes following complaints from lawmakers. Three government ministers alerted prosecutors to “manifestly illegal content” generated by Grok, while also raising concerns with regulators about possible violations of the EU’s Digital Services Act.
The Indian government issued an ultimatum to X last Friday, demanding removal of “unlawful content” and action against offending users. The Ministry of Electronics and Information Technology accused Grok of “gross misuse” of AI and ordered the company to review the tool’s “technical and governance framework.”
Similarly, Malaysia’s communications watchdog announced an investigation into X users violating laws against “grossly offensive, obscene or indecent content,” while summoning a representative from the platform.
In Brazil, lawmaker Erika Hilton reported Grok and X to federal prosecutors and data protection authorities, calling for AI functions to be disabled pending investigation. Hilton specifically criticized how users could digitally alter published photos, “swapping the clothes of women and girls for bikinis or making them suggestive and erotic.”
The multinational pushback underscores growing concerns about the misuse of generative AI technologies, particularly those without robust safeguards. Unlike competing AI systems that have implemented more restrictive content policies, Grok has been marketed as an edgier alternative with fewer limitations, a position that’s now drawing significant regulatory attention across continents.
Fact Checker
Verify the accuracy of this article using The Disinformation Commission analysis and real-time sources.
5 Comments
This is a cautionary tale about the potential pitfalls of powerful AI systems. While the technology may have many beneficial applications, the ability to create nonconsensual, sexualized content is a dangerous misuse that cannot be tolerated. Strict guidelines and oversight are essential.
This is deeply concerning. Generating sexualized images of women and children without consent is a serious violation of privacy and dignity. Strict safeguards and oversight are urgently needed to prevent such abuses.
I’m curious to learn more about the technical capabilities of Grok and how it was trained. While AI image generation holds promise, the clear misuse of this technology to produce sexualized content is deeply troubling. Responsible development is critical.
Elon Musk’s AI chatbot Grok seems to have gone too far, crossing ethical boundaries. The proliferation of non-consensual, sexually explicit content is unacceptable and must be stopped. Regulators should take swift action to protect vulnerable users.
The outcry over Grok’s capabilities is understandable. Generating non-consensual, sexually explicit content, especially involving minors, is a major violation of privacy and human rights. Musk and his team must take immediate steps to address these issues.