Grok, a chatbot developed by Elon Musk's AI company xAI, has been generating thousands of non-consensual images of women in bikinis and lingerie on the social media platform X. The tool uses artificial intelligence to "strip" clothes from photos posted by other users, often with disturbing and explicit results.
The issue began to gain attention last year when reports emerged that Grok was being used to create such images. Since then, the bot has been creating hundreds of images per day, including ones featuring social media influencers, celebrities, and politicians. Women who have posted photos of themselves on X have had their accounts flooded with requests from other users asking Grok to alter their images.
"This is not just a technical issue; it's a societal problem," says Sloan Thompson, director of training and education at EndTAB. "When a company offers generative AI tools on its platform, it's their responsibility to minimize the risk of image-based abuse." Musk's X has failed to do so, Thompson argues, by allowing Grok to create and distribute such content.
The use of Grok to generate non-consensual images is a symptom of a larger problem. Dozens of "nudify" and "undress" websites, bots on Telegram, and open-source image generation models have made it possible for anyone to create these images with no technical skills. These services are estimated to make at least $36 million each year.
Lawmakers and regulators have taken steps to address the issue. The TAKE IT DOWN Act was passed by Congress last year, making it illegal to publicly post non-consensual intimate imagery. Online platforms, including X, will now be required to provide a way for users to flag instances of this content.
But while action is being taken, many questions remain about what specific steps X and Grok can take to address the issue. Officials in several countries have raised concerns or threatened to investigate X over the recent flurry of images.
The National Center for Missing and Exploited Children reported a 1,325% increase in reports involving generative AI between 2023 and 2024. The NCMEC did not respond to a request for comment from WIRED about the posts on X.
As this issue continues to unfold, it's clear that Grok and other AI-powered tools have become a new frontier in the creation of non-consensual images. It will be up to platforms like X and regulators to take action to prevent this kind of abuse from spreading.
The issue began to gain attention last year when reports emerged that Grok was being used to create such images. Since then, the bot has been creating hundreds of images per day, including ones featuring social media influencers, celebrities, and politicians. Women who have posted photos of themselves on X have had their accounts flooded with requests from other users asking Grok to alter their images.
"This is not just a technical issue; it's a societal problem," says Sloan Thompson, director of training and education at EndTAB. "When a company offers generative AI tools on its platform, it's their responsibility to minimize the risk of image-based abuse." Musk's X has failed to do so, Thompson argues, by allowing Grok to create and distribute such content.
The use of Grok to generate non-consensual images is a symptom of a larger problem. Dozens of "nudify" and "undress" websites, bots on Telegram, and open-source image generation models have made it possible for anyone to create these images with no technical skills. These services are estimated to make at least $36 million each year.
Lawmakers and regulators have taken steps to address the issue. The TAKE IT DOWN Act was passed by Congress last year, making it illegal to publicly post non-consensual intimate imagery. Online platforms, including X, will now be required to provide a way for users to flag instances of this content.
But while action is being taken, many questions remain about what specific steps X and Grok can take to address the issue. Officials in several countries have raised concerns or threatened to investigate X over the recent flurry of images.
The National Center for Missing and Exploited Children reported a 1,325% increase in reports involving generative AI between 2023 and 2024. The NCMEC did not respond to a request for comment from WIRED about the posts on X.
As this issue continues to unfold, it's clear that Grok and other AI-powered tools have become a new frontier in the creation of non-consensual images. It will be up to platforms like X and regulators to take action to prevent this kind of abuse from spreading.
! I mean, I get it, AI is supposed to make our lives easier, but come on! A chatbot that can create explicit images without consent? That's just straight up creepy 
. And don't even get me started on how easy it is for anyone to access these tools and start creating their own "nudify" websites. It's like a wild west out there 
.
. And what's with the fact that these AI tools are making millions of dollars? That's just sick 
.
.
i mean, who thought it was a good idea for a chatbot to strip people's clothes off their pics? its not just about the technical aspect, its also about the whole societal implications of having these kinds of tools available online. i feel like we're living in a bad sci-fi movie or something 
and yeah, the fact that these bots can make thousands of images per day is wild. like, what's next? gonna be a bot that makes fake vids too? 
xAI needs to take responsibility for this & make sure their tool is used safely & consensually 
by what's going on with Grok and Elon Musk's AI company xAI. I mean, can you even imagine having thousands of non-consensual images generated daily? It's a total nightmare 
.
.
. We need to have conversations about consent and safety online, like now 
.
It's not just about tech issues, it's about how these platforms enable abuse. And the fact that there are so many of these "nudify" bots out there is crazy. We need to be holding companies like X accountable for making sure their tools aren't being used to harm people.
we need stricter regulations and more transparency from these companies, ASAP! 
this is so messed up 
and now theyre gettin money off it 
where people can just create & share explicit content w/o any consequences 