Elon Musk's AI chatbot, Grok, and its associated app X continue to operate in the Apple App Store and Google Play despite generating thousands of explicit images that could be classified as child sexual abuse material (CSAM) or nonconsensual deepfakes.
Both platforms have strict policies against such content, but they have failed to remove these apps from their stores. The European Union has condemned these images as "illegal" and "appalling," and X has warned users that creating CSAM with Grok will result in severe consequences. However, the app remains available for download.
A growing industry around "nudify" services online has emerged, where stand-alone apps and websites promise to digitally strip women without their consent. Companies like AI startups have also struggled to prevent their tools from being used to generate nonconsensual sexualized imagery.
Lawmakers in the US and other countries have cracked down on non-consensual AI deepfakes, with some passing laws that make it a federal crime to knowingly publish or host such images. However, experts argue that private companies like X and Google should be more proactive in addressing this issue.
To combat this problem, companies could implement better technical safeguards to deter users from creating deepfakes and other forms of sexualized imagery. They might not provide a perfect solution but could at least add some friction to the process.
Meanwhile, advocacy groups like EndTAB are pushing for more public pressure on companies like X and xAI to prevent these types of images from being created in the first place.
These issues highlight the need for greater accountability and regulation in the tech industry when it comes to protecting users from non-consensual content.
Both platforms have strict policies against such content, but they have failed to remove these apps from their stores. The European Union has condemned these images as "illegal" and "appalling," and X has warned users that creating CSAM with Grok will result in severe consequences. However, the app remains available for download.
A growing industry around "nudify" services online has emerged, where stand-alone apps and websites promise to digitally strip women without their consent. Companies like AI startups have also struggled to prevent their tools from being used to generate nonconsensual sexualized imagery.
Lawmakers in the US and other countries have cracked down on non-consensual AI deepfakes, with some passing laws that make it a federal crime to knowingly publish or host such images. However, experts argue that private companies like X and Google should be more proactive in addressing this issue.
To combat this problem, companies could implement better technical safeguards to deter users from creating deepfakes and other forms of sexualized imagery. They might not provide a perfect solution but could at least add some friction to the process.
Meanwhile, advocacy groups like EndTAB are pushing for more public pressure on companies like X and xAI to prevent these types of images from being created in the first place.
These issues highlight the need for greater accountability and regulation in the tech industry when it comes to protecting users from non-consensual content.
... but at the same time, can't we just let the companies figure it out themselves? I'm all for holding them accountable and pushing for greater regulation, but also, come on, these platforms are supposed to be a safe space for users, right? And yet, here we are with CSAM and non-consensual deepfakes running amok... 
. Like, who comes up with this stuff? Companies need to step up their game and implement better safeguards, but also, shouldn't we be having a broader conversation about what's considered acceptable online? I mean, is a digital strip without consent really the same as a real-life stripper?
. But hey, at least there are advocacy groups like EndTAB pushing for change... that's definitely something to build on 
. Maybe we can find a way to balance free speech with user safety? I guess it's hard to say, but one thing's for sure: this is a complicated issue that needs some serious thought 
idk, maybe i'm just naive about how tech works, but it feels like we should be able to trust companies to do better.
. It's time for some real action, not just empty warnings and policy changes 
.
. And to think they're still available for download on major platforms like Apple and Google Play? It's like they're trying to enable a digital version of the creepiest internet history 
. I hope these companies step up their game and add some real safeguards, but until then, it's just a bunch of tech troubles 
.
... it's not rocket science, folks! 
. It's not just about taking down the apps, it's about making it harder for people to create this stuff in the first place.
. They can't just wait for someone else to fix the problem, they have to take action themselves.
.
x app is literally getting away with this and the EU is saying it's "illegal" lol what's next? 
we need more accountability here. these laws in the US might be a good start but private companies like x should do better than that 
. we can't just rely on lawmakers to fix this problem.
it's time to take responsibility for the crap you're pushing out into the world 
i mean, i get that tech is moving fast and all but doesnt that speed come at a cost? we need stricter laws and regulations in place so these companies cant just shrug off their responsibility