Character AI, the platform that lets users create their own customizable genAI chatbots, has taken a drastic measure in response to mounting pressure and controversy. The startup has announced it will ban kids from interacting with its chatbots altogether, citing concerns over safety and well-being.
The decision comes after several lawsuits alleged that the company's chatbots had spurred young users to commit self-harm and suicide. In addition, criticism over the types of characters created on the platform, including a Jeffrey Epstein-themed chatbot, has sparked outrage.
Character AI's founders have come under fire for their handling of these issues, with some accusing them of prioritizing profits over user safety. The company's announcement to ban minors from interacting with its chatbots is seen as a conservative step, but one that may be necessary to prioritize teen safety while still offering young users creative outlets.
In an effort to address these concerns, Character AI plans to establish and fund an "AI Safety Lab" - an independent non-profit dedicated to innovating safety alignment for next-generation AI entertainment features. The lab's goal is to develop safer and more responsible AI technologies that can be used by all ages.
The move follows intense pressure from lawmakers, with Congress introducing a bill dubbed the GUARD Act that would force companies like Character AI to implement age verification on their sites and block users under 18 years old. Senator Josh Hawley stated that "AI chatbots pose a serious threat to our kids," echoing concerns raised by parents who claim their children attempted or died by suicide after interacting with the company's services.
While Character AI's spokesperson has argued that user-created characters are intended for entertainment, the company has faced criticism over the explicit content and disturbing personas created on the platform. These include chatbots modeled on real people, promoting dangerous ideologies, and asking minors for personal information.
In an effort to mitigate these risks, Character AI will reduce access to chats for users under 18 to two hours per day by November 25th. After this date, minors won't be able to interact with the site's chatbots like they used to. Instead, young users will have opportunities to create videos, stories, and streams without engaging with characters.
The future of AI safety remains a pressing concern, with lawmakers and regulators pushing for more responsible practices in the industry. Character AI's decision to ban minors from interacting with its chatbots may set a precedent for prioritizing teen safety while still promoting creative outlets. Only time will tell if this move will have the desired impact on user well-being.
The decision comes after several lawsuits alleged that the company's chatbots had spurred young users to commit self-harm and suicide. In addition, criticism over the types of characters created on the platform, including a Jeffrey Epstein-themed chatbot, has sparked outrage.
Character AI's founders have come under fire for their handling of these issues, with some accusing them of prioritizing profits over user safety. The company's announcement to ban minors from interacting with its chatbots is seen as a conservative step, but one that may be necessary to prioritize teen safety while still offering young users creative outlets.
In an effort to address these concerns, Character AI plans to establish and fund an "AI Safety Lab" - an independent non-profit dedicated to innovating safety alignment for next-generation AI entertainment features. The lab's goal is to develop safer and more responsible AI technologies that can be used by all ages.
The move follows intense pressure from lawmakers, with Congress introducing a bill dubbed the GUARD Act that would force companies like Character AI to implement age verification on their sites and block users under 18 years old. Senator Josh Hawley stated that "AI chatbots pose a serious threat to our kids," echoing concerns raised by parents who claim their children attempted or died by suicide after interacting with the company's services.
While Character AI's spokesperson has argued that user-created characters are intended for entertainment, the company has faced criticism over the explicit content and disturbing personas created on the platform. These include chatbots modeled on real people, promoting dangerous ideologies, and asking minors for personal information.
In an effort to mitigate these risks, Character AI will reduce access to chats for users under 18 to two hours per day by November 25th. After this date, minors won't be able to interact with the site's chatbots like they used to. Instead, young users will have opportunities to create videos, stories, and streams without engaging with characters.
The future of AI safety remains a pressing concern, with lawmakers and regulators pushing for more responsible practices in the industry. Character AI's decision to ban minors from interacting with its chatbots may set a precedent for prioritizing teen safety while still promoting creative outlets. Only time will tell if this move will have the desired impact on user well-being.
. I've been worried about my own kiddo using something like this without proper guidance from me or another adult... it's not that the company is trying to be harsh, they're actually trying to protect their users and get ahead of these safety concerns 
. The AI Safety Lab sounds like a great initiative too! Maybe we'll see more companies follow suit and start taking AI user safety seriously 
i think its about time someone took responsibility and put users first... kids are not just a market, they're human beings with feelings 
character ai needs to take ownership of what it's creating and make sure its safe for all ages 
. ban kids from interacting with chatbots? yeah, that's a pretty drastic move, but gotta admit, safety concerns are legit 
. it's crazy how ppl were already calling out their handling of the issue and now they're doing something to address it 
.
. what's gonna happen next?
. lets keep an eye on this and see how it all plays out 
.
. Like, I've seen some of the characters on Character AI's platform, and yeah, there are some weird ones out there 
, but most people just use them as a way to practice writing or storytelling skills 
... it feels like we're taking away an important tool for young people without even giving 'em some alternatives 
. What do you guys think? Should Character AI be banned entirely or is this move necessary to prevent harm 
I mean, who wants to limit their 13-year-old's fun with AI chatbots just because of some controversy? 
But what about the companies that are gonna be affected by these new laws? Won't that stifle innovation? 
. I've seen my own little one get lost in a game or movie before, and now imagine them getting sucked into a chatbot that's trying to mimic human emotions 
. As a parent, the thought of their safety is always on my mind 
. And I love the idea of them still being able to create content without interacting with chatbots - maybe even teaching them about responsible AI use 
. It's all about finding that balance and making sure our kids are protected online 
.
. It's wild that someone even thought it was a good idea to create a Jeffrey Epstein-themed chatbot... what were they thinkin'? 
. And I'm glad they're takin' this issue seriously enough to make some changes 
On the other hand, all those cases of self-harm and suicide can't be ignored. 
Those Jeffrey Epstein-themed chatbots were just gross, btw - who creates something like that on purpose?! 
.
so character AI is finally doing something about all the drama it's been ignoring... banning kids from their site is probably a good start, but let's be real, they've had years to clean up their act and they still got caught slippin'... i mean, who creates a Jeffrey Epstein-themed chatbot? 
that's just a recipe for disaster... it's about time they take responsibility for the toxic content on their platform... but at least they're setting up an AI safety lab to try and make things better... fingers crossed it'll be more than just a PR stunt 
. I'm hyped that Character AI is takin' responsibility for their mistakes and tryin' to do better 
. It's not just about kids, though – we gotta make sure all users feel safe online too 
. I'm lookin' forward to seein' more innovative safety measures come outta the AI Safety Lab