🔗 Share this article

The popular chatbot platform Character.ai is implementing a major restriction that will stop teenagers from engaging in conversations with its AI-powered avatars.

This action comes after growing backlash regarding the kinds of exchanges minors were having with the AI entities.

Legal Challenges

The service, which launched in 2021 and is used by countless individuals, is confronting several legal actions in the America.

Families have taken legal action, including one concerning the loss of a teenager, with some labeling the platform a "serious risk" to youth.

New Restrictions

Starting from November 25th, users below eighteen will only be able to generate content such as videos with their characters, as opposed to engaging in conversations as they presently are able to.

Digital protection campaigners have welcomed the move but stated that the capability was inappropriate to be accessible by minors in the outset.

Official Response

"This decision is a extension of our core philosophy that we need to keep developing the safest AI platform on the world for entertainment purposes," stated Character.ai boss Karandeep Anand.

He continued that AI safety constitutes "a changing goal" but something the company had taken an "forceful" approach to, with safety measures and preventive measures.

Specialist Views

Online safety organization Internet Matters supported the decision, but emphasized that protective features needed to be incorporated from the start.

"Our research indicates that young people are subjected to risky information and put at risk when engaging with AI, particularly AI chatbots," the group said.

Past Issues

Character.ai has been questioned in the past for featuring potentially dangerous or offensive chatbots that young users could interact with.

Avatars simulating British teenagers were identified on the platform before being taken down.

Afterwards, reporters discovered a chatbot based on notorious criminal which had logged thousands of chats with users.

Market Effects

Digital platform expert Matt Navarra characterized the situation as a "reality check" for the AI industry, which is moving "from permissionless innovation to post-crisis regulation".

"When a platform that develops a teen experience afterwards implements restrictions, it's demonstrating that filtered chats are insufficient when the system's emotional engagement is strong," he remarked.

Next Steps

The platform announces its new focus will be on providing "deeper gameplay" and "character-driven stories" for teenagers.

New age verification systems will also be introduced, and the platform will fund a novel AI protection study center.

An expert in digital protection, who has studied AI safety, said it was "a sensible move" to limit teenagers from accessing chatbots.

"It aids to distinguish imaginative activities from more private, psychologically vulnerable interactions," she elaborated.

"This represents so important for teenage users still learning to handle emotional and digital limits."

She added that Character.ai's updated policies could indicate a "growing period" in the AI industry, where minor security is gradually being acknowledged as an "immediate concern" for ethical development.