🔗 Share this article

The widely-used chatbot platform Character.ai is implementing a significant restriction that will prevent minors from having discussions with its virtual characters.

This move is in response to widespread concern regarding the nature of conversations teenagers were engaging in with the digital companions.

Lawsuits

The company, which started in 2021 and attracts numerous people, is dealing with several legal actions in the United States.

Families have filed lawsuits, among them related to the unfortunate passing of a minor, with some calling the platform a "clear and present danger" to youth.

Changed Rules

Beginning November 25th, users younger than 18 will only be able to create material such as videos with their characters, instead of having discussions as they presently are able to.

Internet security campaigners have applauded the decision but stated that the function should never have been accessible by children in the beginning.

Company Statement

"The new policy is a part of our core philosophy that we need to keep developing the most secure AI platform on the globe for recreational use," said Character.ai boss Karandeep Anand.

He continued that AI safety constitutes "a evolving challenge" but something the company had taken an "forceful" approach to, with parental controls and protective guardrails.

Professional Perspectives

Internet security body Internet Matters welcomed the announcement, but stressed that security protocols ought to have been implemented from the beginning.

"Our research shows that children are subjected to risky information and put at risk when interacting with AI, particularly AI chatbots," the group said.

Earlier Concerns

Character.ai has been criticized in the past for hosting potentially harmful or inappropriate chatbots that young users could engage with.

Avatars simulating British teenagers were identified on the platform before being removed.

Later, researchers identified a chatbot inspired by known predator which had accumulated numerous conversations with users.

Market Effects

Online expert Matt Navarra characterized the situation as a "alert" for the AI industry, which is moving "from unregulated creation to reactive controls".

"If a service that builds a teen experience subsequently implements restrictions, it's saying that moderated conversations don't suffice when the technology's emotional appeal is strong," he stated.

Next Steps

The platform announces its updated direction will be on providing "more immersive experiences" and "narrative experiences" for teenagers.

New age verification processes will also be introduced, and the platform will fund a new AI safety research lab.

An expert in digital protection, who has researched AI safety, commented it was "a sensible move" to restrict teenagers from interacting with chatbots.

"It helps to differentiate artistic expression from more intimate, emotionally sensitive conversations," she clarified.

"This represents so important for minor users in the process of learning to manage emotional and digital boundaries."

She mentioned that Character.ai's revised approaches may represent a "growing period" in the AI industry, where minor security is progressively being understood as an "pressing matter" for accountable advancement.