🔗 Share this article

The widely-used chatbot platform Character.ai is enforcing a substantial rule adjustment that will prevent teenagers from interacting with its artificial intelligence-driven companions.

This action is in response to growing backlash regarding the kinds of exchanges teenagers were participating in with the AI entities.

Lawsuits

The service, which was founded in 2021 and has millions of users, currently faces multiple lawsuits in the United States.

Families have initiated cases, among them involving the unfortunate passing of a young person, with some calling the platform a "clear and present danger" to teenagers.

Updated Policies

Beginning November 25th, users younger than 18 will only be able to generate content such as videos with their characters, as opposed to engaging in conversations as they now do.

Internet security advocates have welcomed the move but stated that the feature should never have been available to young users in the first place.

Company Statement

"This decision is a part of our core philosophy that we need to keep building the most protected AI platform on the globe for leisure activities," said Character.ai boss Karandeep Anand.

He mentioned that AI safety constitutes "a changing goal" but something the company had taken an "forceful" approach to, with parental controls and protective guardrails.

Specialist Views

Digital protection body Internet Matters supported the announcement, but emphasized that protective features needed to be built in from the outset.

"Investigations we've performed demonstrates that children are exposed to harmful content and put at risk when interacting with AI, including AI chatbots," the organization commented.

Earlier Concerns

Character.ai has been criticized in the past for featuring potentially dangerous or concerning chatbots that young users could engage with.

Virtual profiles mimicking British teenagers were discovered on the service before being removed.

Subsequently, investigative journalists found a chatbot based on known predator which had logged thousands of chats with users.

Sector Consequences

Social media expert Matt Navarra characterized the situation as a "wake-up call" for the AI industry, which is transitioning "from unregulated creation to reactive controls".

"When a platform that creates a youth-focused platform subsequently pulls the plug, it's indicating that moderated conversations don't suffice when the tech's emotional pull is strong," he remarked.

Coming Changes

The company says its new focus will be on providing "deeper gameplay" and "narrative experiences" for teenagers.

Updated identity confirmation processes will also be implemented, and the company will finance a fresh artificial intelligence security study center.

An AI safety researcher, who has studied AI safety, stated it was "a prudent action" to control teenagers from using chatbots.

"It assists to distinguish imaginative activities from more personal, psychologically vulnerable exchanges," she clarified.

"This constitutes so important for teenage users still learning to handle personal and online boundaries."

She added that Character.ai's revised approaches might reflect a "growing period" in the AI industry, where minor security is progressively being understood as an "urgent priority" for ethical development.