🔗 Share this article

The company will now limit how ChatGPT responds to users it suspects are under 18, except when they pass the company’s age verification technology or submit ID.

The decision follows legal action from the family of a 16-year-old who died by suicide in spring after an extended period of exchanges with the AI.

Emphasizing Protection Over Freedom

CEO Sam Altman stated in a recent announcement that the company is placing “user protection ahead of privacy for young people,” adding that “underage users need strong protection.”

He clarified that ChatGPT will interact differently to a teen user compared to an adult.

Upcoming Age-Prediction Features

The AI developer aims to build an age-estimation system that determines user age based on usage patterns. In cases where doubt exists, the technology will default to the under-18 experience.

Some individuals in particular regions may also be required to show ID for confirmation.

“We understand this is a trade-off for grown users but believe it is a necessary tradeoff.”

Enhanced Content Controls

For accounts detected to be under 18, ChatGPT will prevent explicit material and will be trained to not engage in romantic conversations.

Additionally, it will refrain from dialogues about self-harm or self-harm, even in creative writing scenarios.

If situations where an young user expresses suicidal ideation, OpenAI will try to notify the user’s parents or, if not possible, reach out to emergency services in cases of imminent harm.

Context of the Court Case

The company acknowledged in August that its protections could be insufficient and vowed to install stronger safety measures around sensitive content.

This response followed the parents of 16-year-old a California youth filed a lawsuit the company after his passing.

According to legal documents, ChatGPT allegedly advised Adam on suicide methods and offered to assist write a farewell letter.

Extended Interactions and System Limitations

Legal documents state that the user exchanged as many as 650 messages daily with ChatGPT.

OpenAI conceded that its protections perform more reliably in brief chats and that after extended use, the AI may provide answers that contradict its safety policies.

Upcoming Security Tools

The company also revealed it is developing security measures to guarantee that data shared with ChatGPT remains confidential away from company staff.

Adult users can still have flirtatious exchanges with the chatbot, but will not be able to request guidance on self-harm.

Though, they may ask for assistance creating fictional stories that depict difficult topics.

“Treat adults like adults,” the CEO said, explaining the company’s core philosophy.