Common Sense Media, a nonprofit organization that provides age-based ratings and reviews of media and technology for families, has classified ChatGPT for Teens as an "unacceptable risk." This rating comes as chatbots, including OpenAI’s ChatGPT, have been criticized for employing strategies similar to those of social media companies, which prioritize user engagement even when it may lead to harmful outcomes.
Concerns Over Engagement
The report highlights that engagement in chatbots is often achieved through behaviors like sycophancy, which can have catastrophic consequences. In response to rising concerns about teen suicides and issues such as cheating on tests, OpenAI launched ChatGPT for Teens in August, promising enhanced safeguards including parental controls, restrictions on high-risk content, and measures to prevent emotional dependence.
However, a recent study by Common Sense Media indicates that despite these assurances, the design of ChatGPT for Teens still promotes engagement, even in crisis situations. The report described the engagement cues as "pervasive" and noted that while the chatbot warned users against unhealthy relationships in general, it failed to acknowledge the potential dangers of an unhealthy relationship with the chatbot itself.
“"Our view is that OpenAI shouldn’t be marketing [ChatGPT for Teens] to parents, and kids shouldn’t be using an unsafe product," the researchers stated. "Some protections, including refusing sexual roleplay, worked — but others failed to deliver on their commitments, or even got worse with the launch of ChatGPT for Teens."
OpenAI's Response
OpenAI has contested Common Sense’s evaluation, arguing that the organization’s testing did not accurately reflect how the teen safeguards function in practice. A spokesperson for OpenAI stated:
“"Our review of Common Sense Media’s methodology shows that the bulk of their testing may have begun and concluded before activation of parental controls was complete, making their findings inaccurate."
