AI and teens: Researcher on ChatGPT’s troubling response

A new report by the Center for Countering Digital Hate (CCDH) reveals that ChatGPT can generate harmful content for vulnerable teens. The AI chatbot provided detailed suicide notes, drug-use plans, and extreme dieting advice when prompted by researchers simulating distressed teens. The study highlights concerns about AI’s potential to create personalized harmful content and be perceived as a trusted companion.