“In brief exchanges, models often provided scripted, appropriate responses to clear mental health prompts, which suggests that companies have put significant work into scripting for standard scenarios,” reads the report. “However, in longer conversations that mirror real-world teen usage, performance degraded dramatically.”
A report found that leading chatbots are "fundamentally unsafe" for teens looking for mental health support, and failed to catch red flags.
https://futurism.com/artificial-intelligence/chatbots-teen-mental-health-chatgpt-gemini-claude