Vals AI and Stanford test 18 chatbots in simulated teen conversations and find safety failures persist with a teen-aware prompt
arXiv · Research preprint
Read the source (opens in a new tab)- What happened
- Researchers from Vals AI and Stanford University posted a preprint on November 4, 2026 evaluating 18 chatbot APIs in 32,555 simulated conversations with teenagers aged 13 to 17.
- Key points
- Chatbots failed the study's 22 clinician-informed safety criteria 43.3% of the time, and 24.9% with a system prompt stating the user's age and asking for safety.
- With that prompt, emotional-dependence failures fell from 54% to 15%, but failures to respond to indirect suicide risk stayed at 52% and to self-harm near 75%.
- Without the prompt, when a teen pushed back, failures on mental health diagnosis, medication and substance misuse boundaries rose 10 to 12 points for more than 80% of chatbots.
- Evidence
- Research preprint from an AI evaluation company and Stanford. GPT-5.6 Terra played teens in scenarios from 12 US clinicians; an AI judge, checked against clinician reviews, scored the answers.
- Uncertain
- Not peer reviewed, and no real adolescents took part. The authors say the scenarios "cannot capture every failure mode or pattern of chatbot use teens may experience."