Vals AI and Stanford test 18 chatbots in simulated teen conversations and find safety failures persist with a teen-aware prompt

arXiv · Research preprint

Read the source (opens in a new tab)
What happened
Researchers from Vals AI and Stanford University posted a preprint on November 4, 2026 evaluating 18 chatbot APIs in 32,555 simulated conversations with teenagers aged 13 to 17.
Key points
  • Chatbots failed the study's 22 clinician-informed safety criteria 43.3% of the time, and 24.9% with a system prompt stating the user's age and asking for safety.
  • With that prompt, emotional-dependence failures fell from 54% to 15%, but failures to respond to indirect suicide risk stayed at 52% and to self-harm near 75%.
  • Without the prompt, when a teen pushed back, failures on mental health diagnosis, medication and substance misuse boundaries rose 10 to 12 points for more than 80% of chatbots.
Evidence
Research preprint from an AI evaluation company and Stanford. GPT-5.6 Terra played teens in scenarios from 12 US clinicians; an AI judge, checked against clinician reviews, scored the answers.
Uncertain
Not peer reviewed, and no real adolescents took part. The authors say the scenarios "cannot capture every failure mode or pattern of chatbot use teens may experience."

See it in the latest record