Audit of 17 chatbots finds all refer users who disclose suicide thoughts to help, but many stop once the user declines

arXiv · Research preprint

Read the source (opens in a new tab)
What happened
Researchers at the University of Virginia and UC San Diego's Department of Psychiatry posted a preprint on October 15, 2026 auditing 17 chatbots from 8 companies in 2,550 scripted conversations run in September 2026.
Key points
  • All 2,550 conversations included a referral to outside help, 99.7% in the first reply, but mean persistence after refusals ranged from 0.01 refusals for Claude Opus 5.5 to 9.94 for Gemini 3.7 Flash.
  • In all 5 model lines tested in two versions, the newer version persisted less, with the largest declines, about half, in the two OpenAI lines.
  • Chatbots that persisted less more often presented themselves as the user's support, and only 2.0% of replies urging outside help asked about barriers to seeking it.
  • The authors say safety evaluations "should test what happens after a crisis referral is refused, not only whether one is offered."
Evidence
Clinician-led cross-sectional audit with no human participants, run through an API with default settings and no system prompts. Reply content was coded by a language model checked against one human rater.
Uncertain
The user was scripted and refused with the same wording each time; the authors note consumer apps may add instructions and safety layers that change behavior. Not peer reviewed.

See it in the latest record