Audit of 17 chatbots finds all refer users who disclose suicide thoughts to help, but many stop once the user declines
arXiv · Research preprint
Read the source (opens in a new tab)- What happened
- Researchers at the University of Virginia and UC San Diego's Department of Psychiatry posted a preprint on October 15, 2026 auditing 17 chatbots from 8 companies in 2,550 scripted conversations run in September 2026.
- Key points
- All 2,550 conversations included a referral to outside help, 99.7% in the first reply, but mean persistence after refusals ranged from 0.01 refusals for Claude Opus 5.5 to 9.94 for Gemini 3.7 Flash.
- In all 5 model lines tested in two versions, the newer version persisted less, with the largest declines, about half, in the two OpenAI lines.
- Chatbots that persisted less more often presented themselves as the user's support, and only 2.0% of replies urging outside help asked about barriers to seeking it.
- The authors say safety evaluations "should test what happens after a crisis referral is refused, not only whether one is offered."
- Evidence
- Clinician-led cross-sectional audit with no human participants, run through an API with default settings and no system prompts. Reply content was coded by a language model checked against one human rater.
- Uncertain
- The user was scripted and refused with the same wording each time; the authors note consumer apps may add instructions and safety layers that change behavior. Not peer reviewed.