RAND-led study finds five chatbots answer high-risk suicide prompts far more often through APIs than apps

Journal of Medical Internet Research · Research paper

Read the source (opens in a new tab)
What happened
A RAND-led team published a study in the Journal of Medical Internet Research on October 9, 2026 comparing how chatbots answer suicide-related prompts through consumer apps and through direct API access.
Key points
  • ChatGPT, Claude, Gemini, Grok and Llama each received 30 clinician-rated suicide-related prompts 100 times through the app and the API, for 30,000 responses.
  • For very-high-risk prompts, 24.8% of API responses answered directly against 4.6% through apps; for high-risk prompts, 80.1% against 48.4%.
  • Overall, 77.4% of API responses were direct against 62.2% through apps; Gemini was the exception, answering slightly more often through its app.
  • The authors conclude: "Safety observed in a UI should not be assumed to generalize to API access or apps built on APIs."
Evidence
Peer-reviewed observational study. A GPT-4o mini classifier, checked against human coding with 96.3% agreement, judged whether each response answered the prompt directly; the study does not measure harm to users.

See it in the latest record