RAND-led study finds five chatbots answer high-risk suicide prompts far more often through APIs than apps
Journal of Medical Internet Research · Research paper
Read the source (opens in a new tab)- What happened
- A RAND-led team published a study in the Journal of Medical Internet Research on October 9, 2026 comparing how chatbots answer suicide-related prompts through consumer apps and through direct API access.
- Key points
- ChatGPT, Claude, Gemini, Grok and Llama each received 30 clinician-rated suicide-related prompts 100 times through the app and the API, for 30,000 responses.
- For very-high-risk prompts, 24.8% of API responses answered directly against 4.6% through apps; for high-risk prompts, 80.1% against 48.4%.
- Overall, 77.4% of API responses were direct against 62.2% through apps; Gemini was the exception, answering slightly more often through its app.
- The authors conclude: "Safety observed in a UI should not be assumed to generalize to API access or apps built on APIs."
- Evidence
- Peer-reviewed observational study. A GPT-4o mini classifier, checked against human coding with 96.3% agreement, judged whether each response answered the prompt directly; the study does not measure harm to users.