Stanford silently tested AI dosing agents in its hospital; pharmacists flag safety concerns in 65.8% of misses

medRxiv · Research preprint

Read the source (opens in a new tab)
What happened
Stanford researchers posted a medRxiv preprint on October 29, 2026 on PharmaAgent, LLM-based agents for vancomycin dosing that they silently deployed at Stanford Hospital for two months.
Key points
  • Across 403 dosing events in 316 patients, error against the treating pharmacist's order averaged 21.8% for high-autonomy agents and 37.8% for low-autonomy agents.
  • Recommendations fell within 25% of the order in 73.4% of events with high autonomy and 50.9% with low; a second pharmacist did so in 90.2%.
  • Pharmacist review of 196 out-of-tolerance recommendations found a safety concern in 65.8%, more often with low autonomy.
  • The authors conclude that "neither configuration is ready to dose patients without pharmacist oversight."
Evidence
Research preprint, not peer reviewed. The agents' recommendations were compared with the orders pharmacists actually wrote during a silent deployment.

See it in the latest record