Stanford silently tested AI dosing agents in its hospital; pharmacists flag safety concerns in 65.8% of misses
medRxiv · Research preprint
Read the source (opens in a new tab)- What happened
- Stanford researchers posted a medRxiv preprint on October 29, 2026 on PharmaAgent, LLM-based agents for vancomycin dosing that they silently deployed at Stanford Hospital for two months.
- Key points
- Across 403 dosing events in 316 patients, error against the treating pharmacist's order averaged 21.8% for high-autonomy agents and 37.8% for low-autonomy agents.
- Recommendations fell within 25% of the order in 73.4% of events with high autonomy and 50.9% with low; a second pharmacist did so in 90.2%.
- Pharmacist review of 196 out-of-tolerance recommendations found a safety concern in 65.8%, more often with low autonomy.
- The authors conclude that "neither configuration is ready to dose patients without pharmacist oversight."
- Evidence
- Research preprint, not peer reviewed. The agents' recommendations were compared with the orders pharmacists actually wrote during a silent deployment.