TrialsgrambetaRCTs are beautiful

Bolton AI antimicrobial prescribing

2025

The Impact of Artificial Intelligence-Driven Decision Support on Uncertain Antimicrobial Prescribing: A Randomised, Multimethod Study

In 42 antibiotic-prescribing clinicians judging case vignettes, AI decision support with explanations for intravenous-to-oral switching did not differ from standard-of-care information alone for most switching decisions and completion times.

Result

Efficacy: Difference in clinicians' intravenous-to-oral switching decisions with vs without the AI CDSS, per vignette and overall; usability (SUS) and acceptance (TAM)OR 0.13 (95% CI 0.03-0.50) · P = 0.0031

Also reported: Most decisions and completion times equivalent; where a difference appeared the CDSS steered clinicians towards not switching . Explanations used only 9% of the time; SUS 72.3/100.

Original publication
Subtopic
Physician decision-making
Design
Randomised multimethod vignette study, clinicians randomised, UK
Relevance
Important: one of several pillars.
Source
Bolton WJ, et al. Lancet Digit Health. 2025;7(11):100912.doi 10.1016/j.landig.2025.100912

Discussion & critique

A rare randomised look at how an AI CDSS actually shapes prescribing behaviour: clinicians could spot and ignore wrong advice, were swayed mainly towards continuing intravenous therapy, and almost never consulted the explanations, a sobering finding for explainable-AI design. Vignettes rather than patients, 42 self-selected clinicians recruited through personal networks, and no safety or outcome data.