Manz ML nudges (SIC)
2020
Effect of Integrating Machine Learning Mortality Estimates With Behavioral Nudges to Clinicians on Serious Illness Conversations Among Patients With Cancer
In 14,607 patients with cancer seen by 78 oncology clinicians, machine-learning mortality predictions delivered as behavioural nudges increased serious illness conversations compared with usual care with weekly cumulative performance emails.
Result
- Absolute difference
- 3.3 points
- NNT
- 31
adjusted difference3.395% CI 2.3-4.5 · P < 0.001
Absolute difference and NNT are derived from the event rates.
Also reported: Among 4,124 high-risk encounters 15.2% vs 3.6% (adjusted difference 11.6 points, 95% CI 8.2–12.5; P<0.001).
- Subtopic
- Prognostic nudges
- Design
- Stepped-wedge cluster RCT, 8 clinic groups over 20 weeks, Pennsylvania, USA
- Relevance
- Practice-defining: a trial the field needs to know.
- Source
- Manz CR, et al. JAMA Oncol. 2020;6(12):e204759.doi 10.1001/jamaoncol.2020.4759
Discussion & critique
A landmark for pairing a validated ML mortality model with behavioural economics: the combination raised the rate of conversations with high-risk patients from 3.6% to 15.2%. Single academic system, 20 weeks, and a process endpoint (documented conversations) rather than goal-concordant care; the 40-week follow-up (Manz ML nudges (long-term)) later showed less end-of-life systemic therapy but no change in hospice or ICU use.