TrialsgrambetaRCTs are beautiful

Manz ML nudges (SIC)

2020

Effect of Integrating Machine Learning Mortality Estimates With Behavioral Nudges to Clinicians on Serious Illness Conversations Among Patients With Cancer

In 14,607 patients with cancer seen by 78 oncology clinicians, machine-learning mortality predictions delivered as behavioural nudges increased serious illness conversations compared with usual care with weekly cumulative performance emails.

Result

Percentage of patient encounters with a documented serious illness conversation
Absolute difference
3.3 points
NNT
31
Effect estimate

adjusted difference3.395% CI 2.3-4.5 · P < 0.001

Absolute difference and NNT are derived from the event rates.

Also reported: Among 4,124 high-risk encounters 15.2% vs 3.6% (adjusted difference 11.6 points, 95% CI 8.2–12.5; P<0.001).

Original publication
Subtopic
Prognostic nudges
Design
Stepped-wedge cluster RCT, 8 clinic groups over 20 weeks, Pennsylvania, USA
Relevance
Practice-defining: a trial the field needs to know.
Source
Manz CR, et al. JAMA Oncol. 2020;6(12):e204759.doi 10.1001/jamaoncol.2020.4759

Discussion & critique

A landmark for pairing a validated ML mortality model with behavioural economics: the combination raised the rate of conversations with high-risk patients from 3.6% to 15.2%. Single academic system, 20 weeks, and a process endpoint (documented conversations) rather than goal-concordant care; the 40-week follow-up (Manz ML nudges (long-term)) later showed less end-of-life systemic therapy but no change in hospice or ICU use.