When predictions are used to allocate scarce health care resources: three considerations for models in the era of Covid-19

Background The need for life-saving interventions such as mechanical ventilation may threaten to outstrip resources during the Covid-19 pandemic. Allocation of these resources to those most likely to benefit can be supported by clinical prediction models. The ethical and practical considerations relevant to predictions supporting decisions about microallocation are distinct from those that inform shared decision-making in ways important for model design. Main body We review three issues of importance for microallocation: (1) Prediction of benefit (or of medical futility) may be technically very challenging; (2) When resources are scarce, calibration is less important for microallocation than is ranking to prioritize patients, since capacity determines thresholds for resource utilization; (3) The concept of group fairness, which is not germane in shared decision-making, is of central importance in microallocation. Therefore, model transparency is important. Conclusion Prediction supporting allocation of life-saving interventions should be explicit, data-driven, frequently updated and open to public scrutiny. This implies a preference for simple, easily understood and easily applied prognostic models.

[1]  N. Christakis,et al.  Extent and determinants of error in physicians' prognoses in terminally ill patients: prospective cohort study. , 2000, The Western journal of medicine.

[2]  Maarten van Smeden,et al.  Calibration: the Achilles heel of predictive analytics , 2019, BMC Medicine.

[3]  A. Jonsen,et al.  Medical futility: its meaning and ethical implications. , 1990, Annals of internal medicine.

[4]  Dirk Timmerman,et al.  Predictive analytics in health care: how can we know it works? , 2019, J. Am. Medical Informatics Assoc..

[5]  Ewout W. Steyerberg,et al.  Big Data and Predictive Analytics: Recalibrating Expectations , 2018, JAMA.

[6]  G. Heinze,et al.  Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal , 2020, BMJ.

[7]  Ezekiel J Emanuel,et al.  Fair Allocation of Scarce Medical Resources in the Time of Covid-19. , 2020, The New England journal of medicine.

[8]  T. Trikalinos,et al.  The Empirical Basis for Determinations of Medical Futility , 2010, Journal of General Internal Medicine.

[9]  E. Steyerberg,et al.  Prognosis Research Strategy (PROGRESS) 3: Prognostic Model Research , 2013, PLoS medicine.

[10]  Ewout Steyerberg,et al.  Personalized evidence based medicine: predictive approaches to heterogeneous treatment effects , 2018, British Medical Journal.

[11]  S. Lemeshow,et al.  Outcome prediction for individual intensive care patients: Useful, misused, or abused? , 1995, Intensive Care Medicine.

[12]  D. Kent,et al.  Risk models and patient-centered evidence: should physicians expect one right answer? , 2012, JAMA.

[13]  David M. Kent,et al.  Predictably unequal: understanding and addressing concerns that algorithmic clinical prediction may increase health disparities , 2020, npj Digital Medicine.

[14]  D. Wilkinson The self-fulfilling prophecy in intensive care , 2009, Theoretical medicine and bioethics.

[15]  M. Kattan,et al.  Predicting Nonsentinel Node Status After Positive Sentinel Lymph Biopsy for Breast Cancer: Clinicians Versus Nomogram , 2005, Annals of Surgical Oncology.

[16]  Gary S Collins,et al.  Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): Explanation and Elaboration , 2015, Annals of Internal Medicine.