Why try to predict ICU outcomes?

Purpose of reviewTo describe why the prediction of ICU outcomes is essential to underpin critical care quality improvement programmes. Recent findingsRecent literature demonstrates that risk-adjusted mortality is a widely used and well-accepted quality indicator for benchmarking ICU performance. Ongoing research continues to address the best ways to present the results of benchmarking through either direct comparison among institutions (e.g., by funnel plots) or indirect comparison against the risk predictions from a risk model (e.g., by process control charts). There is also ongoing research and debate regarding event-based outcomes (e.g., hospital mortality) versus time-based outcomes (e.g., 30-day mortality). Beyond benchmarking, ICU outcome prediction models have a role in risk adjustment and risk stratification in randomized controlled trials, and adjusting for confounding in nonrandomized, observational research. Recent examples include comparing risk-adjusted outcomes according to ‘capacity strain’ on the ICU and extending propensity matching methods to evaluate outcomes of patients managed with a pulmonary artery catheter, among others. Risk models may have a role in communicating risk, but their utility for individual patient decision-making is limited. SummaryRisk-adjusted mortality has strong support from the critical care community as a quality indicator for benchmarking ICU performance but is dependent on up-to-date, accurate risk models. ICU outcome prediction can also contribute to both randomized and nonrandomized research and potentially contribute to individual patient management, although generic risk models should not be used to guide individual treatment decisions.

[1]  K. Vedhara,et al.  A 10 year (2000–2010) systematic review of interventions to improve quality of care in hospitals , 2012, BMC Health Services Research.

[2]  H. Flaatten The present use of quality indicators in the intensive care unit , 2012, Acta anaesthesiologica Scandinavica.

[3]  A. Donabedian,et al.  The quality of care. How can it be assessed? , 1988, JAMA.

[4]  Ewout W Steyerberg,et al.  Covariate adjustment in randomized controlled trials with dichotomous outcomes increases statistical power and reduces sample size requirements. , 2004, Journal of clinical epidemiology.

[5]  S. Ratcliffe,et al.  Outcomes Among Patients Discharged From Busy Intensive Care Units , 2013, Annals of Internal Medicine.

[6]  James R Carpenter,et al.  Recalibration of risk prediction models in a large multicenter cohort of admissions to adult, general critical care units in the United Kingdom* , 2006, Critical care medicine.

[7]  P. Maurette,et al.  [To err is human: building a safer health system]. , 2002, Annales francaises d'anesthesie et de reanimation.

[8]  Alastair Baker,et al.  Crossing the Quality Chasm: A New Health System for the 21st Century , 2001, BMJ : British Medical Journal.

[9]  T. Iwashyna,et al.  Hospital Factors Associated With Discharge Bias in ICU Performance Measurement* , 2014, Critical care medicine.

[10]  David M Kent,et al.  Assessing and reporting heterogeneity in treatment effects in clinical trials: a proposal , 2010, Trials.

[11]  Hester F. Lingsma,et al.  What is the probability of detecting poorly performing hospitals using funnel plots? , 2013, BMJ quality & safety.

[12]  B. Kavanagh,et al.  Scoring systems for the critically ill:use, misuse and abuse , 2006, Canadian journal of anaesthesia = Journal canadien d'anesthesie.

[13]  M. Ruel,et al.  Comparison of the EuroSCORE and Cardiac Anesthesia Risk Evaluation (CARE) score for risk-adjusted mortality analysis in cardiac surgery. , 2012, European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery.

[14]  L. Goldman,et al.  The SUPPORT Prognostic Model: Objective Estimates of Survival for Seriously Ill Hospitalized Adults , 1995, Annals of Internal Medicine.

[15]  A. Abu-Hanna,et al.  Prediction of long-term mortality in ICU patients: model validation and assessing the effect of using in-hospital versus long-term mortality on benchmarking , 2013, Intensive Care Medicine.

[16]  C. Sirio,et al.  A new conceptual framework for ICU performance appraisal and improvement. , 2002, Journal of critical care.

[17]  C. Sprung,et al.  Prospectively defined indicators to improve the safety and quality of care for critically ill patients: a report from the Task Force on Safety and Quality of the European Society of Intensive Care Medicine (ESICM) , 2012, Intensive Care Medicine.

[18]  K. Lee,et al.  Clinical trials in acute myocardial infarction: should we adjust for baseline characteristics? , 2000, American heart journal.

[19]  Assurance in Medicare,et al.  Medicare: A Strategy for Quality Assurance Volume 1 , 1990 .

[20]  A. Bindman,et al.  A brief history of health care quality assessment and improvement in the United States. , 1994, The Western journal of medicine.

[21]  Ewout W Steyerberg,et al.  Covariate adjustment increased power in randomized controlled trials: an example in traumatic brain injury. , 2012, Journal of clinical epidemiology.

[22]  William White,et al.  A Proposal , 2008, Moon, Sun, and Witches.

[23]  T. Higgins Quantifying Risk and Benchmarking Performance in the Adult Intensive Care Unit , 2007, Journal of intensive care medicine.

[24]  J. Sekhon,et al.  A matching method for improving covariate balance in cost-effectiveness analyses. , 2012, Health economics.

[25]  Y. Skrobik,et al.  Les systèmes de notation pour les grands malades :usage, mésusage et abus , 2006 .

[26]  Niels Peek,et al.  Performance of risk-adjusted control charts to monitor in-hospital mortality of intensive care unit patients: A simulation study* , 2012, Critical care medicine.

[27]  J. Marshall,et al.  Ten reasons why we should NOT use severity scores as entry criteria for clinical trials or in our treatment decisions* , 2010, Critical care medicine.

[28]  David M Kent,et al.  Multivariable risk prediction can greatly enhance the statistical power of clinical trial subgroup analysis , 2006, BMC medical research methodology.

[29]  David M Kent,et al.  Limitations of applying summary results of clinical trials to individual patients: the need for risk stratification. , 2007, JAMA.

[30]  K. Rowan,et al.  Outcome data and scoring systems , 1999, BMJ.

[31]  David J Spiegelhalter,et al.  Funnel plots for comparing institutional performance , 2005, Statistics in medicine.