Acute Physiology and Chronic Health Evaluation (APACHE) IV: Hospital mortality assessment for today’s critically ill patients*

Objective:To improve the accuracy of the Acute Physiology and Chronic Health Evaluation (APACHE) method for predicting hospital mortality among critically ill adults and to evaluate changes in the accuracy of earlier APACHE models. Design:Observational cohort study. Setting:A total of 104 intensive care units (ICUs) in 45 U.S. hospitals. Patients:A total of 131,618 consecutive ICU admissions during 2002 and 2003, of which 110,558 met inclusion criteria and had complete data. Interventions:None. Measurements and Main Results:We developed APACHE IV using ICU day 1 information and a multivariate logistic regression procedure to estimate the probability of hospital death for randomly selected patients who comprised 60% of the database. Predictor variables were similar to those in APACHE III, but new variables were added and different statistical modeling used. We assessed the accuracy of APACHE IV predictions by comparing observed and predicted hospital mortality for the excluded patients (validation set). We tested discrimination and used multiple tests of calibration in aggregate and for patient subgroups. APACHE IV had good discrimination (area under the receiver operating characteristic curve = 0.88) and calibration (Hosmer-Lemeshow C statistic = 16.9, p = .08). For 90% of 116 ICU admission diagnoses, the ratio of observed to predicted mortality was not significantly different from 1.0. We also used the validation data set to compare the accuracy of APACHE IV predictions to those using APACHE III versions developed 7 and 14 yrs previously. There was little change in discrimination, but aggregate mortality was systematically overestimated as model age increased. When examined across disease, predictive accuracy was maintained for some diagnoses but for others seemed to reflect changes in practice or therapy. Conclusions:APACHE IV predictions of hospital mortality have good discrimination and calibration and should be useful for benchmarking performance in U.S. ICUs. The accuracy of predictive models is dynamic and should be periodically retested. When accuracy deteriorates they should be revised and updated.

[1]  C Jones,et al.  Glasgow coma scale. , 1979, The American journal of nursing.

[2]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[3]  E. Draper,et al.  APACHE II: A severity of disease classification system , 1985, Critical care medicine.

[4]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[5]  W. Knaus,et al.  The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. , 1991, Chest.

[6]  S Lemeshow,et al.  The APACHE III prognostic system. , 1992, Chest.

[7]  W. Knaus,et al.  Reliability of a measure of severity of illness: acute physiology of chronic health evaluation--II. , 1992, Journal of clinical epidemiology.

[8]  S. Lemeshow,et al.  Mortality Probability Models (MPM II) based on an international cohort of intensive care unit patients. , 1993, JAMA.

[9]  Frans Van de Werf,et al.  An international randomized trial comparing four thrombolytic strategies for acute myocardial infarction. , 1993, The New England journal of medicine.

[10]  S. Lemeshow,et al.  A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. , 1993, JAMA.

[11]  W. Knaus,et al.  Variations in Mortality and Length of Stay in Intensive Care Units , 1993, Annals of Internal Medicine.

[12]  S. Lemeshow,et al.  A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study , 1993 .

[13]  Frank E. Harrell,et al.  Identification of Comatose Patients at High Risk for Death or Severe Disability , 1995 .

[14]  W. Knaus,et al.  The use of APACHE III to evaluate ICU length of stay, resource use, and mortality after coronary artery by-pass surgery. , 1995, The Journal of cardiovascular surgery.

[15]  J. Bion,et al.  A comparison of severity of illness scoring systems for intensive care unit patients: results of a multicenter, multinational study. The European/North American Severity Study Group. , 1995, Critical care medicine.

[16]  S Lemeshow,et al.  Factors affecting the performance of the models in the Mortality Probability Model II system and strategies of customization: a simulation study. , 1996, Critical care medicine.

[17]  G. Apolone,et al.  Impact of different customization strategies in the performance of a general severity score. , 1997, Critical care medicine.

[18]  J. Luce,et al.  Increasing incidence of withholding and withdrawal of life support from the critically ill. , 1997, American journal of respiratory and critical care medicine.

[19]  W. Knaus,et al.  Evaluation of acute physiology and chronic health evaluation III predictions of hospital mortality in an independent database. , 1998, Critical care medicine.

[20]  C. Sprung,et al.  Use of the SOFA score to assess the incidence of organ dysfunction/failure in intensive care units: results of a multicenter, prospective study. Working group on "sepsis-related problems" of the European Society of Intensive Care Medicine. , 1998, Critical care medicine.

[21]  J. Luce,et al.  A national survey of end-of-life care for critically ill patients. , 1998, American journal of respiratory and critical care medicine.

[22]  V. Fidler,et al.  Evaluation of two outcome prediction models on an independent database. , 1998, Critical care medicine.

[23]  Giles Morgan,et al.  Confidential inquiry into quality of care before admission to intensive care , 1998, BMJ.

[24]  D. Goldhill,et al.  Outcome of intensive care patients in a group of British intensive care units. , 1998, Critical care medicine.

[25]  E. Bennett,et al.  Comparison of outcome from intensive care admission after adjustment for case mix by the APACHE III prognostic system. , 1999, Chest.

[26]  T. Speroff,et al.  Increased risk of death in patients with do-not-resuscitate orders. , 1999, Medical care.

[27]  A J Rotondi,et al.  Community-wide assessment of intensive care outcomes using a physiologically based prognostic measure: implications for critical care delivery from Cleveland Health Quality Choice. , 1999, Chest.

[28]  D. Goldhill,et al.  Physiological values and procedures in the 24 h before ICU admission from the ward , 1999, Anaesthesia.

[29]  W J Sibbald,et al.  Interobserver variability in data collection of the APACHE II score in teaching and community hospitals. , 1999, Critical care medicine.

[30]  M. Hiesmayr,et al.  Prognostic performance and customization of the SAPS II: results of a multicenter Austrian study , 1999, Intensive Care Medicine.

[31]  V. Boyko,et al.  The prognosis of a first Q-wave versus non-Q-wave myocardial infarction in the reperfusion era. , 2000, The American journal of medicine.

[32]  A. Wilmer,et al.  Thrombocytopenia and prognosis in intensive care , 2000, Critical care medicine.

[33]  T. Scholten,et al.  Comparison of Acute Physiology and Chronic Health Evaluations II and III and Simplified Acute Physiology Score II: A prospective cohort study evaluating these methods to predict outcome in a German interdisciplinary intensive care unit , 2000, Critical care medicine.

[34]  C B Granger,et al.  Risk stratification and therapeutic decision making in acute coronary syndromes. , 2000, JAMA.

[35]  S. Mackenzie,et al.  Should the pre‐sedation Glasgow Coma Scale value be used when calculating Acute Physiology and Chronic Health Evaluation scores for sedated patients? , 2000, Critical care medicine.

[36]  C. Goldfrad,et al.  Consequences of discharges from intensive care at night , 2000, The Lancet.

[37]  M. Kollef,et al.  Automated computerized intensive care unit severity of illness measure in the Department of Veterans Affairs: Preliminary results , 2000, Critical care medicine.

[38]  C B Schechter,et al.  Outcome prediction model for very elderly critically ill patients , 2001, Critical care medicine.

[39]  Frank E. Harrell,et al.  Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis , 2001 .

[40]  T M Therneau,et al.  A model to predict survival in patients with end‐stage liver disease , 2001, Hepatology.

[41]  R. Beale,et al.  Reduction in mortality after inappropriate early discharge from intensive care unit: logistic regression triage model , 2001, BMJ : British Medical Journal.

[42]  T. Scholten,et al.  Performance of the score systems Acute Physiology and Chronic Health Evaluation II and III at an interdisciplinary intensive care unit, after customization , 2001, Critical care.

[43]  T. Osler,et al.  Identifying quality outliers in a large, multiple-institution database by using customized versions of the Simplified Acute Physiology Score II and the Mortality Probability Model II0* , 2002, Critical care medicine.

[44]  T. Osler,et al.  Rating the quality of intensive care units: Is it a function of the intensive care unit scoring system?* , 2002, Critical care medicine.

[45]  Marc J Popovich.  If most intensive care units are graduating with honors, is it genuine quality or grade inflation? , 2002, Critical care medicine.

[46]  J. Astermark,et al.  The prognostic value of global haemostatic tests in the intensive care unit setting , 2002, Acta anaesthesiologica Scandinavica.

[47]  J. Vincent,et al.  Time course of platelet counts in critically ill patients , 2002, Critical care medicine.

[48]  E. Draper,et al.  Comparing ICU Populations: Background and Current Methods , 2002 .

[49]  J. Timsit,et al.  Decisions to forgo life-sustaining therapy in ICU patients independently predict hospital death , 2003, Intensive Care Medicine.

[50]  Rodney A Hayward,et al.  Accepting Critically Ill Transfer Patients: Adverse Effect on a Referral Center's Outcome and Benchmark Measures , 2003, Annals of Internal Medicine.

[51]  D. Wagner,et al.  Automated intensive care unit risk adjustment: results from a National Veterans Affairs study. , 2003, Critical care medicine.

[52]  J. Helterbrand,et al.  Drotrecogin alfa (activated) administration across clinically important subgroups of patients with severe sepsis , 2003, Critical care medicine.

[53]  B. Doebbeling,et al.  Prognostic factors for mortality following interhospital transfers to the medical intensive care unit of a tertiary referral center , 2003, Critical care medicine.

[54]  Bruce Weaver,et al.  Clinician predictions of intensive care unit mortality* , 2004, Critical care medicine.

[55]  James Deddens,et al.  Variation in outcomes in Veterans Affairs intensive care units with a computerized severity measure* , 2005, Critical care medicine.

[56]  G. Apolone,et al.  The performance of SAPS II in a cohort of patients admitted to 99 Italian ICUs: Results from GiViTI , 1996, Intensive Care Medicine.

[57]  Stephen P. Luby,et al.  Appendix Table 2 , 2007 .