Mortality probability model III and simplified acute physiology score II: assessing their value in predicting length of stay and comparison to APACHE IV.

BACKGROUND To develop and compare ICU length-of-stay (LOS) risk-adjustment models using three commonly used mortality or LOS prediction models. METHODS Between 2001 and 2004, we performed a retrospective, observational study of 11,295 ICU patients from 35 hospitals in the California Intensive Care Outcomes Project. We compared the accuracy of the following three LOS models: a recalibrated acute physiology and chronic health evaluation (APACHE) IV-LOS model; and models developed using risk factors in the mortality probability model III at zero hours (MPM(0)) and the simplified acute physiology score (SAPS) II mortality prediction model. We evaluated models by calculating the following: (1) grouped coefficients of determination; (2) differences between observed and predicted LOS across subgroups; and (3) intraclass correlations of observed/expected LOS ratios between models. RESULTS The grouped coefficients of determination were APACHE IV with coefficients recalibrated to the LOS values of the study cohort (APACHE IVrecal) [R(2) = 0.422], mortality probability model III at zero hours (MPM(0) III) [R(2) = 0.279], and simplified acute physiology score (SAPS II) [R(2) = 0.008]. For each decile of predicted ICU LOS, the mean predicted LOS vs the observed LOS was significantly different (p <or= 0.05) for three, two, and six deciles using APACHE IVrecal, MPM(0) III, and SAPS II, respectively. Plots of the predicted vs the observed LOS ratios of the hospitals revealed a threefold variation in LOS among hospitals with high model correlations. CONCLUSIONS APACHE IV and MPM(0) III were more accurate than SAPS II for the prediction of ICU LOS. APACHE IV is the most accurate and best calibrated model. Although it is less accurate, MPM(0) III may be a reasonable option if the data collection burden or the treatment effect bias is a consideration.

[1]  J. Norrie,et al.  Evaluation of predicted and actual length of stay in 22 Scottish intensive care units using the APACHE III system , 2000, Anaesthesia.

[2]  J. Zimmerman,et al.  Intensive care unit length of stay: Benchmarking based on Acute Physiology and Chronic Health Evaluation (APACHE) IV* , 2006, Critical care medicine.

[3]  J. D. Young,et al.  Development and testing of a hierarchical method to code the reason for admission to intensive care units: the ICNARC Coding Method , 2001 .

[4]  C. Sirio,et al.  Use of intensive care units for patients with low severity of illness. , 1998, Archives of internal medicine.

[5]  W. Knaus,et al.  Variations in Mortality and Length of Stay in Intensive Care Units , 1993, Annals of Internal Medicine.

[6]  B. B. Fleming,et al.  Quality of medical care delivered to Medicare beneficiaries: A profile at state and national levels. , 2000, JAMA.

[7]  N. Halpern,et al.  Critical care medicine in the United States 1985–2000: An analysis of bed numbers, use, and costs* , 2004, Critical care medicine.

[8]  James Deddens,et al.  Variation in outcomes in Veterans Affairs intensive care units with a computerized severity measure* , 2005, Critical care medicine.

[9]  Paul N. Gorman,et al.  Computerized physician order entry in U.S. hospitals: results of a 2002 survey. , 2003, Journal of the American Medical Informatics Association : JAMIA.

[10]  G. Cooper,et al.  Severity-adjusted mortality and length of stay in teaching and nonteaching hospitals. Results of a regional study. , 1998, JAMA.

[11]  D. Wagner,et al.  Daily prognostic estimates for critically ill adults in intensive care units: Results from a prospective, multicenter, inception cohort analysis , 1994, Critical care medicine.

[12]  P. Pronovost,et al.  Organizational characteristics of intensive care units related to outcomes of abdominal aortic surgery. , 1999, JAMA.

[13]  Peter J Pronovost,et al.  Physician staffing patterns and clinical outcomes in critically ill patients: a systematic review. , 2002, JAMA.

[14]  S. Lemeshow,et al.  A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. , 1993, JAMA.

[15]  D. Nelson,et al.  State trends in uninsurance among individuals aged 18 to 64 years: United States, 1992-2001. , 2004, American journal of public health.

[16]  Ewout W Steyerberg,et al.  Internal and external validation of predictive models: a simulation study of bias and precision in small samples. , 2003, Journal of clinical epidemiology.

[17]  J. Lave,et al.  The effect of managed care on ICU length of stay: implications for medicare. , 1996, JAMA.

[18]  S Lemeshow,et al.  A method for assessing the clinical performance and cost‐effectiveness of intensive care units: A multicenter inception cohort study , 1994, Critical care medicine.

[19]  David Wennberg,et al.  The Implications of Regional Variations in Medicare Spending. Part 1: The Content, Quality, and Accessibility of Care , 2003, Annals of Internal Medicine.

[20]  D. Teres,et al.  Assessing contemporary intensive care unit outcome: An updated Mortality Probability Admission Model (MPM0-III)* , 2007, Critical care medicine.

[21]  D. Schoenfeld,et al.  Ventilation with lower tidal volumes as compared with traditional tidal volumes for acute lung injury and the acute respiratory distress syndrome. , 2000, The New England journal of medicine.

[22]  Yaseen Arabi,et al.  The characteristics of very short stay ICU admissions and implications for optimizing ICU resource utilization: the Saudi experience. , 2004, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[23]  J. Skinner,et al.  Use of hospitals, physician visits, and hospice care during last six months of life among cohorts loyal to highly respected hospitals in the United States , 2004, BMJ : British Medical Journal.

[24]  Mitzi L. Dean,et al.  Variation in ICU risk-adjusted mortality: impact of methods of assessment and potential confounders. , 2008, Chest.

[25]  W. Knaus,et al.  Variations in the use of do-not-resuscitate orders in ICUS. Findings from a national study. , 1996, Chest.

[26]  K. Haley,et al.  Intensive communication: Four-year follow-up from a clinical practice study , 2003, Critical care medicine.

[27]  Stanley Lemeshow,et al.  Explaining Variability of Cost Using a Severity-of-Illness Measure for ICU Patients , 1990, Medical care.

[28]  Rainu Kaushal,et al.  Bmc Medical Informatics and Decision Making Assessing the Level of Healthcare Information Technology Adoption in the United States: a Snapshot , 2005 .

[29]  H C van Houwelingen,et al.  Validation, calibration, revision and combination of prognostic survival models. , 2000, Statistics in medicine.

[30]  P. Kotler,et al.  Analytic Reviews: Considerations in the Development of Intensive Care Unit Report Cards , 2002 .

[31]  Wayne S Copes,et al.  A revised method to assess intensive care unit clinical performance and resource utilization* , 2007, Critical care medicine.

[32]  Jonathan Mant,et al.  Detecting differences in quality of care: the sensitivity of measures of process and outcome in treating acute myocardial infarction , 1995, BMJ.

[33]  J. D. Young,et al.  Development and testing of a hierarchical method to code the reason for admission to intensive care units: the ICNARC Coding Method. Intensive Care National Audit & Research Centre. , 2001, British journal of anaesthesia.

[34]  Peter Bauer,et al.  SAPS 3—From evaluation of the patient to evaluation of the intensive care unit. Part 2: Development of a prognostic model for hospital mortality at ICU admission , 2005, Intensive Care Medicine.

[35]  Harlan M Krumholz,et al.  National and state trends in quality of care for acute myocardial infarction between 1994-1995 and 1998-1999: the medicare health care quality improvement program. , 2003, Archives of internal medicine.

[36]  Hans C. van Houwelingen,et al.  Validation, calibration, revision and combination of prognostic survival models , 2000 .