BACKGROUND
Risk stratification of patients in the intensive care unit (ICU) is an important tool because it permits comparison of patient populations for research and quality control. Unfortunately, currently available scoring systems were developed primarily in medical ICUs and have only mediocre performance in surgical ICUs. Moreover, they are very expensive to purchase and use. We conceived a simple risk-stratification tool for the surgical ICU that uses readily available International Classification of Diseases, Ninth Revision, codes to predict outcome. Called ICISS (International Classification of Disease Illness Severity Score), our score is the product of the survival risk ratios (obtained from an independent data set) for all International Classification of Diseases, Ninth Revision, diagnosis codes.
METHODS
A total of 5,322 noncardiac patients admitted to a surgical ICU during an 8-year period had their Acute Physiology and Chronic Health Evaluation (APACHE) II scores compared with their ICISS as predictors of outcome (survival/nonsurvival, length of stay, and charges).
RESULTS
ICISS proved to be a much better predictor of survival than APACHE (receiver operating characteristic (ROC) APACHE = 0.806; Hosmer-Lemeshow (HL) APACHE = 22.56; ROC ICISS = 0.892; HL ICISS = 12.06) or the APACHE survival probability (ROC = 0.836; HL = 34.47). These differences were highly statistically significant (p < 0.001). ICISS was also better correlated with ICU length of stay (APACHE R2 = 0.06; ICISS R2 = 0.32) and ICU charges (APACHE R2 = 0.07; ICISS R2 = 0.39). When combined in a logistic model with ICISS, APACHE II added slightly to the predictive power of ICISS alone (combined ROC = 0.903) but degraded the calibration of the model (combined HL = 16.29; p = 0.038).
CONCLUSION
Because ICISS is both more accurate and much less expensive to calculate than APACHE II score, ICISS should replace APACHE II score as the standard risk stratification tool in surgical ICUs.
[1]
J. Hanley,et al.
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
,
1982,
Radiology.
[2]
J. Bion,et al.
A comparison of severity of illness scoring systems for intensive care unit patients: results of a multicenter, multinational study. The European/North American Severity Study Group.
,
1995,
Critical care medicine.
[3]
A L Brannen,et al.
Prediction of outcome from critical illness. A comparison of clinical judgment with a prediction rule.
,
1989,
Archives of internal medicine.
[4]
Richard W. Carlson,et al.
Comparison of clinical assessment with APACHE II for predicting mortality risk in patients admitted to a medical intensive care unit.
,
1988,
JAMA.
[5]
W. Knaus,et al.
APACHE II: a severity of disease classification system.
,
1985
.
[6]
T. Osler,et al.
Trauma registry injury coding is superfluous: a comparison of outcome prediction based on trauma registry International Classification of Diseases-Ninth Revision (ICD-9) and hospital information system ICD-9 codes.
,
1997,
The Journal of trauma.
[7]
T. Osler,et al.
ICISS: an international classification of disease-9 based injury severity score.
,
1996,
The Journal of trauma.
[8]
D. Wagner,et al.
Daily prognostic estimates for critically ill adults in intensive care units: Results from a prospective, multicenter, inception cohort analysis
,
1994,
Critical care medicine.