Objective: To assess the effect on the performance of Acute Physiology and Chronic Health Evaluation (APACHE) II and APACHE III of two different approaches to scoring the Glasgow Coma Scale (GCS) in sedated patients. The first approach was to assume that the GCS score was normal, and the second was to use the GCS value recorded before the patient was sedated. Design: Prospective cohort study over 2 yrs. Setting: Twenty‐two general adult intensive care units in Scotland. Patients: 13,291 consecutive admissions to the participating intensive care units. Measurements and Main Results: After exclusion of patients according to standard, predefined criteria, the Acute Physiology and Chronic Health Evaluation II and III systems were used to calculate the probability of hospital mortality for patients included in the study. In patients whose GCS scores could not be assessed accurately during the first 24 hrs, the APACHE II and III predictions were calculated twice: first, assuming that the GCS score was normal; and second, substituting the GCS score recorded before sedation. This generated two different databases for each system, and the predictions for both were compared with the observed hospital mortality rate. The effect of the two different approaches to the GCS on the performance of both APACHE II and APACHE III was assessed using measures of discrimination (area under the receiver operating characteristic curve) and goodness of fit (calibration curves and the Hosmer‐Lemeshow statistic). Analysis was undertaken for both the entire cohort and for the group of patients whose APACHE scores were altered. There was a wide variation in the number of patients who had their scores altered between participating units. There were also differences between diagnostic groups. Overall, however, 50% of the patients were sedated and 22% had their scores altered. Using the presedation GCS score increased the discrimination of both APACHE II and APACHE III. The calibration of APACHE III was also improved but that of APACHE II deteriorated. The calibration improved, however, in those patients with altered scores, suggesting that the overall deterioration is attributable to other limitations in the fit of the model to these data. Although changes had the greatest effect in patients with a neurologic or trauma diagnosis, the changes were important in most diagnostic groups. Conclusions: The GCS is an important component of both APACHE II and APACHE III. It should be assessed directly whenever possible. When patients are sedated, using the GCS score recorded before sedation is preferable to the assumption of normality. The variations between different units and different diagnostic groups highlight the possible effects of case mix on the performance of prognostic scoring systems.
[1]
D. Wagner,et al.
Glasgow Coma Scale score in the evaluation of outcome in the intensive care unit: Findings from the Acute Physiology and Chronic Health Evaluation III study
,
1993,
Critical care medicine.
[2]
Predicting mortality of intensive care unit patients. The importance of coma
,
1982,
Critical care medicine.
[3]
F. Cerra,et al.
APACHE II score does not predict multiple organ failure or mortality in postoperative surgical patients.
,
1990,
Archives of surgery.
[4]
E. Draper,et al.
APACHE II: A severity of disease classification system
,
1985,
Critical care medicine.
[5]
D. Marion,et al.
Problems with initial Glasgow Coma Scale assessment caused by prehospital treatment of patients with head injuries: results of a national survey.
,
1994,
The Journal of trauma.
[6]
W. Knaus,et al.
The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults.
,
1991,
Chest.
[7]
D. Hosmer,et al.
A review of goodness of fit statistics for use in the development of logistic regression models.
,
1982,
American journal of epidemiology.
[8]
J. Hanley,et al.
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
,
1982,
Radiology.
[9]
J H Kerr,et al.
Intensive Care Society's APACHE II study in Britain and Ireland--II: Outcome comparisons of intensive care units after adjustment for case mix by the American APACHE II method.
,
1993,
BMJ.
[10]
B. Taylor,et al.
Prediction of outcome from intensive care: a prospective cohort study comparing Acute Physiology and Chronic Health Evaluation II and III prognostic systems in a United Kingdom intensive care unit.
,
1997,
Critical care medicine.
[11]
S. Lemeshow,et al.
A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study.
,
1993,
JAMA.
[12]
E. DeLong,et al.
Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach.
,
1988,
Biometrics.
[13]
B. Jennett,et al.
Assessment of coma and impaired consciousness. A practical scale.
,
1974,
Lancet.