Automatic calculation of a modified APACHE II score using a patient data management system (PDMS)

OBJECTIVE To investigate a fully automated and modified APACHE II score calculation exclusively based on routine data supplied by patient data management system, the ICUData, and to assess the predictive performance of this score using analysis of discrimination and calibration at an operative ICU. METHOD SQL scripts (calculation programs) were developed to calculate the scores of 524 patients who stayed at the ICU between April 1st, 1999 and March 31st, 2000. The calculation programs considered unavailable data as 'not pathological'. The main outcome measure was survival status at ICU discharge. The discriminative power on mortality of this modified APACHE II score was checked with a receiver operating characteristic (ROC) curve. Calibration was tested using the Hosmer-Lemeshow goodness-of-fit test. RESULTS The 459 survivors had an average APACHE score of 17.8+/-5.3. The score of the 65 deceased patients averaged 22.7+/-4.6. The area under the ROC curve of 0.790 was significantly >0.5 (P<0.01) and had a 95% confidence interval (CI) of 0.712-0.825. The goodness-of-fit test showed a good calibration (H=4.89, P=0.70, dof 7, C=6.96, P=0.541, dof 8). CONCLUSION A prediction model based on completely automatically calculated 'modified APACHE II scores' can be constructed using data collected with PDMS. However, due to differences in the patient collective and methods used, the results need validation and can only be partially compared to results from other studies.

[1]  Stanley Lemeshow,et al.  Modeling the Severity of Illness of ICU Patients , 2001 .

[2]  J Dudeck,et al.  Design principles of a clinical information system for intensive care units (ICUData). , 2000, Studies in health technology and informatics.

[3]  M M Shabot,et al.  Automatic extraction of intensity-intervention scores from a computerized surgical intensive care unit flowsheet. , 1987, American journal of surgery.

[4]  L. Murray,et al.  Revisiting the Glasgow Coma Scale and Coma Score , 2000, Intensive Care Medicine.

[5]  D. E. M. Taylor,et al.  Reliability of human and machine measurements in patient monitoring , 2004, European journal of intensive care medicine.

[6]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[7]  C A Bodian,et al.  Arterial Blood Pressure and Heart Rate Discrepancies Between Handwritten and Computerized Anesthesia Records , 2000, Anesthesia and analgesia.

[8]  M. Suistomaa,et al.  Sampling rate causes bias in APACHE II and SAPS II scores , 2000, Intensive Care Medicine.

[9]  S. Lemeshow,et al.  Modeling the severity of illness of ICU patients. A systems update. , 1994, JAMA.

[10]  M Kleen,et al.  [The alveolar gas equation]. , 2000, Der Anaesthesist.

[11]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[12]  K Taeger,et al.  [Comparison of APACHE-II AND APACHE-III for classification of disease severity of intensive care patients]. , 1995, Der Anaesthesist.

[13]  Carsten Fuchs,et al.  Clinical and practical requirements of online software for anesthesia documentation - an experience report , 2000, Int. J. Medical Informatics.

[14]  T. Scholten,et al.  Comparison of Acute Physiology and Chronic Health Evaluations II and III and Simplified Acute Physiology Score II: A prospective cohort study evaluating these methods to predict outcome in a German interdisciplinary intensive care unit , 2000, Critical care medicine.

[15]  J. L. Gall,et al.  APACHE II--a severity of disease classification system. , 1986, Critical care medicine.

[16]  Th. Bein,et al.  Vergleich von APACHE-II und APACHE-III zur Einschätzung der Erkrankungsschwere von Intensivpatienten , 1995, Der Anaesthesist.

[17]  K. Polderman,et al.  Intra-observer variability in APACHE II scoring , 2001, Intensive Care Medicine.

[18]  J. le Gall,et al.  Modeling the severity of illness of ICU patients. , 2001, European journal of internal medicine.

[19]  P J Haug,et al.  HELP the next generation: a new client-server architecture. , 1994, Proceedings. Symposium on Computer Applications in Medical Care.

[20]  K. Polderman,et al.  Inter-observer variability in APACHE II scoring: effect of strict guidelines and training , 2001, Intensive Care Medicine.

[21]  D. Cho,et al.  Comparison of the APACHE III, APACHE II and Glasgow Coma Scale in acute head injury for prediction of mortality and functional outcome , 1997, Intensive Care Medicine.

[22]  W J Sibbald,et al.  Interobserver variability in data collection of the APACHE II score in teaching and community hospitals. , 1999, Critical care medicine.