A comparison of the abilities of nine scoring algorithms in predicting mortality.

OBJECTIVE The purpose of this study was to compare the abilities of nine Abbreviated Injury Scale (AIS)- and (ICD-9)-based scoring algorithms in predicting mortality. METHODS The scores collected on 76,871 incidents consist of four AIS-based algorithms (Injury Severity Score [ISS], New Injury Severity Score, Anatomic Profile Score [APS], and maximum AIS [maxAIS]), their four ICD to AIS mapped counterparts, and the ICD-9-based ISS (ICISS). A 10-fold cross-validation was performed and area under the receiver operating characteristic curve was used to determine algorithm discrimination. Hosmer-Lemeshow statistics were computed to gauge goodness-of-fit, and model refinement measured variance of predicted probabilities. RESULTS Overall, the ICISS has the best discrimination and model refinement, whereas the APS has the best Hosmer-Lemeshow performance. ICD-9 to AIS mapped scores have worse discrimination than their AIS-based counterparts, but still show moderate performance. CONCLUSION Differences in performance were relatively small. Complex scores such as the ICISS and the APS provide improvement in discrimination relative to the maxAIS and the ISS. Trauma registries should move to include the ICISS and the APS. The ISS and maxAIS perform moderately well and have bedside benefits.

[1]  S P Baker,et al.  A modification of the injury severity score that both improves accuracy and simplifies scoring. , 1997, The Journal of trauma.

[2]  D. Trunkey,et al.  Outcome of hospitalized injured patients after institution of a trauma system in an urban area. , 1994, JAMA.

[3]  D M Steinwachs,et al.  Evaluating performance of statewide regionalized systems of trauma care. , 1990, The Journal of trauma.

[4]  D M Steinwachs,et al.  Classifying Trauma Severity Based on Hospital Discharge Diagnoses: Validation of an ICD-9CM to AIS-85 Conversion Table , 1989, Medical care.

[5]  W. Haddon,et al.  The injury severity score: a method for describing patients with multiple injuries and evaluating emergency care. , 1974, The Journal of trauma.

[6]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[7]  E. Mackenzie,et al.  Comparison of alternative methods for assessing injury severity based on anatomic descriptors. , 1999, The Journal of trauma.

[8]  J. Hanley,et al.  A method of comparing the areas under receiver operating characteristic curves derived from the same cases. , 1983, Radiology.

[9]  T. Osler,et al.  Trauma registry injury coding is superfluous: a comparison of outcome prediction based on trauma registry International Classification of Diseases-Ninth Revision (ICD-9) and hospital information system ICD-9 codes. , 1997, The Journal of trauma.

[10]  C J McDonald,et al.  Validation of Probabilistic Predictions , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[11]  T Gennarelli,et al.  Progress in characterizing anatomic injury. , 1990, The Journal of trauma.

[12]  S. Baker,et al.  The injury severity score: an update. , 1976, The Journal of trauma.

[13]  T. Osler,et al.  ICISS: an international classification of disease-9 based injury severity score. , 1996, The Journal of trauma.