Comparison of the Performance of Two Comorbidity Measures, With and Without Information From Prior Hospitalizations

Objectives.This study compares the performance of two comorbidity risk adjustment methods (the Deyo et al adaptation of the Charlson index and the Elixhauser et al method) in five groups of California hospital patients with common reasons for hospitalization, and assesses the contribution to model performance made by information drawn from prior hospital admissions. Methods.California hospital discharge abstract data for the calendar years 1994 through 1997 were used to create a longitudinal data set for patients in the five disease groups. Eleven logistic regression models were estimated to predict the risk of in-hospital death for patients in each group, with both comorbidity risk adjustment methods applied to patient information available from only the index hospitalization, and to information available from both the index and prior hospitalizations. Results.For every comparison made, the level of statistical performance (area under the receiver operating characteristics curve) demonstrated by models using the Elixhauser et al method was superior to that of models using the Deyo et al adaptation method. Although most patients have information available from prior hospital admissions, this additional information yields only small improvements in the performance of models using either comorbidity risk adjustment method. Conclusions.Better discrimination is achieved with the Elixhauser et al method using only information from the index hospitalization than is achieved with the Deyo et al adaptation using information from all identified hospital admissions. Both comorbidity risk adjustment methods achieve their best performance when information from the index hospitalization and prior admissions is separated into independent indicators of comorbid illness.

[1]  J. Jollis,et al.  Adapting a clinical comorbidity index for use with ICD-9-CM administrative data: differing perspectives. , 1993, Journal of clinical epidemiology.

[2]  D. Mark,et al.  Bias in the coding of hospital discharge data and its implications for quality assessment. , 1994, Medical care.

[3]  D. K. Williams,et al.  Assessing hospital-associated deaths from discharge data. The role of length of stay and comorbidities. , 1988, JAMA.

[4]  J. Avorn,et al.  Strategies for improving comorbidity measures based on Medicare and Medicaid claims data. , 2000, Journal of clinical epidemiology.

[5]  M. Cleves,et al.  Evaluation of two competing methods for calculating Charlson's comorbidity index when analyzing short-term mortality using administrative data. , 1997, Journal of clinical epidemiology.

[6]  C. Mackenzie,et al.  A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. , 1987, Journal of chronic diseases.

[7]  F. Harrell,et al.  Prognostic/Clinical Prediction Models: Multivariable Prognostic Models: Issues in Developing Models, Evaluating Assumptions and Adequacy, and Measuring and Reducing Errors , 2005 .

[8]  R E Hall,et al.  Searching for an improved clinical comorbidity index for use with ICD-9-CM administrative data. , 1996, Journal of clinical epidemiology.

[9]  N. Christakis,et al.  The performance of different lookback periods and sources of information for Charlson comorbidity adjustment in Medicare claims. , 1999, Medical care.

[10]  C. Tilquin,et al.  Risk Adjustment in Outcome Assessment: the Charlson Comorbidity Index , 1993, Methods of Information in Medicine.

[11]  A. Feinstein,et al.  The importance of classifying initial co-morbidity in evaluating the outcome of diabetes mellitus. , 1974, Journal of chronic diseases.

[12]  E. Fisher,et al.  Comorbidities, complications, and coding bias. Does the number of diagnosis codes matter in predicting in-hospital mortality? , 1992, JAMA.

[13]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[14]  C. Steiner,et al.  Comorbidity measures for use with administrative data. , 1998, Medical care.

[15]  Daniel B. Mark,et al.  TUTORIAL IN BIOSTATISTICS MULTIVARIABLE PROGNOSTIC MODELS: ISSUES IN DEVELOPING MODELS, EVALUATING ASSUMPTIONS AND ADEQUACY, AND MEASURING AND REDUCING ERRORS , 1996 .

[16]  J. Allison Risk adjustment for measuring health care outcomes , 1996 .

[17]  S. Hansson Dimensions of Risk , 1989 .

[18]  J. Jollis,et al.  Further evidence concerning the use of a clinical comorbidity index with ICD-9-CM administrative data , 1993 .

[19]  R. Elashoff,et al.  Flaws in mortality data. The hazards of ignoring comorbid disease. , 1988, JAMA.

[20]  L I Iezzoni,et al.  The importance of comorbidities in explaining differences in patient costs. , 1996, Medical care.

[21]  F. Harrell Regression coefficients and scoring rules. , 1996, Journal of clinical epidemiology.

[22]  R. Deyo,et al.  Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. , 1992, Journal of clinical epidemiology.

[23]  A Bouckaert,et al.  Practical considerations on the use of the Charlson comorbidity index with administrative data bases. , 1996, Journal of clinical epidemiology.

[24]  H. Akaike A new look at the statistical model identification , 1974 .