Validity of Information on Comorbidity Derived From ICD-9-CCM Administrative Data

Background. The comorbidity variables that constitute the Charlson index are widely used in health care research using administrative data. However, little is known about the validity of administrative data in these comorbidities. The agreement between administrative hospital discharge data and chart data for the recording of information on comorbidity was evaluated. The predictive ability of comorbidity information in the two data sets for predicting in-hospital mortality was also compared. Methods. One thousand two hundred administrative hospital discharge records were randomly selected in the region of Calgary, Alberta, Canada in 1996 and used a published coding algorithm to define the 17 comorbidities that constitute the Charlson index. Corresponding patient charts for the selected records were reviewed as the “criterion standard” against which validity of the administrative data were judged. Results. Compared with the chart data, administrative data had a lower prevalence in 10 comorbidities, a higher prevalence in 3 and a similar prevalence in 4. The &kgr; values ranged from a high of 0.87 to a low of 0.34; agreement was therefore near perfect for one variable, substantial for six, moderate for nine, and only fair for one variable. For the Charlson index score ranging from 0 to 5 to 6 or higher, agreement was moderate to substantial (&kgr; = 0.56, weighted &kgr; = 0.71). When 16 Charlson comorbidities from administrative data were used to predict in-hospital mortality, 10 comorbidities and the index scores defined using administrative data yielded odds ratios that were similar to those derived from chart data. The remaining six comorbidities yielded odds ratios that were quite different from those derived from chart data. Conclusions. Administrative data generally agree with patient chart data for recording of comorbidities although comorbidities tend to be under-reported in administrative data. The ability to predict in-hospital mortality is less reliable for some of the individual comorbidities than it is for the summarized Charlson index scores in administrative data.

[1]  E. Wagner,et al.  The use of automated data to identify complications and comorbidities of diabetes: a validation study. , 1999, Journal of clinical epidemiology.

[2]  Jesse Green,et al.  How Accurate are Hospital Discharge Data for Evaluating Effectiveness of Care? , 1993, Medical care.

[3]  C M Ashton,et al.  International Classification of Diseases, 9th Revision, Clinical Modification codes in discharge abstracts are poor measures of complication occurrence in medical inpatients. , 1997, Medical care.

[4]  R. Kravitz,et al.  Measuring underuse of necessary care among elderly Medicare beneficiaries using inpatient and outpatient claims. , 2000, JAMA.

[5]  J P Rissing,et al.  Physician and coding errors in patient records. , 1985, JAMA.

[6]  L I Iezzoni,et al.  Coding of acute myocardial infarction. Clinical and policy implications. , 1988, Annals of internal medicine.

[7]  G. Cooper,et al.  Severity-Adjusted Mortality and Length of Stay in Teaching and Nonteaching Hospitals: Results of a Regional Study , 1997 .

[8]  J. Rumsfeld,et al.  Relation between hospital primary angioplasty volume and mortality for patients with acute MI treated with primary angioplasty vs thrombolytic therapy. , 2000, JAMA.

[9]  L. G. García Rodríguez,et al.  Positive Predictive Value of ICD‐9 Codes in the Identification of Cases of Complicated Peptic Ulcer Disease in the Saskatchewan Hospital Automated Database , 1996, Epidemiology.

[10]  E. Hannan,et al.  Using Medicare claims data to assess provider quality for CABG surgery: does it work well enough? , 1997, Health services research.

[11]  E. Fisher,et al.  The accuracy of Medicare's hospital claims data: progress has been made, but problems remain. , 1992, American journal of public health.

[12]  P Diehr,et al.  Analysis of Automated Administrative and Survey Databases to Study Patterns and Outcomes of Care , 1994, Spine.

[13]  R E Hall,et al.  Searching for an improved clinical comorbidity index for use with ICD-9-CM administrative data. , 1996, Journal of clinical epidemiology.

[14]  A S Kosinski,et al.  A comparison of the Charlson comorbidity index derived from medical record data and administrative billing data. , 1999, Journal of clinical epidemiology.

[15]  L I Iezzoni,et al.  Identification of in-hospital complications from claims data. Is it valid? , 2000, Medical care.

[16]  D. Mark,et al.  Bias in the coding of hospital discharge data and its implications for quality assessment. , 1994, Medical care.

[17]  D McLerran,et al.  Using administrative data to describe casemix: a comparison with the medical record. , 1994, Journal of clinical epidemiology.

[18]  N. Rawson,et al.  Reliability of the recording of hysterectomy in the Saskatchewan health care system , 1996, British journal of obstetrics and gynaecology.

[19]  M. Cleves,et al.  Evaluation of two competing methods for calculating Charlson's comorbidity index when analyzing short-term mortality using administrative data. , 1997, Journal of clinical epidemiology.

[20]  C. Begg,et al.  Influence of hospital procedure volume on outcomes following surgery for colon cancer. , 2000, JAMA.

[21]  N S Rawson,et al.  Validity of the recording of ischaemic heart disease and chronic obstructive pulmonary disease in the Saskatchewan health care datafiles. , 1995, Statistics in medicine.

[22]  G. Cooper,et al.  Severity-adjusted mortality and length of stay in teaching and nonteaching hospitals. Results of a regional study. , 1998, JAMA.

[23]  L. Muhlbaier,et al.  Using Medicare Claims for Outcomes Research , 1994, Medical care.

[24]  W. M. Krushat,et al.  Accuracy of diagnostic coding for Medicare patients under the prospective-payment system. , 1988, The New England journal of medicine.

[25]  J. Spinelli,et al.  Co-morbidity data in outcomes research: are clinical data derived from administrative databases a reliable alternative to chart review? , 2000, Journal of clinical epidemiology.

[26]  C. Mackenzie,et al.  A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. , 1987, Journal of chronic diseases.

[27]  L. Iezzoni.  Assessing Quality Using Administrative Data , 1997, Annals of Internal Medicine.

[28]  R. Deyo,et al.  Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. , 1992, Journal of clinical epidemiology.

[29]  A R Levy,et al.  Coding accuracy of hospital discharge data for elderly survivors of myocardial infarction. , 1999, The Canadian journal of cardiology.

[30]  L I Iezzoni,et al.  Does clinical evidence support ICD-9-CM diagnosis coding of complications? , 2000, Medical care.

[31]  D. May,et al.  Surveillance of major causes of hospitalization among the elderly, 1988. , 1991, MMWR. CDC surveillance summaries : Morbidity and mortality weekly report. CDC surveillance summaries.

[32]  C. Bombardier,et al.  Validity of rheumatoid arthritis diagnoses listed in the Saskatchewan Hospital Separations Database. , 1993, Journal of clinical epidemiology.

[33]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[34]  J. Jollis,et al.  Adapting a clinical comorbidity index for use with ICD-9-CM administrative data: differing perspectives. , 1993, Journal of clinical epidemiology.

[35]  W. M. Krushat,et al.  Medicare reimbursement accuracy under the prospective payment system, 1985 to 1988. , 1992, JAMA.

[36]  E. DeLong,et al.  Discordance of Databases Designed for Claims Payment versus Clinical Information Systems: Implications for Outcomes Research , 1993, Annals of Internal Medicine.

[37]  L I Iezzoni,et al.  Use of administrative data to find substandard care: validation of the complications screening program. , 2000, Medical care.

[38]  E P Steinberg,et al.  Accuracy of Medicare Claims Data for Estimation of Cancer Incidence and Resection Rates Among Elderly Americans , 1991, Medical care.