American Journal of Epidemiology Practice of Epidemiology Updating and Validating the Charlson Comorbidity Index and Score for Risk Adjustment in Hospital Discharge Abstracts Using Data from 6 Countries

With advances in the effectiveness of treatment and disease management, the contribution of chronic comorbid diseases (comorbidities) found within the Charlson comorbidity index to mortality is likely to have changed since development of the index in 1984. The authors reevaluated the Charlson index and reassigned weights to each condition by identifying and following patients to observe mortality within 1 year after hospital discharge. They applied the updated index and weights to hospital discharge data from 6 countries and tested for their ability to predict in-hospital mortality. Compared with the original Charlson weights, weights generated from the Calgary, Alberta, Canada, data (2004) were 0 for 5 comorbidities, decreased for 3 comorbidities, increased for 4 comorbid-ities, and did not change for 5 comorbidities. The C statistics for discriminating in-hospital mortality between the new score generated from the 12 comorbidities and the Charlson score were 0.825 (new) and 0. The updated index of 12 comorbidities showed good-to-excellent discrimination in predicting in-hospital mortality in data from 6 countries and may be more appropriate for use with more recent administrative data. The Charlson comorbidity index (1), a method of predicting mortality by classifying or weighting comorbid conditions (comorbidities), has been widely utilized by health researchers to measure burden of disease and case mix. Since the publication of Charlson et al.'s original article in 1987 (1), the paper has been cited nearly 5,500 times, and the index has been validated for its ability to predict mortality in various disease subgroups, including cancer, renal disease, stroke, intensive care, and liver disease (2–8). These studies consistently demonstrate that the Charlson index is a valid prognostic indicator for mortality. In 1984, Charlson et al. defined the clinical conditions to be included in the index after a review of 559 hospital charts for patients admitted to medical services at 1 hospital and then assessed the association of these comorbidities with 1-year all-cause mortality (1). Among many potential comor-bidity variables assessed, 17 were found to be associated with 1-year mortality. To measure disease burden, Charlson et al. assigned a weighted score to each comorbid condition based on the relative risk of 1-year mortality. After validating the index in breast cancer patients, Charlson et al. reported that the score as an indicator of disease burden had a strong ability to predict mortality (1). To apply the index in administrative hospital discharge data, Deyo et al. (9), Romano et al. (10), and D'Hoore …

[1]  P. Romano,et al.  Detection of postoperative respiratory failure: how predictive is the Agency for Healthcare Research and Quality's Patient Safety Indicator? , 2010, Journal of the American College of Surgeons.

[2]  H. Quan,et al.  Validating ICD coding algorithms for diabetes mellitus from administrative data. , 2010, Diabetes research and clinical practice.

[3]  Banafsheh Sadeghi,et al.  Evaluation of the predictive value of ICD-9-CM coded administrative data for venous thromboembolism in the United States. , 2010, Thrombosis research.

[4]  P. Romano,et al.  Cases of Iatrogenic Pneumothorax Can Be Identified From ICD-9-CM Coded Data , 2010, American journal of medical quality : the official journal of the American College of Medical Quality.

[5]  H. Quan,et al.  Epidemiology and natural history of primary biliary cirrhosis in a Canadian health region: A population‐based study , 2009, Hepatology.

[6]  Patrick S. Romano,et al.  How Valid is the ICD-9-CM Based AHRQ Patient Safety Indicator for Postoperative Venous Thromboembolism? , 2009, Medical care.

[7]  P. Romano,et al.  Positive Predictive Value of the AHRQ Accidental Puncture or Laceration Patient Safety Indicator , 2009, Annals of surgery.

[8]  Hude Quan,et al.  Validation of a Case Definition to Define Hypertension Using Administrative Data , 2009, Hypertension.

[9]  J R Hodges,et al.  Determinants of survival in behavioral variant frontotemporal dementia , 2009, Neurology.

[10]  Joshua Chodosh,et al.  Dementia and life expectancy: what do we know? , 2009, Journal of the American Medical Directors Association.

[11]  H. Quan,et al.  A comparison between the APACHE II and Charlson Index Score for predicting hospital mortality in critically ill patients , 2009, BMC health services research.

[12]  H. B. Lefton,et al.  Diagnosis and epidemiology of cirrhosis. , 2009, The Medical clinics of North America.

[13]  P. Austin,et al.  A Modification of the Elixhauser Comorbidity Measures Into a Point System for Hospital Death Using Administrative Data , 2009, Medical care.

[14]  Hude Quan,et al.  Predicting in‐hospital mortality in patients with cirrhosis: Results differ across risk adjustment methods , 2009, Hepatology.

[15]  C. Christiansen,et al.  Validity of selected AHRQ patient safety indicators based on VA National Surgical Quality Improvement Program data. , 2009, Health services research.

[16]  H. Quan,et al.  Assessing validity of ICD-9-CM and ICD-10 administrative data in recording clinical conditions in a unique dually coded database. , 2008, Health services research.

[17]  Hude Quan,et al.  Cross-National Comparative Performance of Three Versions of the ICD-10 Charlson Index , 2007, Medical care.

[18]  Karen Tu,et al.  Accuracy of administrative databases in identifying patients with hypertension , 2007, Open medicine : a peer-reviewed, independent, open-access journal.

[19]  N. Cook Use and Misuse of the Receiver Operating Characteristic Curve in Risk Prediction , 2007, Circulation.

[20]  D. Hoaglin,et al.  Enhancement of claims data to improve risk adjustment of hospital mortality. , 2007, JAMA.

[21]  W. Barlow,et al.  In Search of the Perfect Comorbidity Measure for Use With Administrative Claims Data: Does It Exist? , 2006, Medical care.

[22]  H. Quan,et al.  Assessing record linkage between health care and Vital Statistics databases using deterministic methods , 2006, BMC Health Services Research.

[23]  W. Gilbert,et al.  Accuracy of obstetric diagnoses and procedures in hospital discharge data. , 2006, American journal of obstetrics and gynecology.

[24]  H. Quan,et al.  Coding Algorithms for Defining Comorbidities in ICD-9-CM and ICD-10 Administrative Data , 2005, Medical care.

[25]  Michael D. Hill,et al.  Coding of Stroke and Stroke Risk Factors Using International Classification of Diseases, Revisions 9 and 10 , 2005, Stroke.

[26]  D. Meltzer,et al.  Use of a Self-Report-Generated Charlson Comorbidity Index for Predicting Mortality , 2005, Medical care.

[27]  J. Avorn,et al.  A review of uses of health care utilization databases for epidemiologic research on therapeutics. , 2005, Journal of clinical epidemiology.

[28]  Peter C Austin,et al.  Comparison of Coding of Heart Failure and Comorbidities in Administrative and Clinical Data for Use in Outcomes Research , 2005, Medical care.

[29]  David B Matchar,et al.  Charlson Index Comorbidity Adjustment for Ischemic Stroke Outcome Studies , 2004, Stroke.

[30]  Hude Quan,et al.  Adapting the Charlson Comorbidity Index for use in patients with ESRD. , 2003, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[31]  Hude Quan,et al.  Validity of Information on Comorbidity Derived From ICD-9-CCM Administrative Data , 2002, Medical care.

[32]  W. Ghali,et al.  Overview of the Alberta Provincial Project for Outcome Assessment in Coronary Heart Disease. On behalf of the APPROACH investigators. , 2000, The Canadian journal of cardiology.

[33]  J. Spinelli,et al.  Co-morbidity data in outcomes research: are clinical data derived from administrative databases a reliable alternative to chart review? , 2000, Journal of clinical epidemiology.

[34]  A R Levy,et al.  Coding accuracy of hospital discharge data for elderly survivors of myocardial infarction. , 1999, The Canadian journal of cardiology.

[35]  A S Kosinski,et al.  A comparison of the Charlson comorbidity index derived from medical record data and administrative billing data. , 1999, Journal of clinical epidemiology.

[36]  P. Duncan,et al.  Inaccuracy of the International Classification of Diseases (ICD-9-CM) in identifying the diagnosis of ischemic cerebrovascular disease , 1997, Neurology.

[37]  E. Hannan,et al.  Using Medicare claims data to assess provider quality for CABG surgery: does it work well enough? , 1997, Health services research.

[38]  A Bouckaert,et al.  Practical considerations on the use of the Charlson comorbidity index with administrative data bases. , 1996, Journal of clinical epidemiology.

[39]  R M Poses,et al.  Prediction of survival of critically ill patients by admission comorbidity. , 1996, Journal of clinical epidemiology.

[40]  L. G. García Rodríguez,et al.  Positive Predictive Value of ICD‐9 Codes in the Identification of Cases of Complicated Peptic Ulcer Disease in the Saskatchewan Hospital Automated Database , 1996, Epidemiology.

[41]  N S Rawson,et al.  Validity of the recording of ischaemic heart disease and chronic obstructive pulmonary disease in the Saskatchewan health care datafiles. , 1995, Statistics in medicine.

[42]  L. Iezzoni Risk adjustment for medical effectiveness research: an overview of conceptual and methodological considerations. , 1995, Journal of investigative medicine : the official publication of the American Federation for Clinical Research.

[43]  D McLerran,et al.  Using administrative data to describe casemix: a comparison with the medical record. , 1994, Journal of clinical epidemiology.

[44]  J. Jollis,et al.  Adapting a clinical comorbidity index for use with ICD-9-CM administrative data: differing perspectives. , 1993, Journal of clinical epidemiology.

[45]  C. Bombardier,et al.  Validity of rheumatoid arthritis diagnoses listed in the Saskatchewan Hospital Separations Database. , 1993, Journal of clinical epidemiology.

[46]  W. M. Krushat,et al.  Medicare reimbursement accuracy under the prospective payment system, 1985 to 1988. , 1992, JAMA.

[47]  R. Deyo,et al.  Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. , 1992, Journal of clinical epidemiology.

[48]  Hsia Dc,et al.  Accuracy of Diagnostic Coding for Medicare Patients under the Prospective-Payment System , 1988 .

[49]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[50]  R. Brant,et al.  Risk adjustment using administrative data: impact of a diagnosis-type indicator. , 2001, Journal of general internal medicine.

[51]  C. Steiner,et al.  Comorbidity measures for use with administrative data. , 1998, Medical care.

[52]  C. Mackenzie,et al.  A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. , 1987, Journal of chronic diseases.