Charlson comorbidity index derived from chart review or administrative data: agreement and prediction of mortality in intensive care patients

Purpose This study compared the Charlson comorbidity index (CCI) information derived from chart review and administrative systems to assess the completeness and agreement between scores, evaluate the capacity to predict 30-day and 1-year mortality in intensive care unit (ICU) patients, and compare the predictive capacity with that of the Simplified Acute Physiology Score (SAPS) II model. Patients and methods Using data from 959 patients admitted to a general ICU in a Norwegian university hospital from 2007 to 2009, we compared the CCI score derived from chart review and administrative systems. Agreement was assessed using % agreement, kappa, and weighted kappa. The capacity to predict 30-day and 1-year mortality was assessed using logistic regression, model discrimination with the c-statistic, and calibration with a goodness-of-fit statistic. Results The CCI was complete (n=959) when calculated from chart review, but less complete from administrative data (n=839). Agreement was good, with a weighted kappa of 0.667 (95% confidence interval: 0.596–0.714). The c-statistics for categorized CCI scores from charts and administrative data were similar in the model that included age, sex, and type of admission: 0.755 and 0.743 for 30-day mortality, respectively, and 0.783 and 0.775, respectively, for 1-year mortality. Goodness-of-fit statistics supported the model fit. Conclusion The CCI scores from chart review and administrative data showed good agreement and predicted 30-day and 1-year mortality in ICU patients. CCI combined with age, sex, and type of admission predicted mortality almost as well as the physiology-based SAPS II.

[1]  Robert G Uzzo,et al.  Why Summary Comorbidity Measures Such As the Charlson Comorbidity Index and Elixhauser Score Work , 2015, Medical care.

[2]  C. Steiner,et al.  Comorbidity measures for use with administrative data. , 1998, Medical care.

[3]  A S Kosinski,et al.  A comparison of the Charlson comorbidity index derived from medical record data and administrative billing data. , 1999, Journal of clinical epidemiology.

[4]  R. Deyo,et al.  Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. , 1992, Journal of clinical epidemiology.

[5]  Peter J Pronovost,et al.  A systematic review of the Charlson comorbidity index using Canadian administrative databases: a perspective on risk adjustment in critical care research. , 2005, Journal of critical care.

[6]  J. Spinelli,et al.  Co-morbidity data in outcomes research: are clinical data derived from administrative databases a reliable alternative to chart review? , 2000, Journal of clinical epidemiology.

[7]  D. Wagner,et al.  Impact of Different Measures of Comorbid Disease on Predicted Mortality of Intensive Care Unit Patients , 2002, Medical care.

[8]  P. Rochon,et al.  Interrater reliability of measurements of comorbid illness should be reported. , 2006, Journal of clinical epidemiology.

[9]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[10]  J. Finn,et al.  Combining multiple comorbidities with Acute Physiology Score to predict hospital mortality of critically ill patients: a linked data cohort study , 2007, Anaesthesia.

[11]  Alfred F. Connors,et al.  Comparison of the Performance of Two Comorbidity Measures, With and Without Information From Prior Hospitalizations , 2001, Medical care.

[12]  L. Bouter,et al.  How to measure comorbidity. a critical review of available methods. , 2003, Journal of clinical epidemiology.

[13]  A. Bottle,et al.  Systematic Review of Comorbidity Indices for Administrative Data , 2012, Medical care.

[14]  S. Lemeshow,et al.  Comparison of Charlson comorbidity index with SAPS and APACHE scores for prediction of mortality following intensive care , 2011, Clinical epidemiology.

[15]  S. Keenan,et al.  Adjustment of intensive care unit outcomes for severity of illness and comorbidity scores. , 2006, Journal of critical care.

[16]  Douglas G. Altman,et al.  Practical statistics for medical research , 1990 .

[17]  S. Lemeshow,et al.  A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. , 1993, JAMA.

[18]  Peter C Austin,et al.  Comparison of Coding of Heart Failure and Comorbidities in Administrative and Clinical Data for Use in Outcomes Research , 2005, Medical care.

[19]  Hude Quan,et al.  Comparison of the Elixhauser and Charlson/Deyo Methods of Comorbidity Measurement in Administrative Data , 2004, Medical care.

[20]  K. Stavem,et al.  Decisions to withhold or withdraw life‐sustaining treatment in a Norwegian intensive care unit , 2013, Acta anaesthesiologica Scandinavica.

[21]  E L Hannan,et al.  Clinical Versus Administrative Data Bases for CABG Surgery: Does it Matter , 1992, Medical care.

[22]  R M Poses,et al.  Prediction of survival of critically ill patients by admission comorbidity. , 1996, Journal of clinical epidemiology.

[23]  W. Knaus,et al.  The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. , 1991, Chest.

[24]  Bee Hoon Heng,et al.  A comparison of comorbidities obtained from hospital administrative data and medical charts in older patients with pneumonia , 2011, BMC health services research.

[25]  J. Finn,et al.  Changes in Case-Mix and Outcomes of Critically Ill Patients in an Australian Tertiary Intensive Care Unit , 2010, Anaesthesia and intensive care.

[26]  T. Kurth,et al.  The Deyo-Charlson and Elixhauser-van Walraven Comorbidity Indices as predictors of mortality in critically ill patients , 2015, BMJ Open.

[27]  H. Quan,et al.  Assessing validity of ICD-9-CM and ICD-10 administrative data in recording clinical conditions in a unique dually coded database. , 2008, Health services research.

[28]  C. Mackenzie,et al.  A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. , 1987, Journal of chronic diseases.

[29]  H. Quan,et al.  A comparison between the APACHE II and Charlson Index Score for predicting hospital mortality in critically ill patients , 2009, BMC health services research.

[30]  H. Quan,et al.  New ICD-10 version of the Charlson comorbidity index predicted in-hospital mortality. , 2004, Journal of clinical epidemiology.

[31]  W. Knaus,et al.  APACHE III study design: analytic plan for evaluation of severity and outcome in intensive care unit patients. Implications. , 1989, Critical care medicine.

[32]  Ashesh B Jani,et al.  An electronic application for rapidly calculating Charlson comorbidity score , 2004, BMC Cancer.

[33]  R E Hall,et al.  Searching for an improved clinical comorbidity index for use with ICD-9-CM administrative data. , 1996, Journal of clinical epidemiology.

[34]  H. Quan,et al.  Coding Algorithms for Defining Comorbidities in ICD-9-CM and ICD-10 Administrative Data , 2005, Medical care.

[35]  Bing Li,et al.  Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. , 2011, American journal of epidemiology.

[36]  Hugo Sax,et al.  Administrative data outperformed single-day chart review for comorbidity measure. , 2007, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[37]  R. Blais,et al.  Evaluation of comorbidity indices for inpatient mortality prediction models. , 2006, Journal of clinical epidemiology.