Comparison of the Predictive Validity of Diagnosis-Based Risk Adjusters for Clinical Outcomes

Objectives:Many possible methods of risk adjustment exist, but there is a dearth of comparative data on their performance. We compared the predictive validity of 2 widely used methods (Diagnostic Cost Groups [DCGs] and Adjusted Clinical Groups [ACGs]) for 2 clinical outcomes using a large national sample of patients. Methods:We studied all patients who used Veterans Health Administration (VA) medical services in fiscal year (FY) 2001 (n = 3,069,168) and assigned both a DCG and an ACG to each. We used logistic regression analyses to compare predictive ability for death or long-term care (LTC) hospitalization for age/gender models, DCG models, and ACG models. We also assessed the effect of adding age to the DCG and ACG models. Results:Patients in the highest DCG categories, indicating higher severity of illness, were more likely to die or to require LTC hospitalization. Surprisingly, the age/gender model predicted death slightly more accurately than the ACG model (c-statistic of 0.710 versus 0.700, respectively). The addition of age to the ACG model improved the c-statistic to 0.768. The highest c-statistic for prediction of death was obtained with a DCG/age model (0.830). The lowest c-statistics were obtained for age/gender models for LTC hospitalization (c-statistic 0.593). The c-statistic for use of ACGs to predict LTC hospitalization was 0.783, and improved to 0.792 with the addition of age. The c-statistics for use of DCGs and DCG/age to predict LTC hospitalization were 0.885 and 0.890, respectively, indicating the best prediction. Conclusions:We found that risk adjusters based upon diagnoses predicted an increased likelihood of death or LTC hospitalization, exhibiting good predictive validity. In this comparative analysis using VA data, DCG models were generally superior to ACG models in predicting clinical outcomes, although ACG model performance was enhanced by the addition of age.

[1]  B. McNeil,et al.  Outcome of myocardial infarction in Veterans Health Administration patients as compared with medicare patients. , 2000, The New England journal of medicine.

[2]  J. Lubitz,et al.  Trends in Medicare payments in the last year of life. , 1993, The New England journal of medicine.

[3]  Jonathan P. Weiner,et al.  Risk-Adjusted Medicare Capitation Rates Using Ambulatory and Inpatient Diagnoses , 1996, Health care financing review.

[4]  B Starfield,et al.  Ambulatory care groups: a categorization of diagnoses for research and management. , 1991, Health services research.

[5]  D. Bates,et al.  Paying more fairly for Medicare capitated care. , 1998, The New England journal of medicine.

[6]  D Geffner-Sclarsky,et al.  [Hospital care for stroke patients in the Valencian Region using the basic minimum data set from the International Classification of Diseases, 9th revision, clinical modification]. , 2006, Revista de neurologia.

[7]  D. Bates,et al.  Diagnosis-Based Risk Adjustment for Medicare Capitation Payments , 1996, Health care financing review.

[8]  J. Luck,et al.  How far down the managed care road? A comparison of primary care outpatient services in a Veterans Affairs medical center and a capitated multispecialty group practice. , 1998, Archives of internal medicine.

[9]  M. Ingber.  Implementation of Risk Adjustment for Medicare , 2000, Health care financing review.

[10]  L. Iezzoni.  Risk Adjustment for Measuring Healthcare Outcomes , 1994 .

[11]  Sunil J Rao,et al.  Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis , 2003 .

[12]  N. McCall.  Utilization and Costs of Medicare Services by Beneficiaries in Their Last Year of Life , 1984, Medical care.

[13]  H. Luft,et al.  The Best of Both Worlds?: Potential of Hybrid Prospective/Concurrent Risk Adjustment , 2003, Medical care.

[14]  K. Pietz,et al.  Physician-Level Variation in Practice Patterns in the VA Healthcare System , 2002, Health Services and Outcomes Research Methodology.

[15]  D. Berlowitz,et al.  Evaluating Diagnosis-Based Case-Mix Measures: How Well Do They Apply to the VA Population? , 2001, Medical care.

[16]  Charles Maynard,et al.  A primer and comparative review of major US mortality databases. , 2002, Annals of epidemiology.

[17]  A. Ash,et al.  Finding future high-cost cases: comparing prior cost versus diagnosis-based methods. , 2001, Health services research.

[18]  J. Stavins,et al.  Medicare use in the last ninety days of life. , 1992, Health services research.