Using Diagnoses to Estimate Health Care Cost Risk in Canada

Supplemental Digital Content is available in the text. Objective: Until recently, the options for summarizing Canadian patient complexity were limited to health risk predictive modeling tools developed outside of Canada. This study aims to validate a new model created by the Canadian Institute for Health Information (CIHI) for Canada’s health care environment. Research Design: This was a cohort study. Subjects: The rolling population eligible for coverage under Ontario’s Universal Provincial Health Insurance Program in the fiscal years (FYs) 2006/2007–2016/2017 (12–13 million annually) comprised the subjects. Measures: To evaluate model performance, we compared predicted cost risk at the individual level, on the basis of diagnosis history, with estimates of actual patient-level cost using “out-of-the-box” cost weights created by running the CIHI software “as is.” We next considered whether performance could be improved by recalibrating the model weights, censoring outliers, or adding prior cost. Results: We were able to closely match model performance reported by CIHI for their 2010–2012 development sample (concurrent R2=48.0%; prospective R2=8.9%) and show that performance improved over time (concurrent R2=51.9%; prospective R2=9.7% in 2014–2016). Recalibrating the model did not substantively affect prospective period performance, even with the addition of prior cost and censoring of cost outliers. However, censoring substantively improved concurrent period explanatory power (from R2=53.6% to 66.7%). Conclusions: We validated the CIHI model for 2 periods, FYs 2010/2011–2012/2013 and FYs 2014/2015—2016/2017. Out-of-the-box model performance for Ontario was as good as that reported by CIHI for the development sample based on 3-province data (British Columbia, Alberta, and Ontario). We found that performance was robust to variations in model specification, data sources, and time.

[1]  D. Bates,et al.  Diagnosis-Based Risk Adjustment for Medicare Capitation Payments , 1996, Health care financing review.

[2]  R. Moineddin,et al.  Risk Adjustment Using Administrative Data-Based and Survey-Derived Methods for Explaining Physician Utilization , 2010, Medical care.

[3]  R. Kronick,et al.  Measuring coding intensity in the Medicare Advantage program. , 2014, Medicare & medicaid research review.

[4]  S. Walter,et al.  Needs-based primary medical care capitation: Development and evaluation of alternative approaches , 2000, Health care management science.

[5]  Saad Rais,et al.  Predicting patients with high risk of becoming high-cost healthcare users in Ontario (Canada). , 2014, Healthcare policy = Politiques de sante.

[6]  Willard G. Manning,et al.  Adjusting capitation rates using objective health measures and prior utilization , 1989, Health care financing review.

[7]  Carl van Walraven,et al.  Using the Johns Hopkins Aggregated Diagnosis Groups (ADGs) to Predict Mortality in a General Adult Population Cohort in Ontario, Canada , 2011, Medical care.

[8]  A. Burns.  Effects of Medicare Advantage Enrollment on Beneficiary Risk Scores , 2015 .

[9]  L. Einav,et al.  NBER WORKING PAPER SERIES UPCODING: EVIDENCE FROM MEDICARE ON SQUISHY RISK ADJUSTMENT , 2015 .

[10]  Walter P. Wodchis,et al.  Guidelines on Person-Level Costing Using Administrative Databases in Ontario , 2013 .

[11]  D. Bates,et al.  Using Diagnoses to Describe Populations and Predict Costs , 2000, Health care financing review.

[12]  J. Wasem,et al.  The new risk adjustment formula in Germany: implementation and first experiences. , 2013, Health policy.

[13]  Randall P. Ellis,et al.  Diagnostic cost group hierarchical condition category models for medicare risk adjustment , 2000 .

[14]  N. Roos,et al.  Performance of the ACG Case-Mix System in Two Canadian Provinces , 2001, Medical care.