The importance of health insurance claims data in creating learning health systems: evaluating care for high-need high-cost patients using the National Patient-Centered Clinical Research Network (PCORNet)

OBJECTIVE Case management programs for high-need high-cost patients are spreading rapidly among health systems. PCORNet has substantial potential to support learning health systems in rapidly evaluating these programs, but access to complete patient data on health care utilization is limited as PCORNet is based on electronic health records not health insurance claims data. Because matching cases to comparison patients on baseline utilization is often a critical component of high-quality observational comparative effectiveness research for high-need high-cost patients, limited access to claims may negatively affect the quality of the matching process. We sought to determine whether the evaluation of programs for high-need high-cost patients required claims data to match cases to comparison patients. MATERIALS AND METHODS A retrospective cohort study design with multiple measures of before-and-after health care utilization for 1935 case management patients and 3833 matched comparison patients aged 18 years and older from 2011 to 2015. EHR and claims data were extracted from 3 health systems participating in PCORNet. RESULTS Without matching on claims-based health care utilization, the case management programs at 2 of 3 health systems were associated with fewer hospital admissions and emergency visits over the subsequent 12 months. With matching on claims-based health care utilization, case management was no longer associated with admissions and emergency visits at those 2 programs. DISCUSSION The results of a PCORNet-facilitated evaluation of 3 programs for high-need high-cost patients differed substantially depending on whether claims data were available for matching cases to comparison patients. CONCLUSIONS Partnering with learning health systems to rapidly evaluate programs for high-need high-cost patients will require that PCORNet facilitates comprehensive and timely access to both electronic health records and health insurance claims data.

[1]  Gerald F Riley,et al.  Administrative and Claims Records as Sources of Health Care Cost Data , 2009, Medical care.

[2]  Elizabeth A Stuart,et al.  Prognostic score-based balance measures can be a useful diagnostic for propensity score methods in comparative effectiveness research. , 2013, Journal of clinical epidemiology.

[3]  Abhi Shelat,et al.  One‐to‐many propensity score matching in cohort studies , 2012, Pharmacoepidemiology and drug safety.

[4]  Matthew L Maciejewski,et al.  Approaches to Comparative Effectiveness Research in Multimorbid Populations , 2014, Medical care.

[5]  C. Knai,et al.  Reported barriers to evaluation in chronic care: experiences in six European countries. , 2013, Health policy.

[6]  L. Etheredge,et al.  A rapid-learning health system. , 2007, Health affairs.

[7]  Lisa I. Iezzoni,et al.  Risk Adjustment of Medicare Capitation Payments Using the CMS-HCC Model , 2004, Health care financing review.

[8]  T. Bodenheimer,et al.  Care management of patients with complex health care needs. , 2009, The Synthesis project. Research synthesis report.

[9]  Stephen B. Soumerai,et al.  Missing clinical and behavioral health data in a large electronic health record (EHR) system , 2016, J. Am. Medical Informatics Assoc..

[10]  Terry Fulmer,et al.  Caring for High-Need, High-Cost Patients - An Urgent Priority. , 2016, The New England journal of medicine.

[11]  George Hripcsak,et al.  Caveats for the use of operational electronic health record data in comparative effectiveness research. , 2013, Medical care.

[12]  J. Grimshaw,et al.  Research designs for studies evaluating the effectiveness of change and improvement strategies , 2003, Quality & safety in health care.

[13]  A. Hung,et al.  The role of matching when adjusting for baseline differences in the outcome variable of comparative effectiveness studies. , 2015, Journal of comparative effectiveness research.

[14]  J. Grefenstette,et al.  A systematic review of barriers to data sharing in public health , 2014, BMC Public Health.

[15]  Petra Kaufmann,et al.  Transforming Evidence Generation to Support Health and Health Care Decisions. , 2016, The New England journal of medicine.

[16]  E. McGlynn,et al.  Building Data Infrastructure to Evaluate and Improve Quality: PCORnet. , 2015, Journal of oncology practice.

[17]  C. Steiner,et al.  Comorbidity measures for use with administrative data. , 1998, Medical care.

[18]  Maureen A. Smith,et al.  Variability in Care Management Programs in Medicare ACOs: A Survey of Medical Directors , 2018, Journal of general internal medicine.

[19]  B. Leff,et al.  Attributes common to programs that successfully treat high-need, high-cost individuals. , 2015, The American journal of managed care.

[20]  S. Rimm-Kaufman,et al.  Using Indices of Fidelity to Intervention Core Components to Identify Program Active Ingredients , 2015 .

[21]  C. Hudon,et al.  Key factors of case management interventions for frequent users of healthcare services: a thematic analysis review , 2017, BMJ Open.

[22]  C. Rutter,et al.  Are Publicly Funded Health Databases Geographically Detailed and Timely Enough to Support Patient-Centered Outcomes Research? , 2018, Journal of General Internal Medicine.

[23]  Ariel Linden,et al.  Evaluating health management programmes over time: application of propensity score-based weighting to longitudinal data. , 2010, Journal of evaluation in clinical practice.

[24]  Wanzhu Tu,et al.  Geriatric care management for low-income seniors: a randomized controlled trial. , 2007, JAMA.

[25]  Elizabeth A Stuart,et al.  Matching methods for causal inference: A review and a look forward. , 2010, Statistical science : a review journal of the Institute of Mathematical Statistics.

[26]  Ariel Linden Designing a Prospective Study When Randomization is Not Feasible , 2011, Evaluation & the health professions.

[27]  Kari Ferver,et al.  The use of claims data in healthcare research. , 2009 .

[28]  P. Williamson,et al.  Design and analysis of pilot studies: recommendations for good practice. , 2004, Journal of evaluation in clinical practice.

[29]  Matthew DeCamp,et al.  Medicare Shared Savings Program: public reporting and shared savings distributions. , 2015, The American journal of managed care.

[30]  George Hripcsak,et al.  Defining and measuring completeness of electronic health records for secondary use , 2013, J. Biomed. Informatics.

[31]  Paul Jesilow,et al.  How Healthcare Studies Use Claims Data , 2011 .

[32]  Huseyin Naci,et al.  The critical role of observational evidence in comparative effectiveness research. , 2010, Health affairs.

[33]  P. Bower,et al.  Effectiveness of Case Management for 'At Risk' Patients in Primary Care: A Systematic Review and Meta-Analysis , 2015, PloS one.

[34]  S. Ramsey,et al.  A controlled time-series trial of clinical reminders: using computerized firm systems to make quality improvement research a routine part of mainstream practice. , 2000, Health services research.

[35]  Gary King,et al.  Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference , 2007, Political Analysis.