DECISION-MAKING ALIGNED WITH RAPID-CYCLE EVALUATION IN HEALTH CARE

Background: Availability of real-time electronic healthcare data provides new opportunities for rapid-cycle evaluation (RCE) of health technologies, including healthcare delivery and payment programs. We aim to align decision-making processes with stages of RCE to optimize the usefulness and impact of rapid results. Rational decisions about program adoption depend on program effect size in relation to externalities, including implementation cost, sustainability, and likelihood of broad adoption. Methods: Drawing on case studies and experience from drug safety monitoring, we examine how decision makers have used scientific evidence on complex interventions in the past. We clarify how RCE alters the nature of policy decisions; develop the RAPID framework for synchronizing decision-maker activities with stages of RCE; and provide guidelines on evidence thresholds for incremental decision-making. Results: In contrast to traditional evaluations, RCE provides early evidence on effectiveness and facilitates a stepped approach to decision making in expectation of future regularly updated evidence. RCE allows for identification of trends in adjusted effect size. It supports adapting a program in midstream in response to interim findings, or adapting the evaluation strategy to identify true improvements earlier. The 5-step RAPID approach that utilizes the cumulating evidence of program effectiveness over time could increase policy-makers' confidence in expediting decisions. Conclusions: RCE enables a step-wise approach to HTA decision-making, based on gradually emerging evidence, reducing delays in decision-making processes after traditional one-time evaluations.

[1]  W. J. Cooper,et al.  Kaiser-Permanente's Medicare Plus Project: A Successful Medicare Prospective Payment Demonstration , 1983, Health care financing review.

[2]  S. Schneeweiss.  Learning from big health care data. , 2014, The New England journal of medicine.

[3]  Judith A Racoosin,et al.  Utilizing Medicare claims data for real‐time drug safety evaluations: is it feasible? , , 2011, Pharmacoepidemiology and drug safety.

[4]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[5]  France Légaré,et al.  Health research funding agencies' support and promotion of knowledge translation: an international study. , 2008, The Milbank quarterly.

[6]  Sebastian Schneeweiss,et al.  Using high‐dimensional propensity scores to automate confounding control in a distributed medical product safety surveillance system , 2012, Pharmacoepidemiology and drug safety.

[7]  K J Rothman,et al.  No Adjustments Are Needed for Multiple Comparisons , 1990, Epidemiology.

[8]  Sander Greenland,et al.  Living with statistics in observational research. , 2013, Epidemiology.

[9]  J. Lurie,et al.  Beyond spinal manipulation: should Medicare expand coverage for chiropractic services? A review and commentary on the challenges for policy makers , 2013, Journal of chiropractic humanities.

[10]  R J Glynn,et al.  Assessing the Comparative Effectiveness of Newly Marketed Medications: Methodological Challenges and Implications for Drug Development , 2011, Clinical pharmacology and therapeutics.

[11]  Lonny Reisman,et al.  Full coverage for preventive medications after myocardial infarction. , 2011, The New England journal of medicine.

[12]  R. Willke,et al.  Treatment dynamics of newly marketed drugs and implications for comparative effectiveness research. , 2013, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[13]  K. Rothman.  Six Persistent Research Misconceptions , 2014, Journal of general internal medicine.

[14]  D. Meltzer,et al.  Toward a Science of Research Prioritization? The Use of Value of Information by Multidisciplinary Stakeholder Groups , 2013, Medical decision making : an international journal of the Society for Medical Decision Making.

[15]  Andrew Briggs,et al.  Performance-based risk-sharing arrangements-good practices for design, implementation, and evaluation: report of the ISPOR good practices for performance-based risk-sharing arrangements task force. , 2013, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[16]  Sebastian Schneeweiss,et al.  Managing drug-risk information--what to do with all those new numbers. , 2009, The New England journal of medicine.

[17]  Jun Liu,et al.  Near-Real-Time Monitoring of New Drugs: An Application Comparing Prasugrel Versus Clopidogrel , 2014, Drug Safety.

[18]  J. Rassen,et al.  A modular, prospective, semi‐automated drug safety monitoring system for use in a distributed data environment , 2014, Pharmacoepidemiology and drug safety.

[19]  Richard Platt,et al.  The U.S. Food and Drug Administration's Mini‐Sentinel program: status and direction , 2012, Pharmacoepidemiology and drug safety.

[20]  J. Rassen,et al.  Prospective Cohort Studies of Newly Marketed Medications: Using Covariate Data to Inform the Design of Large-Scale Studies , 2014, Epidemiology.

[21]  S. Ramsey,et al.  Evidence, economics, and emphysema: Medicare's long journey with lung volume reduction surgery. , 2005, Health affairs.

[22]  R. Chin.  Adaptive and Flexible Clinical Trials , 2011 .

[23]  L. Meckley,et al.  Risk-sharing arrangements that link payment for drugs to health outcomes are proving hard to implement. , 2011, Health affairs.

[24]  M. Weinstein,et al.  Sequential Value-of-Information Assessment for Prospective Drug Safety Monitoring Using Claims Databases , 2013, Medical decision making : an international journal of the Society for Medical Decision Making.

[25]  W. Shrank.  The Center For Medicare And Medicaid Innovation's blueprint for rapid-cycle evaluation of new care and payment models. , 2013, Health affairs.