Economic evaluation in implementation science: Making the business case for implementation strategies

Implementation researchers have made notable progress in developing and testing implementation strategies (i.e., highly-specified methods used to help providers improve uptake of mental health evidence-based practices: EBPs). Yet, implementation strategies are not widely applied in healthcare organizations to improve delivery of EBPs. Economic considerations are a key factor influencing the use of implementation strategies to deliver and sustain mental health evidence-based practices, in part because many health care leaders are reluctant to invest in ongoing implementation strategy support without knowing the return-on-investment. Comparative economic evaluation of implementation strategies provides critical information for payers, policymakers, and providers to make informed decisions if specific strategies are an efficient use of scarce organizational resources. Currently, few implementation studies include implementation cost data and even fewer conduct comparative economic analyses of implementation strategies. This summary will introduce clinicians, researchers and other health professionals to the economic evaluation in implementation science. We provide an overview of different economic evaluation methods, discuss differences between economic evaluation in health services and implementation science. We also highlight approaches and frameworks to guide economic evaluation of implementation, provide an example for a cognitive-behavioral therapy program and discuss recommendations.

[1]  Jason M. Lang,et al.  Costs to Community Mental Health Agencies to Sustain an Evidence-Based Practice. , 2017, Psychiatric services.

[2]  J. Lave,et al.  Cost-effectiveness of treatments for major depression in primary care practice. , 1998, Archives of general psychiatry.

[3]  A. Kilbourne,et al.  Adaptive School-based Implementation of CBT (ASIC): clustered-SMART for building an optimized adaptive implementation intervention to improve uptake of mental health interventions in schools , 2018, Implementation Science.

[4]  Mairi Pearson,et al.  Development of the Framework , 2011 .

[5]  T. Bärnighausen,et al.  Implementation science in resource-poor countries and communities , 2018, Implementation Science.

[6]  Alistair Munro,et al.  A Guide to Treatments That Work. , 2000 .

[7]  M. Gold.  Cost-effectiveness in health and medicine , 2016 .

[8]  Cara C. Lewis,et al.  Enhancing the Impact of Implementation Strategies in Healthcare: A Research Agenda , 2019, Front. Public Health.

[9]  A. Kilbourne,et al.  An introduction to implementation science for the non-specialist , 2015, BMC psychology.

[10]  M. Weinstein,et al.  The role of cost-effectiveness analysis in health and medicine. Panel on Cost-Effectiveness in Health and Medicine. , 1996, JAMA.

[11]  A. Rothberg.  Making Choices in Health: WHO Guide to Cost Effectiveness Analysis , 2008 .

[12]  M. Drummond,et al.  Health Care Technology: Effectiveness, Efficiency and Public Policy@@@Methods for the Economic Evaluation of Health Care Programmes , 1988 .

[13]  Alex R. Dopp,et al.  Economic Impact of the Statewide Implementation of an Evidence-Based Treatment: Multisystemic Therapy in New Mexico. , 2017, Behavior therapy.

[14]  S. Bailey,et al.  Children and adolescents. , 2004, Criminal behaviour and mental health : CBMH.

[15]  G. Sanders,et al.  Cost-Effectiveness in Health and Medicine , 2016 .

[16]  J. Fairbank,et al.  Use of the Breakthrough Series Collaborative to Support Broad and Sustained Use of Evidence-Based Trauma Treatment for Children in Community Practice Settings , 2012, Administration and Policy in Mental Health and Mental Health Services Research.

[17]  Alison E. Peterson,et al.  Long-Term Sustainability of Evidence-Based Practices in Community Mental Health Agencies , 2014, Administration and Policy in Mental Health and Mental Health Services Research.

[18]  Enola K Proctor,et al.  Implementation strategies: recommendations for specifying and reporting , 2013, Implementation Science.

[19]  Lisa V Rubenstein,et al.  Organizational cost of quality improvement for depression care. , 2009, Health services research.

[20]  Judith Cohen,et al.  Treating Trauma and Traumatic Grief in Children and Adolescents , 2006 .

[21]  Jennifer Duffy,et al.  Bridging the Gap Between Prevention Research and Practice: The Interactive Systems Framework for Dissemination and Implementation , 2008, American journal of community psychology.

[22]  Ross C. Brownson,et al.  Dissemination and implementation research in health : translating science to practice , 2012 .

[23]  Alex R. Dopp,et al.  Mixed-method approaches to strengthen economic evaluations in implementation research , 2019, Implementation Science.

[24]  T. Wagner,et al.  If substance use disorder treatment more than offsets its costs, why don't more medical centers want to provide it? A budget impact analysis in the Veterans Health Administration. , 2011, Journal of substance abuse treatment.

[25]  Alex R. Dopp,et al.  Community-Based Implementation of Trauma-Focused Interventions for Youth: Economic Impact of the Learning Collaborative Model , 2017, Psychological services.

[26]  T. Trikalinos,et al.  Recommendations for Conduct, Methodological Practices, and Reporting of Cost-effectiveness Analyses: Second Panel on Cost-Effectiveness in Health and Medicine. , 2016, JAMA.

[27]  J. Grimshaw,et al.  Systematic review of economic evaluations and cost analyses of guideline implementation strategies , 2007, The European Journal of Health Economics.

[28]  Ties Hoomans,et al.  Economic evaluation of implementation strategies in health care , 2014, Implementation Science.

[29]  Mark Nuijten,et al.  Principles of good practice for budget impact analysis: report of the ISPOR Task Force on good research practices--budget impact analysis. , 2007, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[30]  Caitlin N. Dorsey,et al.  A content analysis of dissemination and implementation science resource initiatives: what types of resources do they offer to advance the field? , 2017, Implementation Science.

[31]  Lisa Saldana,et al.  Observational measure of implementation progress in community based settings: The Stages of implementation completion (SIC) , 2011, Implementation science : IS.

[32]  John Landsverk,et al.  The Cost of Implementing New Strategies (COINS): A Method for Mapping Implementation Resources Using the Stages of Implementation Completion. , 2014, Children and youth services review.

[33]  Russell E Glasgow,et al.  Costing Behavioral Interventions: A Practical Guide to Enhance Translation , 2009, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[34]  B. Cuthbert,et al.  Reenvisioning Clinical Science , 2014, Clinical psychological science : a journal of the Association for Psychological Science.

[35]  S. Leatherman,et al.  Integrating microfinance and health strategies: examining the evidence to inform policy and practice. , 2012, Health policy and planning.

[36]  G. Aarons,et al.  Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[37]  J. Lowery,et al.  Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science , 2009, Implementation science : IS.

[38]  P. Kendall,et al.  Training Therapists in Evidence-Based Practice: A Critical Review of Studies From a Systems-Contextual Perspective. , 2010, Clinical psychology : a publication of the Division of Clinical Psychology of the American Psychological Association.

[39]  Peter Muennig,et al.  Cost-effectiveness analyses in health : a practical approach , 2008 .

[40]  S. Cellini,et al.  Cost-effectiveness and cost-benefit analysis. , 2015, The Genetic resource.

[41]  M. Eccles,et al.  Welcome to Implementation Science , 2006, Implementation Science.

[42]  Martha A. Starr.  Qualitative and Mixed‐Methods Research in Economics: Surprising Growth, Promising Future , 2014 .

[43]  Linda Shields,et al.  Content Analysis , 2015 .

[44]  R. Raghavan.  The role of economic evaluation in dissemination and implementation research , 2012 .

[45]  Shannon Wiltsey Stirman,et al.  Development of a framework and coding system for modifications and adaptations of evidence-based interventions , 2013, Implementation Science.

[46]  P. Reeves,et al.  Economic evaluations of public health implementation-interventions: a systematic review and guideline for practice. , 2019, Public health.

[47]  R. Ong,et al.  Mixed-methods research: What’s in it for economists? , 2014 .

[48]  Alicia C. Bunger,et al.  Outcomes for Implementation Research: Conceptual Distinctions, Measurement Challenges, and Research Agenda , 2010, Administration and Policy in Mental Health and Mental Health Services Research.