Methods to Improve the Selection and Tailoring of Implementation Strategies

Implementing behavioral health interventions is a complicated process. It has been suggested that implementation strategies should be selected and tailored to address the contextual needs of a given change effort; however, there is limited guidance as to how to do this. This article proposes four methods (concept mapping, group model building, conjoint analysis, and intervention mapping) that could be used to match implementation strategies to identified barriers and facilitators for a particular evidence-based practice or process change being implemented in a given setting. Each method is reviewed, examples of their use are provided, and their strengths and weaknesses are discussed. The discussion includes suggestions for future research pertaining to implementation strategies and highlights these methods’ relevance to behavioral health services and research.

[1]  M. A. Scheirer.  Linking sustainability research to intervention types. , 2013, American journal of public health.

[2]  S. Reeves,et al.  Implementation Science BioMed Central Debate , 2005 .

[3]  Ross C. Brownson,et al.  Dissemination and implementation research in health : translating science to practice , 2012 .

[4]  David E. Goodrich,et al.  Enhanced fidelity to treatment for bipolar disorder: results from a randomized controlled implementation trial. , 2014, Psychiatric services.

[5]  L. K. Bartholomew,et al.  Intervention Mapping: A Process for Developing Theory and Evidence-Based Health Education Programs , 1998, Health education & behavior : the official publication of the Society for Public Health Education.

[6]  Guy Cafri,et al.  Expanding the Domains of Attitudes Towards Evidence-Based Practice: The Evidence Based Practice Attitude Scale-50 , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[7]  M. Eccles,et al.  Planning and Studying Improvement in Patient Care: The Use of Theoretical Perspectives , 2007, The Milbank quarterly.

[8]  E. Proctor,et al.  Writing implementation research grant proposals: ten key ingredients , 2012, Implementation Science.

[9]  Alicia C. Bunger,et al.  Outcomes for Implementation Research: Conceptual Distinctions, Measurement Challenges, and Research Agenda , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[10]  An implementation strategy to improve the guideline adherence of insurance physicians: an experiment in a controlled setting , 2013 .

[11]  C. Cunningham,et al.  Modeling the Mental Health Practice Change Preferences of Educators: A Discrete-Choice Conjoint Experiment , 2013, School Mental Health.

[12]  Jac A. M. Vennix,et al.  Group model building effectiveness: a review of assessment studies † , 2002 .

[13]  Brian S. Mittman,et al.  Implementation Science in Health Care , 2012 .

[14]  B. Orme.  Getting Started with Conjoint Analysis: Strategies for Product Design and Pricing Research , 2005 .

[15]  Brian Dangerfield,et al.  Complex systems in finance and econometrics , 2011 .

[16]  D. Chambers,et al.  Exploring the feasibility of Conjoint Analysis as a tool for prioritizing innovations for implementation , 2013, Implementation Science.

[17]  Simon Peck,et al.  Group Model Building: Facilitating Team Learning Using System Dynamics , 1996, J. Oper. Res. Soc..

[18]  G. Aarons,et al.  A comparison of policy and direct practice stakeholder perceptions of factors affecting evidence-based practice implementation using concept mapping , 2011, Implementation science : IS.

[19]  J. Kirchner,et al.  Expert recommendations for implementing change (ERIC): protocol for a mixed methods study , 2014, Implementation Science.

[20]  S. Flottorp,et al.  Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. , 2005, The Cochrane database of systematic reviews.

[21]  Maria E. Fernandez,et al.  Planning Health Promotion Programs: An Intervention Mapping Approach , 2006 .

[22]  D. Forbes,et al.  Using Predictive Models of Behavior Change to Promote Evidence-Based Treatment for PTSD , 2011 .

[23]  J. Grimshaw,et al.  Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the Theoretical Domains Framework , 2012, Implementation Science.

[24]  Cheri J. Shapiro,et al.  Facilitators and Barriers to Implementation of an Evidence-Based Parenting Intervention to Prevent Child Maltreatment , 2012, Child maltreatment.

[25]  R. Raghavan.  The role of economic evaluation in dissemination and implementation research , 2012 .

[26]  Etiënne A. J. A. Rouwette,et al.  Group Model Building , 2009, Encyclopedia of Complexity and Systems Science.

[27]  J. Grimshaw,et al.  Best strategies to implement clinical pathways in an emergency department setting: study protocol for a cluster randomized controlled trial , 2013, Implementation Science.

[28]  J. Sandars,et al.  Knowledge transfer for the management of dementia: a cluster-randomised trial of blended learning in general practice , 2010, Implementation science : IS.

[29]  Charles A. Rapp,et al.  Barriers to Evidence-Based Practice Implementation: Results of a Qualitative Study , 2010, Community Mental Health Journal.

[30]  Nicholas J. Cutforth,et al.  Adapted intervention mapping: a strategic planning process for increasing physical activity and healthy eating opportunities in schools via environment and policy change. , 2013, The Journal of school health.

[31]  A. J. van der Beek,et al.  Intervention mapping for the development of a strategy to implement the insurance medicine guidelines for depression , 2011, BMC public health.

[32]  G. Kok,et al.  Intervention Mapping - Designing Theory and Evidence-Based Health Promotion Programs , 2000 .

[33]  Gregory A. Aarons,et al.  A Concept Mapping Approach to Guide and Understand Dissemination and Implementation , 2012, The Journal of Behavioral Health Services & Research.

[34]  K. Hoagwood,et al.  Evidence-Based Interventions in Schools: Developers’ Views of Implementation Barriers and Facilitators , 2009 .

[35]  R Brian Haynes,et al.  Strategies to enhance venous thromboprophylaxis in hospitalized medical patients (SENTRY): a pilot cluster randomized trial , 2013, Implementation Science.

[36]  D. Simpson,et al.  Counselor assessments of training and adoption barriers. , 2007, Journal of substance abuse treatment.

[37]  S. Scott,et al.  Development of a checklist to assess the quality of reporting of knowledge translation interventions using the Workgroup for Intervention Development and Evaluation Research (WIDER) recommendations , 2013, Implementation Science.

[38]  Jennifer L. Magnabosco.  Innovations in mental health services implementation: a report on state-level data from the U.S. Evidence-Based Practices Project , 2006, Implementation science : IS.

[39]  B. Powell,et al.  Mental Health Clinicians' Experiences of Implementing Evidence-Based Treatments , 2013, Journal of evidence-based social work.

[40]  William M. K. Trochim,et al.  The use of concept mapping for assessing fidelity of model transfer: An example from psychiatric rehabilitation , 1995 .

[41]  Andrew D Pinto,et al.  Using concept mapping in the knowledge-to-action process to compare stakeholder opinions on barriers to use of cancer screening among South Asians , 2013, Implementation Science.

[42]  Marije Bosch,et al.  Tailoring quality improvement interventions to identified barriers: a multiple case analysis. , 2007, Journal of evaluation in clinical practice.

[43]  Jo Rycroft-Malone,et al.  Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges , 2008, Implementation science : IS.

[44]  P. Kendall,et al.  Training Therapists in Evidence-Based Practice: A Critical Review of Studies From a Systems-Contextual Perspective. , 2010, Clinical psychology : a publication of the Division of Clinical Psychology of the American Psychological Association.

[45]  J. Lowery,et al.  Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science , 2009, Implementation science : IS.

[46]  M. Walzer.  What Does It Mean to Be , 2004 .

[47]  K. Hawley,et al.  Mental health clinicians' motivation to invest in training: results from a practice-based research network survey. , 2013, Psychiatric services.

[48]  Peter J Pronovost,et al.  Using a logic model to design and evaluate quality and patient safety improvement programs. , 2012, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[49]  C. Bright,et al.  Toward a policy ecology of implementation of evidence-based practices in public mental health settings , 2008, Implementation science : IS.

[50]  Dean Tjosvold,et al.  Book review : Group model building : facilitating team learning using system dynamics , 1998 .

[51]  G. Kok,et al.  Exploring the Development of Existing Sex Education Programmes for People with Intellectual Disabilities: An Intervention Mapping Approach , 2012, Journal of applied research in intellectual disabilities : JARID.

[52]  George P. Richardson,et al.  Teamwork in group model building , 1995 .

[53]  Lars Wallin,et al.  Individual determinants of research utilization by nurses: a systematic review update , 2011, Implementation science : IS.

[54]  M. Laurant,et al.  Factors associated with the impact of quality improvement collaboratives in mental healthcare: An exploratory study , 2012, Implementation Science.

[55]  Cynthia A. Vinson.  Using Concept Mapping to Develop a Conceptual Framework for Creating Virtual Communities of Practice to Translate Cancer Research into Practice , 2014, Preventing chronic disease.

[56]  Leopoldo J. Cabassa,et al.  A two-way street: bridging implementation science and cultural adaptations of mental health treatments , 2013, Implementation Science.

[57]  David A. Chambers,et al.  Implementation Research in Mental Health Services: an Emerging Science with Conceptual, Methodological, and Training challenges , 2008, Administration and Policy in Mental Health and Mental Health Services Research.

[58]  Enola K. Proctor,et al.  A Compilation of Strategies for Implementing Clinical Innovations in Health and Mental Health , 2012, Medical care research and review : MCRR.

[59]  Kimberley R. Isett,et al.  The state policy context of implementation issues for evidence-based practices in mental health. , 2007, Psychiatric services.

[60]  P. Hovmand,et al.  Implementation of Evidence-Based Practice and Organizational Performance , 2008, The Journal of Behavioral Health Services & Research.

[61]  Marije Bosch,et al.  Development and selection of strategies for improving patient care , 2013 .

[62]  Mary F Brunette,et al.  Implementation of integrated dual disorders treatment: a qualitative analysis of facilitators and barriers. , 2008, Psychiatric services.

[63]  Lawrence A Palinkas,et al.  Implementing evidence-based practice in community mental health agencies: a multiple stakeholder analysis. , 2009, American journal of public health.

[64]  S. Straus,et al.  Knowledge translation in health care : moving from evidence to practice , 2009 .

[65]  Michel Wensing,et al.  Improving Patient Care: The Implementation of Change in Health Care , 2013 .

[66]  S Tsui,et al.  Transitioning to a new Casemix grouper to fund long-term care homes in Ontario, Canada , 2011, BMC Health Services Research.

[67]  Marije Bosch,et al.  Selecting, Tailoring, and implementing knowledge translation interventions , 2009 .

[68]  Etiënne A. J. A. Rouwette,et al.  Group Model Building , 2020, System Dynamics.

[69]  D. Kolko,et al.  The role of therapist training in the implementation of psychosocial treatments: a review and critique with recommendations. , 2010, Clinical psychology review.

[70]  Enola K Proctor,et al.  A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions , 2014, Research on social work practice.

[71]  Kelli Scott,et al.  Using Measurement-Based Care to Enhance Any Treatment. , 2015, Cognitive and behavioral practice.

[72]  K. Kelleher,et al.  Assessing the Organizational Social Context (OSC) of Mental Health Services: Implications for Research and Practice , 2008, Administration and Policy in Mental Health and Mental Health Services Research.

[73]  M. Eccles,et al.  Welcome to Implementation Science , 2006, Implementation Science.

[74]  P. Green,et al.  Thirty Years of Conjoint Analysis: Reflections and Prospects , 2001 .

[75]  Lisa M Klesges,et al.  What Does It Mean to “Employ” the RE-AIM Model? , 2013, Evaluation & the health professions.

[76]  P. Kontos,et al.  Implementation Science BioMed Central Debate , 2009 .

[77]  David A Chambers,et al.  Bridging research and practice: models for dissemination and implementation research. , 2012, American journal of preventive medicine.

[78]  Jeremy M Grimshaw,et al.  A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations , 2010, Implementation science : IS.

[79]  G. Aarons,et al.  Dissemination and implementation of evidence-based practices for child and adolescent mental health: a systematic review. , 2013, Journal of the American Academy of Child and Adolescent Psychiatry.

[80]  S. Marcus,et al.  Training and consultation to promote implementation of an empirically supported treatment: a randomized trial. , 2012, Psychiatric services.

[81]  F Davidoff,et al.  Publication guidelines for quality improvement in health care: evolution of the SQUIRE project , 2008, Quality & Safety in Health Care.

[82]  V. Ganju.  Implementation of evidence-based practices in state mental health systems: implications for research and effectiveness studies. , 2003, Schizophrenia bulletin.

[83]  S. Brophy,et al.  Interventions for latent autoimmune diabetes (LADA) in adults. , 2011, The Cochrane database of systematic reviews.

[84]  Richard Baker,et al.  A checklist for identifying determinants of practice: A systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice , 2013, Implementation Science.

[85]  R. Whitley,et al.  Implementing the illness management and recovery program in community mental health settings: facilitators and barriers. , 2009, Psychiatric services.

[86]  R. Raghavan,et al.  Administrative Barriers to the Adoption of High-Quality Mental Health Services for Children in Foster Care: A National Study , 2007, Administration and Policy in Mental Health and Mental Health Services Research.

[87]  Enola K Proctor,et al.  Implementation strategies: recommendations for specifying and reporting , 2013, Implementation Science.

[88]  Peter S. Hovmand,et al.  Community Based System Dynamics , 2013 .

[89]  Jill J. Francis,et al.  Designing theoretically-informed implementation interventions , 2006, Implementation science : IS.

[90]  Alicia C. Bunger,et al.  Context matters: measuring implementation climate among individuals and groups , 2014, Implementation Science.

[91]  Susan Michie,et al.  Specifying and reporting complex behaviour change interventions: the need for a scientific method , 2009, Implementation science : IS.

[92]  Shelagh A. Mulvaney,et al.  Barriers and facilitators of evidence-based practice perceived by behavioral science health professionals. , 2007, Journal of clinical psychology.

[93]  Jac A. M. Vennix,et al.  Group model-building: tackling messy problems , 1999 .

[94]  Audra K. Langley,et al.  Evidence-Based Mental Health Programs in Schools: Barriers and Facilitators of Successful Implementation , 2010, School mental health.

[95]  Mary Kane,et al.  Concept Mapping for Planning and Evaluation , 2006 .

[96]  C. Abraham,et al.  The Behavior Change Technique Taxonomy (v1) of 93 Hierarchically Clustered Techniques: Building an International Consensus for the Reporting of Behavior Change Interventions , 2013, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[97]  Andrew Lloyd,et al.  Conjoint analysis applications in health--a checklist: a report of the ISPOR Good Research Practices for Conjoint Analysis Task Force. , 2011, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[98]  R. Cicerone.  Initial National Priorities for Comparative Effectiveness Research , 2009 .

[99]  J. Kirchner,et al.  A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project , 2015, Implementation Science.

[100]  J. Coyne,et al.  Barriers to Adoption of New Treatments: An Internet Study of Practicing Community Psychotherapists , 2009, Administration and Policy in Mental Health and Mental Health Services Research.

[101]  J. Grimshaw,et al.  Tailored implementation for chronic diseases (TICD): A project protocol , 2011, Implementation science : IS.

[102]  George P. Richardson,et al.  A framework for evaluating systems thinking interventions: an experimental approach to mental health system change , 1997 .

[103]  J. Ioannidis,et al.  Evidence-based de-implementation for contradicted, unproven, and aspiring healthcare practices , 2014, Implementation Science.

[104]  Maria E Fernandez,et al.  Using Intervention Mapping to Develop a Breast and Cervical Cancer Screening Program for Hispanic Farmworkers: Cultivando La Salud , 2005, Health promotion practice.

[105]  Allan Best,et al.  Systems Thinking in Dissemination and Implementation Research , 2012 .

[106]  Rachel Haine-Schlagel,et al.  Therapist, Parent, and Youth Perspectives of Treatment Barriers to Family-Focused Community Outpatient Mental Health Services , 2012, Journal of Child and Family Studies.

[107]  Michel Wensing,et al.  Improving Patient Care: The Implementation of Change in Clinical Practice , 2005 .

[108]  David A. Chambers,et al.  Research and services partnerships: partnership: a fundamental component of dissemination and implementation research. , 2013, Psychiatric Services.

[109]  J. Lowery,et al.  Evaluation of a large-scale weight management program using the consolidated framework for implementation research (CFIR) , 2013, Implementation Science.

[110]  Lawrence Palinkas,et al.  Design Elements in Implementation Research: A Structured Review of Child Welfare and Child Mental Health Studies , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[111]  H. Swartz,et al.  Facilitators and barriers associated with implementation of evidence-based psychotherapy in community settings. , 2013, Psychiatric services.

[112]  G. Aarons,et al.  Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[113]  Bryan K. Orme,et al.  Which Conjoint Method Should I Use? , 2001 .