What strategies are used to build practitioners’ capacity to implement community-based interventions and are they effective?: a systematic review

BackgroundNumerous agencies are providing training, technical assistance, and other support to build community-based practitioners’ capacity to adopt and implement evidence-based prevention interventions. Yet, little is known about how best to design capacity-building interventions to optimize their effectiveness. Wandersman et al. (Am J Community Psychol.50:445–59, 2102) proposed the Evidence-Based System of Innovation Support (EBSIS) as a framework to guide research and thereby strengthen the evidence base for building practitioners’ capacity. The purpose of this review was to contribute to further development of the EBSIS by systematically reviewing empirical studies of capacity-building interventions to identify (1) the range of strategies used, (2) variations in the way they were structured, and (3) evidence for their effectiveness at increasing practitioners’ capacity to use evidence-based prevention interventions.MethodsPubMed, EMBASE, and CINAHL were searched for English-language articles reporting findings of empirical studies of capacity-building interventions that were published between January 2000 and January 2014 and were intended to increase use of evidence-based prevention interventions in non-clinical settings. To maximize review data, studies were not excluded a priori based on design or methodological quality. Using the EBSIS as a guide, two researchers independently extracted data from included studies. Vote counting and meta-summary methods were used to summarize findings.ResultsThe review included 42 publications reporting findings from 29 studies. In addition to confirming the strategies and structures described in the EBSIS, the review identified two new strategies and two variations in structure. Capacity-building interventions were found to be effective at increasing practitioners’ adoption (n = 10 of 12 studies) and implementation (n = 9 of 10 studies) of evidence-based interventions. Findings were mixed for interventions’ effects on practitioners’ capacity or intervention planning behaviors. Both the type and structure of capacity-building strategies may have influenced effectiveness. The review also identified contextual factors that may require variations in the ways capacity-building interventions are designed.ConclusionsBased on review findings, refinements are suggested to the EBSIS. The refined framework moves the field towards a more comprehensive and standardized approach to conceptualizing the types and structures of capacity-building strategies. This standardization will assist with synthesizing findings across studies and guide capacity-building practice and research.

[1]  J. Wyatt,et al.  Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide , 2014, BMJ : British Medical Journal.

[2]  C. B. Steele,et al.  Use of Evidence-Based Practices and Resources Among Comprehensive Cancer Control Programs. , 2015, Journal of public health management and practice : JPHMP.

[3]  M. Slaughter,et al.  An intervention to improve program implementation: findings from a two-year cluster randomized trial of Assets-Getting To Outcomes , 2013, Implementation Science.

[4]  K. Glanz,et al.  Linking agents' activities and communication patterns in a study of the dissemination of an effective skin cancer prevention program. , 2009, Journal of public health management and practice : JPHMP.

[5]  Karen Glanz,et al.  Research to reality: a process evaluation of a mini-grants program to disseminate evidence-based nutrition programs to rural churches and worksites. , 2012, Journal of public health management and practice : JPHMP.

[6]  Ross C Brownson,et al.  Individual and setting level predictors of the implementation of a skin cancer prevention program: a multilevel analysis , 2010, Implementation science : IS.

[7]  C. Adair,et al.  Knowledge transfer and exchange: review and synthesis of the literature. , 2007, The Milbank quarterly.

[8]  J. Briney,et al.  Sustaining the Utilization and High Quality Implementation of Tested and Effective Prevention Programs Using the Communities That Care Prevention System , 2012, American journal of community psychology.

[9]  S. Sussman,et al.  The Effects of Implementation Fidelity in the Towards No Drug Abuse Dissemination Trial. , 2013, Health education.

[10]  M. Greenberg,et al.  The Effect of the PROSPER Partnership Model on Cultivating Local Stakeholder Knowledge of Evidence-Based Programs: A Five-Year Longitudinal Study of 28 Communities , 2012, Prevention Science.

[11]  R Brian Haynes,et al.  A cross-sectional study of the number and frequency of terms used to refer to knowledge translation in a body of health literature in 2006: a Tower of Babel? , 2010, Implementation science : IS.

[12]  Dianne C Barker,et al.  Helping pregnant smokers quit: meeting the challenge in the next decade , 2000, The Western journal of medicine.

[13]  M. Maras,et al.  Ready, Willing, and Able: Developing a Support System to Promote Implementation of School-Based Prevention Programs , 2012, American journal of community psychology.

[14]  Jennifer Duffy,et al.  Bridging the Gap Between Prevention Research and Practice: The Interactive Systems Framework for Dissemination and Implementation , 2008, American journal of community psychology.

[15]  S. Philliber,et al.  Implementation Science: Promoting Science-Based Approaches to Prevent Teen Pregnancy , 2008, Prevention Science.

[16]  Ilima L. Kane,et al.  Motivating public school districts to adopt sun protection policies: a randomized controlled trial. , 2011, American journal of preventive medicine.

[17]  M. Engelgau,et al.  Systems and Capacity to Address Noncommunicable Diseases in Low- and Middle-Income Countries , 2013, Science Translational Medicine.

[18]  Abraham Wandersman,et al.  Toward an Evidence-Based System for Innovation Support for Implementing Innovations with Quality: Tools, Training, Technical Assistance, and Quality Assurance/Quality Improvement , 2012, American journal of community psychology.

[19]  A. Faye,et al.  Enhancing Teen Pregnancy Prevention in Local Communities: Capacity Building Using the Interactive Systems Framework , 2012, American journal of community psychology.

[20]  Abigail A Fagan,et al.  Implementing the LifeSkills Training drug prevention program: factors related to implementation fidelity , 2008, Implementation science : IS.

[21]  K. Glanz,et al.  A Multi-Method Process Evaluation for a Skin Cancer Prevention Diffusion Trial , 2009, Evaluation & the health professions.

[22]  M. Hagströmer,et al.  A participatory and capacity-building approach to healthy eating and physical activity – SCIP-school: a 2-year controlled trial , 2012, International Journal of Behavioral Nutrition and Physical Activity.

[23]  M. Greenberg,et al.  The Longitudinal Effect of Technical Assistance Dosage on the Functioning of Communities That Care Prevention Boards in Pennsylvania , 2008, The Journal of Primary Prevention.

[24]  Jeffrey R. Harris,et al.  Improving low-wage, midsized employers' health promotion practices: a randomized controlled trial. , 2012, American journal of preventive medicine.

[25]  M. Petticrew,et al.  Developing and evaluating complex interventions: the new Medical Research Council guidance , 2008, BMJ : British Medical Journal.

[26]  R. Brownson,et al.  Evidence-based public health: a fundamental concept for public health practice. , 2009, Annual review of public health.

[27]  A theory-based model of translation practices in public health participatory research. , 2012, Sociology of health & illness.

[28]  Evelyn P Whitlock,et al.  Evidence-based behavioral medicine: What is it and how do we achieve it? , 2003, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[29]  Joseph G. L. Lee,et al.  Successful implementation of a wellness and tobacco cessation curriculum in psychosocial rehabilitation clubhouses , 2011, BMC public health.

[30]  A. Wandersman,et al.  The Getting To Outcomes Demonstration and Evaluation: An Illustration of the Prevention Support System , 2008, American journal of community psychology.

[31]  J. Stevenson,et al.  Coalitional Capacities and Environmental Strategies to Prevent Underage Drinking , 2013, American journal of community psychology.

[32]  Jennifer Duffy,et al.  Unpacking Prevention Capacity: An Intersection of Research-to-practice Models and Community-centered Models , 2008, American journal of community psychology.

[33]  L. Leviton,et al.  Evaluation of the Healthy Schools Program: Part II. The Role of Technical Assistance , 2012, Preventing chronic disease.

[34]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[35]  Ross C Brownson,et al.  Evidence-based interventions to promote physical activity: what contributes to dissemination by state health departments. , 2007, American journal of preventive medicine.

[36]  S. Sussman,et al.  The Project Towards No Drug Abuse (TND) Dissemination Trial: Implementation Fidelity and Immediate Outcomes , 2010, Prevention Science.

[37]  T. Valente,et al.  Community coalitions as a system: effects of network change on adoption of evidence-based substance abuse prevention. , 2007, American journal of public health.

[38]  J. Durlak,et al.  Implementation Matters: A Review of Research on the Influence of Implementation on Program Outcomes and the Factors Affecting Implementation , 2008, American journal of community psychology.

[39]  P. Ebener,et al.  Evaluating the Impact of Getting to Outcomes–Underage Drinking on Prevention Capacity and Alcohol Merchant Attitudes and Selling Behaviors , 2014, Prevention Science.

[40]  Borsika A. Rabin,et al.  Dissemination and implementation research on community-based cancer prevention: a systematic review. , 2010, American journal of preventive medicine.

[41]  Ross C Brownson,et al.  A glossary for dissemination and implementation research in health. , 2008, Journal of public health management and practice : JPHMP.

[42]  A. Robbins,et al.  Formative Assessment of Use of Behavioral Data in HIV Prevention: Texas , 2005, AIDS and Behavior.

[43]  Valerie B. Shapiro,et al.  Reciprocal Relations between Coalition Functioning and the Provision of Implementation Support , 2013, Prevention Science.

[44]  K. Glanz,et al.  Process evaluation of the Pool Cool Diffusion Trial for skin cancer prevention across 2 years. , 2007, Health education research.

[45]  M. Greenberg,et al.  Six-Year Sustainability of Evidence-Based Intervention Implementation Quality by Community-University Partnerships: The PROSPER Study , 2011, American journal of community psychology.

[46]  G. Robert,et al.  Diffusion of innovations in service organizations: systematic review and recommendations. , 2004, The Milbank quarterly.

[47]  V. Benard,et al.  News from the CDC: collaborations to build capacity at the community level in cancer prevention and control , 2013, Translational behavioral medicine.

[48]  M. Greenberg,et al.  Determinants of Community Coalition Ability to Support Evidence-Based Programs , 2010, Prevention Science.

[49]  P. Ebener,et al.  Intervening with Practitioners to Improve the Quality of Prevention: One-Year Findings from a Randomized Trial of Assets-Getting To Outcomes , 2013, The Journal of Primary Prevention.

[50]  M. Sandelowski,et al.  An evaluation of how well research reports facilitate the use of findings in practice. , 2006, Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing.

[51]  M. Pentz,et al.  Promoting Community Coalition Functioning: Effects of Project STEP , 2008, Prevention Science.

[52]  Findings from the Community Health Intervention Program in South Carolina: Implications for Reducing Cancer-Related Health Disparities , 2013, Journal of Cancer Education.

[53]  P. Pluye,et al.  A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews. , 2009, International journal of nursing studies.

[54]  David R. Holtgrave,et al.  Bridging the gap between the science and service of HIV prevention: transferring effective research-based HIV prevention interventions to community AIDS service providers. , 2000, American journal of public health.

[55]  Jo Rycroft-Malone,et al.  Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges , 2008, Implementation science : IS.

[56]  Camilla Harshbarger,et al.  An empirical assessment of implementation, adaptation, and tailoring: the evaluation of CDC's National Diffusion of VOICES/VOCES. , 2006, AIDS education and prevention : official publication of the International Society for AIDS Education.

[57]  R. Brownson,et al.  Use of evidence-based interventions in state health departments: a qualitative assessment of barriers and solutions. , 2010, Journal of public health management and practice : JPHMP.

[58]  Elizabeth Waters,et al.  Improving the reporting of public health intervention research: advancing TREND and CONSORT. , 2008, Journal of public health.

[59]  A. Wandersman,et al.  Technical Assistance as a Prevention Capacity-Building Tool: A Demonstration Using the Getting To Outcomes® Framework , 2009, Health education & behavior : the official publication of the Society for Public Health Education.

[60]  L. Hedges,et al.  The Handbook of Research Synthesis and Meta-Analysis , 2009 .

[61]  Karen Glanz,et al.  Diffusion of an effective skin cancer prevention program: design, theoretical foundations, and first-year implementation. , 2005, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[62]  P. Ebener,et al.  PROMOTING EVIDENCE-BASED PRACTICES: THE ADOPTION OF A PREVENTION SUPPORT SYSTEM IN COMMUNITY SETTINGS , 2009 .

[63]  Souraya Sidani,et al.  Handbook for Synthesizing Qualitative Research , 2008 .

[64]  Myriam Hamdallah,et al.  The diffusion of effective behavioral interventions project: development, implementation, and lessons learned. , 2006, AIDS education and prevention : official publication of the International Society for AIDS Education.

[65]  Brian K Bumbarger,et al.  Sustaining Evidence-Based Prevention Programs: Correlates in a Large-Scale Dissemination Initiative , 2013, Prevention Science.

[66]  L. Leviton,et al.  Evaluation of the Healthy Schools Program: Part I. Interim Progress , 2012, Preventing chronic disease.

[67]  S. Buka,et al.  The Interactive Systems Framework Applied to the Strategic Prevention Framework: The Rhode Island Experience , 2012, American journal of community psychology.

[68]  C. Roberts-Gray,et al.  Follow-up comparisons of intervention and comparison schools in a state tobacco prevention and control initiative. , 2006, The Journal of school health.

[69]  J. Popay,et al.  Synthesizing Qualitative and Quantitative Health Evidence: A Guide to Methods , 2007 .

[70]  K. Emmons,et al.  The SunWise Policy Intervention for School-Based Sun Protection: A Pilot Study , 2008, The Journal of school nursing : the official publication of the National Association of School Nurses.