Use of effective training and quality assurance strategies is associated with high-fidelity EBI implementation in practice settings: a case analysis.

High-quality implementation of evidence-based interventions is important for program effectiveness and is influenced by training and quality assurance (QA). However, gaps in the literature contribute to a lack of guidance on training and supervision in practice settings, particularly when significant adaptations in programs occur. We examine training and QA in relationship to program fidelity among organizations delivering a widely disseminated HIV counseling and testing EBI in which significant adaptations occurred due to new testing technology. Using a maximum variation case study approach, we examined training and QA in organizations delivering the program with high- and low-fidelity (agencies: 3 = high; 3 = low). We identified themes that distinguished high- and low-fidelity agencies. For example, high-fidelity agencies more often employed a team approach to training; demonstrated use of effective QA strategies; leveraged training and QA to identify and adjust for fit problems, including challenges related to adaptations; and understood the distinctions between RESPECT and other testing programs. The associations between QA and fidelity were strong and straightforward, whereas the relationship between training and fidelity was more complex. Public health needs high-quality training and QA approaches that can address program fit and program adaptations. The study findings reinforced the value of using effective QA strategies. Future work should address methods of increasing program fit through training and QA, identify a set of QA strategies that maximize program fidelity and is feasible to implement, and identify low-cost supplemental training options.

[1]  J. Richardson,et al.  The Challenges of Assessing Fidelity to Physician-Driven HIV Prevention Interventions: Lessons Learned Implementing Partnership for Health in a Los Angeles HIV Clinic , 2008, AIDS and Behavior.

[2]  E. Ozer,et al.  Increasing the Screening and Counseling of Adolescents for Risky Health Behaviors: A Primary Care Intervention , 2005, Pediatrics.

[3]  Aaron R. Lyon,et al.  Developing the Mental Health Workforce: Review and Application of Training Approaches from Multiple Disciplines , 2011, Administration and Policy in Mental Health and Mental Health Services Research.

[4]  A. Fairchild,et al.  Evidence and the Politics of Deimplementation: The Rise and Decline of the "Counseling and Testing" Paradigm for HIV Prevention at the US Centers for Disease Control and Prevention. , 2016, The Milbank quarterly.

[5]  E. Proctor,et al.  Training in Implementation Practice Leadership (TRIPLE): evaluation of a novel practice change strategy in behavioral health organizations , 2019, Implementation Science.

[6]  Dianna Dragatsi,et al.  Using the collaborative intervention planning framework to adapt a health-care manager intervention to a new population and provider group to improve the health of people with serious mental illness , 2014, Implementation Science.

[7]  Alan E Kazdin,et al.  Evidence-based treatment and practice: new opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. , 2008, The American psychologist.

[8]  P. Chamberlain,et al.  A Supervisor-Targeted Implementation Approach to Promote System Change: The R3 Model , 2016, Administration and Policy in Mental Health and Mental Health Services Research.

[9]  M. M. Dolcini,et al.  Fiscal loss and program fidelity: impact of the economic downturn on HIV/STI prevention program fidelity , 2014, Translational Behavioral Medicine.

[10]  R. Brownson,et al.  Learning About and Using Research Evidence Among Public Health Practitioners. , 2017, American journal of preventive medicine.

[11]  F Rhodes,et al.  Efficacy of risk-reduction counseling to prevent human immunodeficiency virus and sexually transmitted diseases: a randomized controlled trial. Project RESPECT Study Group. , 1998, JAMA.

[12]  M. Charns,et al.  Middle managers’ role in implementing evidence-based practices in healthcare: a systematic review , 2018, Implementation Science.

[13]  J. Lowery,et al.  Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science , 2009, Implementation science : IS.

[14]  Deborah Bybee,et al.  Fidelity Criteria: Development, Measurement, and Validation , 2003 .

[15]  Holly M. Hutchins,et al.  Training Transfer: An Integrative Literature Review , 2007 .

[16]  A. O'Leary,et al.  Translating HIV interventions into practice: community-based organizations' experiences with the diffusion of effective behavioral interventions (DEBIs). , 2010, Social science & medicine.

[17]  C. Malotte,et al.  Relative Efficacy of Prevention Counseling With Rapid and Standard HIV Testing: A Randomized, Controlled Trial (RESPECT-2) , 2005, Sexually transmitted diseases.

[18]  M. M. Dolcini,et al.  Implementing a brief evidence-based HIV intervention: a mixed methods examination of compliance fidelity , 2014, Translational behavioral medicine.

[19]  J. Klein,et al.  Improving adolescent preventive care in community health centers. , 2001, Pediatrics.

[20]  Michael C. Anderson,et al.  Interference and inhibition in memory retrieval. , 1996 .

[21]  Elisa S. Shernoff,et al.  Clinical Supervision in Effectiveness and Implementation Research , 2013 .

[22]  Dean L. Fixsen,et al.  Improving Programs and Outcomes , 2015 .

[23]  M. M. Dolcini,et al.  Impact of Human Resources on Implementing an Evidence-Based HIV Prevention Intervention , 2017, AIDS and Behavior.

[24]  H. H. Hill,et al.  Development of an Audio-Tape Review System for Supporting Adherence to an Evidence-Based Treatment. , 2008, Professional psychology, research and practice.

[25]  R. Culyba,et al.  Changing HIV Clinical Knowledge and Skill in Context: The Impact of Longitudinal Training in the Southeast United States , 2011, The Journal of the Association of Nurses in AIDS Care : JANAC.

[26]  Deborah Gelaude,et al.  Adapting evidence-based behavioral interventions for new settings and target populations. , 2006, AIDS education and prevention : official publication of the International Society for AIDS Education.

[27]  C. Collins,et al.  CDC’s dissemination of evidence-based behavioral HIV prevention interventions , 2011, Translational behavioral medicine.

[28]  A. Wandersman,et al.  The Getting To Outcomes Demonstration and Evaluation: An Illustration of the Prevention Support System , 2008, American journal of community psychology.

[29]  David A Chambers,et al.  The Adaptome: Advancing the Science of Intervention Adaptation. , 2016, American journal of preventive medicine.

[30]  Abraham Wandersman,et al.  Toward an Evidence-Based System for Innovation Support for Implementing Innovations with Quality: Tools, Training, Technical Assistance, and Quality Assurance/Quality Improvement , 2012, American journal of community psychology.

[31]  J. Durlak,et al.  Implementation Matters: A Review of Research on the Influence of Implementation on Program Outcomes and the Factors Affecting Implementation , 2008, American journal of community psychology.

[32]  David A. Chambers,et al.  The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change , 2013, Implementation Science.

[33]  Andrew V. Dane,et al.  Program integrity in primary and early secondary prevention: are implementation effects out of control? , 1998, Clinical psychology review.

[34]  Lucy Berliner,et al.  Clinician Use of Standardized Assessments Following a Common Elements Psychotherapy Training and Consultation Program , 2014, Administration and Policy in Mental Health and Mental Health Services Research.

[35]  E. Ozer,et al.  Receipt of preventive health services in young adults. , 2013, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[36]  Dean L. Fixsen,et al.  Core Implementation Components , 2009 .