The Quality Implementation Framework: A Synthesis of Critical Steps in the Implementation Process

Implementation science is growing in importance among funders, researchers, and practitioners as an approach to bridging the gap between science and practice. We addressed three goals to contribute to the understanding of the complex and dynamic nature of implementation. Our first goal was to provide a conceptual overview of the process of implementation by synthesizing information from 25 implementation frameworks. The synthesis extends prior work by focusing on specific actions (i.e., the “how to”) that can be employed to foster high quality implementation. The synthesis identified 14 critical steps that were used to construct the Quality Implementation Framework (QIF). These steps comprise four QIF phases: Initial Considerations Regarding the Host Setting, Creating a Structure for Implementation, Ongoing Structure Once Implementation Begins, and Improving Future Applications. Our second goal was to summarize research support for each of the 14 QIF steps and to offer suggestions to direct future research efforts. Our third goal was to outline practical implications of our findings for improving future implementation efforts in the world of practice. The QIF’s critical steps can serve as a useful blueprint for future research and practice. Applying the collective guidance synthesized by the QIF to the Interactive Systems Framework for Dissemination and Implementation (ISF) emphasizes that accountability for quality implementation does not rest with the practitioner Delivery System alone. Instead, all three ISF systems are mutually accountable for quality implementation.

[1]  Neal Schmitt,et al.  The fidelity-adaptation debate: Implications for the implementation of public sector social programs , 1987 .

[2]  J. Ioannidis,et al.  The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. , 2009, Journal of clinical epidemiology.

[3]  Catherine P. Bradshaw,et al.  Maximizing the Implementation Quality of Evidence-Based Preventive Interventions in Schools: A Conceptual Framework , 2008, Advances in school mental health promotion.

[4]  Karen A. Blase,et al.  Implementation Research: A Synthesis of the , 2005 .

[5]  J. Grimshaw,et al.  Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations , 1993, The Lancet.

[6]  David Holleran,et al.  The Impact of Evidence-Based Practices on Requests for Out-of-Home Placements in the Context of System Reform , 2013 .

[7]  Satya S. Chakravorty,et al.  Six Sigma programs: An implementation model , 2009 .

[8]  E. Stone,et al.  Using process data to explain outcomes. An illustration from the Child and Adolescent Trial for Cardiovascular Health (CATCH). , 1998, Evaluation review.

[9]  G. Aarons,et al.  Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[10]  Joseph A. Maxwell,et al.  Qualitative Research Design: An Interactive Approach , 1996 .

[11]  E. Rogers Diffusion of Innovations , 1962 .

[12]  D. Henderson-smart,et al.  Closing the evidence‐practice gap for newborn pain using clinical networks , 2011, Journal of paediatrics and child health.

[13]  R Jones,et al.  Twenty years of implementation research. , 2000, Family practice.

[14]  D. Simpson A conceptual framework for transferring research to practice. , 2002, Journal of substance abuse treatment.

[15]  B. Chorpita,et al.  Toward Large‐Scale Implementation of Empirically Supported Treatments for Children: A Review and Observations by the Hawaii Empirical Basis to Services Task Force , 2006 .

[16]  W. Miller,et al.  A randomized trial of methods to help clinicians learn motivational interviewing. , 2004, Journal of consulting and clinical psychology.

[17]  A. Wandersman,et al.  Getting To Outcomes™ 2004 , 2004 .

[18]  Fevzi Okumus,et al.  A framework to implement strategies in organizations , 2003 .

[19]  A. Kilbourne,et al.  Implementing evidence-based interventions in health care: application of the replicating effective programs framework , 2007, Implementation science : IS.

[20]  M. Greenberg,et al.  Toward a Comprehensive Strategy for Effective Practitioner–Scientist Partnerships and Larger-Scale Community Health and Well-Being , 2005, American journal of community psychology.

[21]  Shawna J Lee,et al.  Using Planned Adaptation to Implement Evidence-Based Programs with New Populations , 2008, American journal of community psychology.

[22]  A. Wandersman,et al.  The Getting To Outcomes Demonstration and Evaluation: An Illustration of the Prevention Support System , 2008, American journal of community psychology.

[23]  Abraham Wandersman,et al.  Practical Implementation Science: Developing and Piloting the Quality Implementation Tool , 2012, American journal of community psychology.

[24]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[25]  C. Perry,et al.  Tobacco use measurement, prediction, and intervention in elementary schools in four states: the CATCH Study. , 1996, Preventive medicine.

[26]  J. Ioannidis,et al.  The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration , 2009, BMJ : British Medical Journal.

[27]  Pierre Benghozi,et al.  Dissemination and implementation , 2009 .

[28]  S. Elliott,et al.  Determinants of implementing heart health: promotion activities in Ontario public health units: a social ecological perspective. , 2001, Health education research.

[29]  Ruth P Saunders,et al.  Examining the link between program implementation and behavior outcomes in the lifestyle education for activity program (LEAP). , 2006, Evaluation and program planning.

[30]  Sonja K Schoenwald,et al.  The ARC Organizational and Community Intervention Strategy for Implementing Evidence-Based Children's Mental Health Treatments , 2005, Mental health services research.

[31]  Jennifer Duffy,et al.  Bridging the Gap Between Prevention Research and Practice: The Interactive Systems Framework for Dissemination and Implementation , 2008, American journal of community psychology.

[32]  James H Derzon,et al.  The effects of school-based intervention programs on aggressive behavior: a meta-analysis. , 2003, Journal of consulting and clinical psychology.

[33]  N. Tobler,et al.  Meta-Analysis of 143 Adolescent Drug Prevention Programs: Quantitative Outcome Results of Program Participants Compared to a Control or Comparison Group , 1986 .

[34]  C. Basch,et al.  Avoiding Type III Errors in Health Education Program Evaluations: A Case Study , 1985, Health education quarterly.

[35]  Jo Rycroft-Malone,et al.  The PARIHS framework--a framework for guiding the implementation of evidence-based practice. , 2004, Journal of nursing care quality.

[36]  Jennifer Duffy,et al.  Unpacking Prevention Capacity: An Intersection of Research-to-practice Models and Community-centered Models , 2008, American journal of community psychology.

[37]  Peter K. Smith,et al.  The Effectiveness of Whole-School Antibullying Programs: A Synthesis of Evaluation Research , 2004 .

[38]  N. Koroloff,et al.  Grounded Theory and Backward Mapping: Exploring the Implementation Context for Wraparound , 2007, The Journal of Behavioral Health Services & Research.

[39]  Paul Chinowsky Staircase Model for New Practice Implementation , 2008 .

[40]  Katherine Irwin,et al.  Blueprints for Violence Prevention , 2003 .

[41]  E. Proctor,et al.  Implementation Research in Mental Health Services , 2009 .

[42]  K. Klein,et al.  The Challenge of Innovation Implementation , 1996 .

[43]  Amy Buhl Conn,et al.  Implementing computerized technology: an organizational analysis. , 2001, The Journal of applied psychology.

[44]  Russell E Glasgow,et al.  A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. , 2008, Joint Commission journal on quality and patient safety.

[45]  S. Stith,et al.  Implementing Community-Based Prevention Programming: A Review of the Literature , 2006, Journal of Primary Prevention.

[46]  R Kosterman,et al.  Changing teaching practices to promote achievement and bonding to school. , 1998, The American journal of orthopsychiatry.

[47]  E. Berman,et al.  The Challenge of Innovation , 2008, IEEE Engineering Management Review.

[48]  C. Greenwood,et al.  A Building-Based Case Study of Evidence-Based Literacy Practices , 2003 .

[49]  S. Schoenwald,et al.  Toward Evidence-Based Transport of Evidence-Based Treatments: MST as an Example , 2008 .

[50]  B. Joyce,et al.  Student Achievement Through Staff Development , 1988 .

[51]  Thomas D. Cook,et al.  Comer's School Development Program in Prince George's County, Maryland: A Theory-Based Evaluation , 1999 .

[52]  K. Guldbrandsson From news to everyday use: the difficult art of implementation. , 2008 .

[53]  J. Lowery,et al.  Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science , 2009, Implementation science : IS.

[54]  D. Gottfredson,et al.  Managing Adolescent Behavior A Multiyear, Multischool Study , 1993 .

[55]  D. Elliott,et al.  Blueprints for Violence Prevention. Juvenile Justice Bulletin. , 2001 .

[56]  Andrew V. Dane,et al.  Program integrity in primary and early secondary prevention: are implementation effects out of control? , 1998, Clinical psychology review.

[57]  Abraham Wandersman,et al.  Community interventions and effective prevention. , 2003, The American psychologist.

[58]  A. Wandersman,et al.  Supporting Implementation of Expanded School Mental Health Services: Application of the Interactive Systems Framework in Ohio , 2008 .

[59]  R. McMahon,et al.  Adherence and Flexibility: They Can (and Do) Coexist! , 2010 .

[60]  Gene E. Hall,et al.  Implementing Change: Patterns, Principles, and Potholes , 2000 .

[61]  Scott D. Gest,et al.  Implementation Quality: Lessons Learned in the Context of the Head Start REDI Trial. , 2010, Early childhood research quarterly.

[62]  Brad A. Dufrene,et al.  Monitoring Implementation of Reciprocal Peer Tutoring: Identifying and Intervening With Students Who Do Not Maintain Accurate Implementation , 2005 .

[63]  Marshall Scott Poole,et al.  Research on the management of innovation : the Minnesota studies , 1991 .

[64]  David A. Chambers,et al.  Implementation Research in Mental Health Services: an Emerging Science with Conceptual, Methodological, and Training challenges , 2008, Administration and Policy in Mental Health and Mental Health Services Research.

[65]  K. Khunti,et al.  Implementation Science the National Institute of Health Research (nihr) Collaboration for Leadership in Applied Health Research and Care (clahrc) for Leicestershire, Northamptonshire and Rutland (lnr): a Programme Protocol , 2009 .

[66]  G. Aarons,et al.  The impact of evidence-based practice implementation and fidelity monitoring on staff turnover: evidence for a protective effect. , 2009, Journal of consulting and clinical psychology.

[67]  B. Mittman,et al.  An organizational framework and strategic implementation for system-level change to enhance research-based practice: QUERI Series , 2008, Implementation science : IS.

[68]  J. Durlak,et al.  Implementation Matters: A Review of Research on the Influence of Implementation on Program Outcomes and the Factors Affecting Implementation , 2008, American journal of community psychology.

[69]  D. Moher,et al.  Nonalcoholic Fatty Liver Disease and Acute Ischemic Stroke , 2010 .

[70]  Sarah A. McGraw,et al.  Using Process Data To Explain Outcomes , 1996 .

[71]  Mary Jo Bitner,et al.  Developing Effective Prevention Services for the Real World: A Prevention Service Development Model , 2005, American journal of community psychology.

[72]  Tony C. M. Lam,et al.  Measuring Program Implementation with a Classroom Observation Instrument , 1985 .

[73]  S. Asch,et al.  Enhancing Organizational Change and Improvement Prospects: Lessons from an HIV Testing Intervention for Veterans , 2008 .

[74]  Jeffrey C. Valentine,et al.  Effectiveness of Mentoring Programs for Youth: A Meta-Analytic Review , 2002, American journal of community psychology.

[75]  Abraham Wandersman,et al.  Toward an Evidence-Based System for Innovation Support for Implementing Innovations with Quality: Tools, Training, Technical Assistance, and Quality Assurance/Quality Improvement , 2012, American journal of community psychology.

[76]  Barbara Resnick,et al.  Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. , 2004, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[77]  J M Grimshaw,et al.  Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. , 1994, Lancet.

[78]  J. Markowitz We Don't Train in Vain: A Dissemination Trial of Three Strategies of Training Clinicians in Cognitive–Behavioral Therapy , 2006 .

[79]  G. Robert,et al.  Diffusion of innovations in service organizations: systematic review and recommendations. , 2004, The Milbank quarterly.

[80]  Michael W. Arthur,et al.  Promoting science-based prevention in communities. , 2002, Addictive behaviors.

[81]  M. Sanders,et al.  Facilitating Practitioner Flexibility Within an Empirically Supported Intervention: Lessons From a System of Parenting Support , 2010 .

[82]  Abigail A Fagan,et al.  Bridging Science to Practice: Achieving Prevention Program Implementation Fidelity in the Community Youth Development Study , 2008, American journal of community psychology.

[83]  Mark Greenberg,et al.  PROSPER Community–University Partnership Model for Public Education Systems: Capacity-Building for Evidence-Based, Competence-Building Prevention , 2004, Prevention Science.