Practical Implementation Science: Developing and Piloting the Quality Implementation Tool

According to the Interactive Systems Framework for Dissemination and Implementation, implementation is a major mechanism and concern in bridging research and practice. The growing number of implementation frameworks need to be synthesized and translated so that the science and practice of quality implementation can be furthered. In this article, we: (1) use the synthesis of frameworks developed by Meyers et al. (Am J Commun Psychol, 2012) and translate the results into a practical implementation science tool to use for improving quality of implementation (i.e., the Quality Implementation Tool; QIT), and (2) present some of the benefits and limitations of the tool by describing how the QIT was implemented in two different pilot projects. We discuss how the QIT can be used to guide collaborative planning, monitoring, and evaluation of how an innovation is implemented.

[1]  C. Voss.  Successful innovation and implementation of new processes , 1992 .

[2]  Steven C. Mills,et al.  A tool for analyzing implementation fidelity of an integrated learning system , 2000 .

[3]  Sonja K Schoenwald,et al.  The ARC Organizational and Community Intervention Strategy for Implementing Evidence-Based Children's Mental Health Treatments , 2005, Mental health services research.

[4]  Peter K. Smith,et al.  The Effectiveness of Whole-School Antibullying Programs: A Synthesis of Evaluation Research , 2004 .

[5]  Jennifer Duffy,et al.  Bridging the Gap Between Prevention Research and Practice: The Interactive Systems Framework for Dissemination and Implementation , 2008, American journal of community psychology.

[6]  C. Bright,et al.  Toward a policy ecology of implementation of evidence-based practices in public mental health settings , 2008, Implementation science : IS.

[7]  P. Greenbaum,et al.  Use of the System-of-Care Practice Review in the National Evaluation , 2001 .

[8]  Carol L. O'Donnell.  Defining, Conceptualizing, and Measuring Fidelity of Implementation and Its Relationship to Outcomes in K–12 Curriculum Intervention Research , 2008 .

[9]  J. Lowery,et al.  Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science , 2009, Implementation science : IS.

[10]  Deborah Bybee,et al.  Fidelity Criteria: Development, Measurement, and Validation , 2003 .

[11]  D. Simpson,et al.  Assessing organizational readiness for change. , 2002, Journal of substance abuse treatment.

[12]  Jennifer Duffy,et al.  Unpacking Prevention Capacity: An Intersection of Research-to-practice Models and Community-centered Models , 2008, American journal of community psychology.

[13]  Abraham Wandersman,et al.  The Quality Implementation Framework: A Synthesis of Critical Steps in the Implementation Process , 2012, American journal of community psychology.

[14]  Rudolph Corvini,et al.  Training in Business and Industry. , 1962 .

[15]  Marybeth Shinn,et al.  Learning from Communities: Overcoming Difficulties in Dissemination of Prevention and Promotion Efforts , 2005, American journal of community psychology.

[16]  Joseph A. Durlak,et al.  Why Program Implementation is Important , 1998 .

[17]  Abraham Wandersman,et al.  Getting to outcomes: a results-based approach to accountability , 2000 .

[18]  E. Rogers.  Diffusion of Innovations , 1962 .

[19]  W. Miller,et al.  Motivational interviewing: preparing people for change. , 2002 .

[20]  H. Liddle,et al.  INTERVENTION FIDELITY IN FAMILY-BASED PREVENTION COUNSELING FOR ADOLESCENT PROBLEM BEHAVIORS , 2005 .

[21]  R. Goodman,et al.  Identifying and Defining the Dimensions of Community Capacity to Provide a Basis for Measurement , 1998, Health education & behavior : the official publication of the Society for Public Health Education.

[22]  Camilla Harshbarger,et al.  An empirical assessment of implementation, adaptation, and tailoring: the evaluation of CDC's National Diffusion of VOICES/VOCES. , 2006, AIDS education and prevention : official publication of the International Society for AIDS Education.

[23]  David P. Farrington,et al.  Offender Rehabilitation in Practice: Implementing and Evaluating Effective Programs , 2001 .

[24]  Abigail A Fagan,et al.  Bridging Science to Practice: Achieving Prevention Program Implementation Fidelity in the Community Youth Development Study , 2008, American journal of community psychology.

[25]  N. Koroloff,et al.  Grounded Theory and Backward Mapping: Exploring the Implementation Context for Wraparound , 2007, The Journal of Behavioral Health Services & Research.

[26]  Katherine Irwin,et al.  Blueprints for Violence Prevention , 2003 .

[27]  Andrew V. Dane,et al.  Program integrity in primary and early secondary prevention: are implementation effects out of control? , 1998, Clinical psychology review.

[28]  Peter Bramley,et al.  Evaluating Training against Business Criteria , 1994 .

[29]  D. Elliott,et al.  Blueprints for Violence Prevention. Juvenile Justice Bulletin. , 2001 .

[30]  K. Klein,et al.  The Challenge of Innovation Implementation , 1996 .

[31]  Russell E Glasgow,et al.  A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. , 2008, Joint Commission journal on quality and patient safety.

[32]  Karen A. Blase,et al.  In Search of Program Implementation: 792 Replications of the Teaching-Family Model , 2007 .

[33]  S. Stith,et al.  Implementing Community-Based Prevention Programming: A Review of the Literature , 2006, Journal of Primary Prevention.

[34]  Karen A. Blase,et al.  Implementation Research: A Synthesis of the , 2005 .

[35]  Etienne Wenger,et al.  Learning in Communities , 2010 .

[36]  J. Durlak.  The importance of doing well in whatever you do: A commentary on the special section, “Implementation research in early childhood education” , 2010 .

[37]  M. Greenberg,et al.  Toward dissemination of evidence-based family interventions: maintenance of community-based partnership recruitment results and associated factors. , 2007, Journal of family psychology : JFP : journal of the Division of Family Psychology of the American Psychological Association.

[38]  M. White.  Recovery management and recovery-oriented systems of care: scientific rationale and promising practices. , 2008 .

[39]  C. Turner,et al.  Leadership and team effectiveness in community coalitions for the prevention of alcohol and other drug abuse , 1993 .

[40]  M. Barrera,et al.  Issues and challenges in the design of culturally adapted evidence-based interventions. , 2010, Annual review of clinical psychology.

[41]  A. Faye,et al.  Enhancing Teen Pregnancy Prevention in Local Communities: Capacity Building Using the Interactive Systems Framework , 2012, American journal of community psychology.

[42]  Kevin G. F. Thomas,et al.  A Tale of Two School Districts: Lessons to Be Learned About the Impact of Relationship Building and Ecology on Consultations , 1997 .

[43]  M. Brommels,et al.  Implementing clinical guidelines in psychiatry: a qualitative study of perceived facilitators and barriers , 2010, BMC psychiatry.

[44]  Gene E. Hall,et al.  Implementing Change: Patterns, Principles, and Potholes , 2000 .

[45]  Scott D. Gest,et al.  Implementation Quality: Lessons Learned in the Context of the Head Start REDI Trial. , 2010, Early childhood research quarterly.

[46]  Richard J. Goscha,et al.  Evidence-Based Practice Implementation in Kansas , 2010, Community Mental Health Journal.

[47]  D. Gottfredson,et al.  Quality of School-Based Prevention Programs: Results from a National Survey , 2002 .

[48]  Abraham Wandersman,et al.  Community Science: Bridging the Gap between Science and Practice with Community-Centered Models , 2003, American journal of community psychology.

[49]  W. B. Hansen,et al.  Drug education practice: results of an observational study. , 1999, Health education research.

[50]  Mathea Falco,et al.  A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. , 2003, Health education research.

[51]  Ruth P Saunders,et al.  Examining the link between program implementation and behavior outcomes in the lifestyle education for activity program (LEAP). , 2006, Evaluation and program planning.

[52]  L. Schorr,et al.  Determining "What Works" in Social Programs and Social Policies: Toward a More Inclusive Knowledge Base. , 2003 .

[53]  G. Robert,et al.  Diffusion of innovations in service organizations: systematic review and recommendations. , 2004, The Milbank quarterly.

[54]  A. Bader,et al.  Adopting a surgical safety checklist could save money and improve the quality of care in U.S. hospitals. , 2010, Health affairs.

[55]  M. Greenberg,et al.  Six-Year Sustainability of Evidence-Based Intervention Implementation Quality by Community-University Partnerships: The PROSPER Study , 2011, American journal of community psychology.

[56]  Jeffrey C. Valentine,et al.  Effectiveness of Mentoring Programs for Youth: A Meta-Analytic Review , 2002, American journal of community psychology.

[57]  Abraham Wandersman,et al.  Toward an Evidence-Based System for Innovation Support for Implementing Innovations with Quality: Tools, Training, Technical Assistance, and Quality Assurance/Quality Improvement , 2012, American journal of community psychology.

[58]  Anthony P. Carnevale,et al.  Workplace basics : the essential skills employers want , 1990 .

[59]  Raymond A. Noe,et al.  Employee Training and Development , 2001 .

[60]  C. Cherniss,et al.  Emotional Intelligence: What it is and Why it Matters , 2000 .

[61]  J. Durlak,et al.  Implementation Matters: A Review of Research on the Influence of Implementation on Program Outcomes and the Factors Affecting Implementation , 2008, American journal of community psychology.