Toward an Evidence-Based System for Innovation Support for Implementing Innovations with Quality: Tools, Training, Technical Assistance, and Quality Assurance/Quality Improvement

An individual or organization that sets out to implement an innovation (e.g., a new technology, program, or policy) generally requires support. In the Interactive Systems Framework for Dissemination and Implementation, a Support System should work with Delivery Systems (national, state and/or local entities such as health and human service organizations, community-based organizations, schools) to enhance their capacity for quality implementation of innovations. The literature on the Support ystem has been under-researched and under-developed. This article begins to conceptualize theory, research, and action for an evidence-based system for innovation support (EBSIS). EBSIS describes key priorities for strengthening the science and practice of support. The major goal of EBSIS is to enhance the research and practice of support in order to build capacity in the Delivery System for implementing innovations with quality, and thereby, help the Delivery System achieve outcomes. EBSIS is guided by a logic model that includes four key support components: tools, training, technical assistance, and quality assurance/quality improvement. EBSIS uses the Getting To Outcomes approach to accountability to aid the identification and synthesis of concepts, tools, and evidence for support. We conclude with some discussion of the current status of EBSIS and possible next steps, including the development of collaborative researcher-practitioner-funder-consumer partnerships to accelerate accumulation of knowledge on the Support System.

[1]  P. Drucker.  Classic Drucker : essential wisdom of Peter Drucker from the pages of Harvard Business Review. , 2006 .

[2]  Winston Bennett,et al.  A META-ANALYSIS OF THE RELATIONS AMONG TRAINING CRITERIA , 1997 .

[3]  D. Simpson,et al.  Counselor assessments of training and adoption barriers. , 2007, Journal of substance abuse treatment.

[4]  A Donabedian,et al.  The effectiveness of quality assurance. , 1996, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[5]  Gregory H. Dobbins,et al.  THE EFFECTS OF ACCOUNTABILITY ON TRAINING EFFECTIVENESS. , 1994 .

[6]  Jens Rowold,et al.  Individual Influences on Knowledge Acquisition in a Call Center Training Context in Germany , 2007 .

[7]  J. Stevenson,et al.  Building evaluation capacity in human service organizations: a case study , 2002 .

[8]  C. MacAulay,et al.  A framework for institutionalizing quality assurance. , 2002, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[9]  Rudolph Corvini,et al.  Training in Business and Industry. , 1962 .

[10]  Les Gasser,et al.  Assessing Information Quality of a Community-Based Encyclopedia , 2005, ICIQ.

[11]  S L George,et al.  Guidelines for quality assurance in multicenter trials: a position paper. , 1998, Controlled clinical trials.

[12]  M. Greenberg,et al.  Toward dissemination of evidence-based family interventions: maintenance of community-based partnership recruitment results and associated factors. , 2007, Journal of family psychology : JFP : journal of the Division of Family Psychology of the American Psychological Association.

[13]  Paul Florin,et al.  Cultivating Capacity , 2004 .

[14]  K. Shojania,et al.  Evidence-based quality improvement: the state of the science. , 2005, Health affairs.

[15]  Abraham Wandersman,et al.  Getting to outcomes: a results-based approach to accountability , 2000 .

[16]  Ronald P. Anjard,et al.  SPC chart selection process , 1995 .

[17]  S. Mumtaz.  Factors affecting teachers' use of information and communications technology: a review of the literature , 2000 .

[18]  Donald J. McCubbrey,et al.  Management Information Systems for the Information Age , 1997 .

[19]  J. Sieber.  When Academicians Collaborate With Community Agencies in Effectiveness Research , 2008 .

[20]  Siep Thomas,et al.  Attributes of clinical guidelines that influence use of guidelines in general practice: observational study , 1998, BMJ.

[21]  Diane M. Strong,et al.  AIMQ: a methodology for information quality assessment , 2002, Inf. Manag..

[22]  E. Antman,et al.  Adherence to national guidelines for drug treatment of suspected acute myocardial infarction: evidence for undertreatment in women and the elderly. , 1996, Archives of internal medicine.

[23]  A. Gawande,et al.  The Checklist Manifesto: How to Get Things Right , 2011 .

[24]  Peter Bramley,et al.  Evaluating training effectiveness : translating theory into practice , 1990 .

[25]  P. Wesley,et al.  Supporting Early Childhood Inclusion , 1996 .

[26]  Jennifer Duffy,et al.  Unpacking Prevention Capacity: An Intersection of Research-to-practice Models and Community-centered Models , 2008, American journal of community psychology.

[27]  Gary Uhl,et al.  Increasing evaluation capacity within community-based HIV prevention programs , 2002 .

[28]  A. Wandersman,et al.  Advances in Bridging Research and Practice: Introduction to the Second Special Issue on the Interactive System Framework for Dissemination and Implementation , 2012, American journal of community psychology.

[29]  D. King,et al.  Redesigning emergency department patient flows: Application of Lean Thinking to health care , 2006, Emergency medicine Australasia : EMA.

[30]  Jennifer Preece,et al.  Usability and learning: Evaluating the potential of educational software , 1996, Comput. Educ..

[31]  M. Salyers,et al.  The Role of Technical Assistance Centers in Implementing Evidence-Based Practices: Lessons Learned , 2007 .

[32]  Sarah J. Swanson,et al.  Strategies for state-wide implementation of supported employment: the Johnson & Johnson-Dartmouth Community Mental Health Program. , 2008, Psychiatric rehabilitation journal.

[33]  Pedro Antunes,et al.  Developing a tool to assist electronic facilitation of decision-making groups , 1999, 6th International Symposium on String Processing and Information Retrieval. 5th International Workshop on Groupware (Cat. No.PR00268).

[34]  David R. Holtgrave,et al.  Bridging the gap between the science and service of HIV prevention: transferring effective research-based HIV prevention interventions to community AIDS service providers. , 2000, American journal of public health.

[35]  R. Mitchell,et al.  Identifying training and technical assistance needs in community coalitions: a developmental approach. , 1993, Health education research.

[36]  A. Faye,et al.  Enhancing Teen Pregnancy Prevention in Local Communities: Capacity Building Using the Interactive Systems Framework , 2012, American journal of community psychology.

[37]  J. Durlak,et al.  Implementation Matters: A Review of Research on the Influence of Implementation on Program Outcomes and the Factors Affecting Implementation , 2008, American journal of community psychology.

[38]  D. Kirkpatrick.  Techniques for evaluating training programs , 1979 .

[39]  S. Kegeles,et al.  Challenges and facilitators to building program evaluation capacity among community-based organizations. , 2005, AIDS education and prevention : official publication of the International Society for AIDS Education.

[40]  W. P. Ryan,et al.  High Performance Nonprofit Organizations: Managing Upstream for Greater Impact , 1998 .

[41]  Web-Based Technical Assistance and Training to Promote Community Tobacco Control Policy Change , 2006, Health promotion practice.

[42]  F. Butterfoss.  The Coalition Technical Assistance and Training Framework: Helping Community Coalitions Help Themselves , 2004, Health promotion practice.

[43]  B. Kitchenham,et al.  Case Studies for Method and Tool Evaluation , 1995, IEEE Softw..

[44]  Yoshikazu Nakamura,et al.  Revision of diagnostic guidelines for Kawasaki disease (the 5th revised edition) , 2005, Pediatrics international : official journal of the Japan Pediatric Society.

[45]  T. Churches.  A proposed architecture and method of operation for improving the protection of privacy and confidentiality in disease registers , 2003, BMC medical research methodology.

[46]  Myriam Hamdallah,et al.  The diffusion of effective behavioral interventions project: development, implementation, and lessons learned. , 2006, AIDS education and prevention : official publication of the International Society for AIDS Education.

[47]  Abigail A Fagan,et al.  Bridging Science to Practice: Achieving Prevention Program Implementation Fidelity in the Community Youth Development Study , 2008, American journal of community psychology.

[48]  M. Salzer,et al.  Delivering effective children's services in the community: Reconsidering the benefits of system interventions , 1997 .

[49]  Duncan C. Meyers,et al.  Using a Training-of-Trainers Approach and Proactive Technical Assistance to Bring Evidence Based Programs to Scale: An Operationalization of the Interactive Systems Framework’s Support System , 2012, American journal of community psychology.

[50]  Abraham Wandersman,et al.  Practical Implementation Science: Developing and Piloting the Quality Implementation Tool , 2012, American journal of community psychology.

[51]  Wei‐Tao Tai.  Effects of training framing, general self‐efficacy and training motivation on trainees' training effectiveness , 2006 .

[52]  David Lorge Parnas,et al.  The Role of Inspection in Software Quality Assurance , 2003, IEEE Trans. Software Eng..

[53]  Cathie Furman,et al.  Applying the Toyota Production System: using a patient safety alert system to reduce error. , 2007, Joint Commission journal on quality and patient safety.

[54]  Katherine Irwin,et al.  Blueprints for Violence Prevention , 2003 .

[55]  B. Joyce,et al.  Student Achievement Through Staff Development , 1988 .

[56]  Elizabeth Agius,et al.  Organizational capacity building: addressing a research and practice gap. , 2007, Evaluation and program planning.

[57]  Rhonda K. Lewis,et al.  Using empowerment theory in collaborative partnerships for community health and development , 1995, American journal of community psychology.

[58]  Theodore Speroff,et al.  Study Designs for PDSA Quality Improvement Research , 2004, Quality management in health care.

[59]  John D. Hamilton,et al.  A Measurement Feedback System ( MFS ) Is Necessary to Improve Mental Health Outcomes , 2008 .

[60]  A. Young,et al.  An Instrument to Assess Competencies of Providers Treating Severe Mental Illness , 2003, Mental health services research.

[61]  Elliott N. Weiss,et al.  Mapping the Value Stream , 2014 .

[62]  Áine McConnon,et al.  The Internet for weight control in an obese sample: results of a randomised controlled trial , 2007, BMC Health Services Research.

[63]  F. Butterfoss.  Coalitions and Partnerships in Community Health , 2007 .

[64]  Roger E Mitchell,et al.  Supporting Community-Based Prevention and Health Promotion Initiatives: Developing Effective Technical Assistance Systems , 2002, Health education & behavior : the official publication of the Society for Public Health Education.

[65]  Vincent S. Lai,et al.  Evaluating end-user training programs , 2005, CACM.

[66]  E. Antman,et al.  Adherence to national guidelines for drug treatment of suspected acute myocardial infarction: evidence for undertreatment in women and the elderly. , 1996, Archives of internal medicine.

[67]  J. Mathieu,et al.  Toward Theoretically Based Principles of Training Effectiveness: A Model and Initial Empirical Investigation , 1995 .

[68]  H. Kraemer,et al.  A new approach to integrating data from multiple informants in psychiatric assessment and research: mixing and matching contexts and perspectives. , 2003, The American journal of psychiatry.

[69]  J M Grimshaw,et al.  Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. , 1994, Lancet.

[70]  D. Wayne Osgood,et al.  Readiness, Functioning, and Perceived Effectiveness in Community Prevention Coalitions: A Study of Communities That Care , 2004, American journal of community psychology.

[71]  Katherine Irwin,et al.  Blueprints for Violence Prevention , 2001 .

[72]  G. McGough.  The checklist manifesto: how to get things right Atul Gawande The checklist manifesto: how to get things right Metropolitan Books £12.99 224pp 9780805091748 0805091742 , 2010 .

[73]  Bahaman Abu Samah,et al.  Factors Affecting Teachers' Use of Information and Communication Technology. , 2009 .

[74]  R. Resar,et al.  Basics of quality improvement in health care. , 2007, Mayo Clinic proceedings.

[75]  N. Cullum,et al.  Guidelines in professions allied to medicine. , 1999, The Cochrane database of systematic reviews.

[76]  Raymond A. Noe,et al.  Employee Training and Development , 2001 .

[77]  K. Dodge,et al.  Preventing child maltreatment: community approaches. , 2009 .

[78]  Quality Toolbox: Improving Clinical Interventions Through Successful Outreach Using Six Sigma Quality Improvement , 2008, Journal for healthcare quality : official publication of the National Association for Healthcare Quality.

[79]  Dan S. Chiaburu,et al.  Leader Influences on Training Effectiveness: Motivation and Outcome Expectation Processes , 2008 .

[80]  R. J. Haylett.  The basics of quality , 1986 .

[81]  A. Wandersman,et al.  The Getting To Outcomes Demonstration and Evaluation: An Illustration of the Prevention Support System , 2008, American journal of community psychology.

[82]  R. Grol,et al.  Systems for quality improvement in general practice : a survey of 26 countries , 1997 .

[83]  A. Wandersman,et al.  Developing a Community Science Research Agenda for Building Community Capacity for Effective Preventive Interventions , 2005, American journal of community psychology.

[84]  A. Wandersman,et al.  Developing a Prevention Synthesis and Translation System to Promote Science-Based Approaches to Teen Pregnancy, HIV and STI Prevention , 2012, American journal of community psychology.

[85]  Dean L. Fixsen,et al.  Core Implementation Components , 2009 .

[86]  Rosemary Rushmer,et al.  A systematic narrative review of quality improvement models in health care , 2009 .

[87]  M H Trivedi,et al.  Development and Implementation of Computerized Clinical Guidelines: Barriers and Solutions , 2002, Methods of Information in Medicine.

[88]  Jennifer Duffy,et al.  Bridging the Gap Between Prevention Research and Practice: The Interactive Systems Framework for Dissemination and Implementation , 2008, American journal of community psychology.

[89]  M. Greenberg,et al.  The Longitudinal Effect of Technical Assistance Dosage on the Functioning of Communities That Care Prevention Boards in Pennsylvania , 2008, The Journal of Primary Prevention.

[90]  Chrim Scivyer,et al.  THE DEVELOPMENT AND IMPLEMENTATION , 2022 .

[91]  J. Grimshaw,et al.  Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations , 1993, The Lancet.

[92]  E. S. Rogers,et al.  Effectiveness of technical assistance in the development of psychiatric rehabilitation programs , 2006, The journal of mental health administration.

[93]  Diane M. Strong,et al.  Information quality benchmarks: product and service performance , 2002, CACM.

[94]  Anthony P. Carnevale,et al.  Workplace basics : the essential skills employers want , 1990 .

[95]  Peter Bramley,et al.  Evaluating Training against Business Criteria , 1994 .

[96]  Michael W. Arthur,et al.  Installing the communities that care prevention system: implementation progress and fidelity in a randomized controlled trial , 2008 .

[97]  M. Yasin,et al.  The role of benchmarking in achieving continuous service quality , 1995 .

[98]  Gene E. Hall,et al.  Implementing Change: Patterns, Principles, and Potholes , 2000 .

[99]  Evidence-based patient choice and psychiatry , 2002, Evidence-based mental health.

[100]  P. Bossuyt,et al.  BMC Medical Research Methodology , 2002 .

[101]  Stefano Mizzaro,et al.  Quality control in scholarly publishing: A new proposal , 2003, J. Assoc. Inf. Sci. Technol..

[102]  G. Eysenbach,et al.  Evidence-based Patient Choice and Consumer health informatics in the Internet age , 2001, Journal of medical Internet research.

[103]  S. Kegeles,et al.  The role of technical assistance in the replication of effective HIV interventions. , 2000, AIDS education and prevention : official publication of the International Society for AIDS Education.

[104]  A. Kitson,et al.  Achieving improvement through quality: an evaluation of key factors in the implementation process. , 1996, Journal of advanced nursing.

[105]  S. Cretin,et al.  Total quality management in hospitals: the contributions of commitment, quality councils, teams, budgets, and training to perceived improvement at Veterans Health Administration hospitals. , 1996, Medical care.

[106]  M. Knowles.  The Modern practice of adult education : andragogy versus pedagogy / , 1970 .