Tools developed and disseminated by guideline producers to promote the uptake of their guidelines.

BACKGROUND The uptake of clinical practice guidelines (CPGs) is inconsistent, despite their potential to improve the quality of health care and patient outcomes. Some guideline producers have addressed this problem by developing tools to encourage faster adoption of new guidelines. This review focuses on the effectiveness of tools developed and disseminated by guideline producers to improve the uptake of their CPGs. OBJECTIVES To evaluate the effectiveness of implementation tools developed and disseminated by guideline producers, which accompany or follow the publication of a CPG, to promote uptake. A secondary objective is to determine which approaches to guideline implementation are most effective. SEARCH METHODS We searched the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register, Cochrane Central Register of Controlled Trials (CENTRAL); NHS Economic Evaluation Database, HTA Database; MEDLINE and MEDLINE In-Process and other non-indexed citations; Embase; PsycINFO; CINAHL; Dissertations and Theses, ProQuest; Index to Theses; Science Citation Index Expanded, ISI Web of Knowledge; Conference Proceedings Citation Index - Science, ISI Web of Knowledge; Health Management Information Consortium (HMIC), and NHS Evidence up to February 2016. We also searched trials registers, reference lists of included studies and relevant websites. SELECTION CRITERIA We included randomised controlled trials (RCTs) and cluster-RCTs, controlled before-and-after studies (CBAs) and interrupted time series (ITS) studies evaluating the effects of guideline implementation tools developed by recognised guideline producers to improve the uptake of their own guidelines. The guideline could target any clinical area. DATA COLLECTION AND ANALYSIS Two review authors independently extracted data and assessed the risk of bias of each included study using the Cochrane 'Risk of bias' criteria. We graded our confidence in the evidence using the approach recommended by the GRADE working group. The clinical conditions targeted and the implementation tools used were too heterogenous to combine data for meta-analysis. We report the median absolute risk difference (ARD) and interquartile range (IQR) for the main outcome of adherence to guidelines. MAIN RESULTS We included four cluster-RCTs that were conducted in the Netherlands, France, the USA and Canada. These studies evaluated the effects of tools developed by national guideline producers to implement their CPGs. The implementation tools evaluated targeted healthcare professionals; none targeted healthcare organisations or patients.One study used two short educational workshops tailored to barriers. In three studies the intervention consisted of the provision of paper-based educational materials, order forms or reminders, or both. The clinical condition, type of healthcare professional, and behaviour targeted by the CPG varied across studies.Two of the four included studies reported data on healthcare professionals' adherence to guidelines. A guideline tool developed by the producers of a guideline probably leads to increased adherence to the guidelines; median ARD (IQR) was 0.135 (0.115 and 0.159 for the two studies respectively) at an average four-week follow-up (moderate certainty evidence), which indicates a median 13.5% greater adherence to guidelines in the intervention group. Providing healthcare professionals with a tool to improve implementation of a guideline may lead to little or no difference in costs to the health service. AUTHORS' CONCLUSIONS Implementation tools developed by recognised guideline producers probably lead to improved healthcare professionals' adherence to guidelines in the management of non-specific low back pain and ordering thyroid-function tests. There are limited data on the relative costs of implementing these interventions.There are no studies evaluating the effectiveness of interventions targeting the organisation of care (e.g. benchmarking tools, costing templates, etc.), or for mass media interventions. We could not draw any conclusions about our second objective, the comparative effectiveness of implementation tools, due to the small number of studies, the heterogeneity between interventions, and the clinical conditions that were targeted.

[1]  A. Oxman,et al.  Rational Prescribing in Primary Care (RaPP-trial). A randomised trial of a tailored intervention to improve prescribing of antihypertensive and cholesterol-lowering drugs in general practice [ISRCTN48751230] , 2003, BMC health services research.

[2]  M. Kanter,et al.  Proactive office encounter: a systematic approach to preventive and chronic care at every patient encounter. , 2010, The Permanente journal.

[3]  G. Smith,et al.  Bias in meta-analysis detected by a simple, graphical test , 1997, BMJ.

[4]  Derek P de Beurs,et al.  The effect of an e-learning supported Train-the-Trainer programme on implementation of suicide guidelines in mental health care. , 2015, Journal of affective disorders.

[5]  Rose M. Allinder,et al.  Translating Research Into Practice , 2001 .

[6]  J. Grimshaw,et al.  Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations , 1993, The Lancet.

[7]  G. Guyatt,et al.  GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. , 2011, Journal of clinical epidemiology.

[8]  William DuMouchel,et al.  A meta-analysis of 16 randomized controlled trials to evaluate computer-based clinical reminder systems for preventive care in the ambulatory setting. , 1996, Journal of the American Medical Informatics Association : JAMIA.

[9]  Trisha Greenhalgh,et al.  Diffusion of innovations in health service organisations , 2005 .

[10]  A D Oxman,et al.  Changing physician performance. A systematic review of the effect of continuing medical education strategies. , 1995, JAMA.

[11]  A. Oxman,et al.  Rational Prescribing in Primary care (RaPP): process evaluation of an intervention to improve prescribing of antihypertensive and cholesterol-lowering drugs , 2006, Implementation science : IS.

[12]  O. Lesnyak,et al.  THU0451 Implementation of the osteoarthritis clinical guideline: Results of a cluster randomized trial in primary care , 2013 .

[13]  E. McGlynn,et al.  How good is the quality of health care in the United States? , 1998, The Milbank quarterly.

[14]  Noelle Robertson,et al.  Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. , 2010, The Cochrane database of systematic reviews.

[15]  A. Taylor-Vaisey,et al.  Translating guidelines into practice. A systematic review of theoretic concepts, practical experience and research evidence in the adoption of clinical practice guidelines. , 1997, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[16]  K. Vissers,et al.  Rationale, design, and implementation protocol of the Dutch clinical practice guideline Pain in patients with cancer: a cluster randomised controlled trial with short message service (SMS) and interactive voice response (IVR) , 2011, Implementation science : IS.

[17]  D. Knol,et al.  Effect on the process of care of an active strategy to implement clinical guidelines on physiotherapy for low back pain: a cluster randomised controlled trial , 2005, Quality and Safety in Health Care.

[18]  C. Chambers,et al.  197: Implementing Best Practices for Vaccination Pain Management , 2014 .

[19]  M. Eccles,et al.  Is untargeted educational outreach visiting delivered by pharmaceutical advisers effective in primary care? A pragmatic randomized controlled trial , 2007, Implementation science : IS.

[20]  M. Eccles,et al.  Welcome to Implementation Science , 2006, Implementation Science.

[21]  P. Michel,et al.  [Medico-economic assessment of two methods for implementing thyroid testing guidelines]. , 2005, Revue d'epidemiologie et de sante publique.

[22]  Didier Pittet,et al.  Global implementation of WHO's multimodal strategy for improvement of hand hygiene: a quasi-experimental study. , 2013, The Lancet. Infectious diseases.

[23]  J. Birdsell,et al.  Health researchers in Alberta: an exploratory comparison of defining characteristics and knowledge translation activities , 2007, Implementation science : IS.

[24]  P. Plsek,et al.  Collaborative quality improvement to promote evidence based surfactant for preterm infants: a cluster randomised trial , 2004, BMJ : British Medical Journal.

[25]  M. Smith,et al.  Improving quality of care for acute myocardial infarction: The Guidelines Applied in Practice (GAP) Initiative. , 2002 .

[26]  S. Weingarten,et al.  Translating practice guidelines into patient care : guidelines at the bedside. , 2000, Chest.

[27]  Louise Lemieux-Charles,et al.  How can we improve guideline use? A conceptual framework of implementability , 2011, Implementation science : IS.

[28]  K. Hood,et al.  General practitioners' use of magnetic resonance imaging: an open randomized trial comparing telephone and written requests and an open randomized controlled trial of different methods of local guideline dissemination. , 2002, Clinical radiology.

[29]  Richard N. Shiffman,et al.  Bmc Medical Informatics and Decision Making the Guideline Implementability Appraisal (glia): Development of an Instrument to Identify Obstacles to Guideline Implementation , 2022 .

[30]  R. Grol,et al.  Implementing guidelines and innovations in general practice: which interventions are effective? , 1998, The British journal of general practice : the journal of the Royal College of General Practitioners.

[31]  M. Eccles,et al.  Tailored interventions to address determinants of practice. , 2015, The Cochrane database of systematic reviews.

[32]  J. W. Thomas.  Quality of care: measure with caution. , 1990, QRB. Quality review bulletin.

[33]  H. Hearnshaw,et al.  Randomised controlled trial of tailored strategies to implement guidelines for the management of patients with depression in general practice. , 2001, The British journal of general practice : the journal of the Royal College of General Practitioners.

[34]  J M Grimshaw,et al.  Effectiveness and efficiency of guideline dissemination and implementation strategies , 2004, International Journal of Technology Assessment in Health Care.

[35]  S C Schoenbaum,et al.  Implementing clinical guidelines: a quality management approach to reminder systems. , 1992, QRB. Quality review bulletin.

[36]  J. Swan,et al.  Mind the gap: Understanding utilisation of evidence and policy in health care management practice. , 2011, Journal of health organization and management.

[37]  A D Oxman,et al.  Educational outreach visits: effects on professional practice and health care outcomes. , 2007, The Cochrane database of systematic reviews.

[38]  C. Chambers,et al.  Reducing the pain of childhood vaccination: an evidence-based clinical practice guideline (summary) , 2010, Canadian Medical Association Journal.

[39]  Elie A Akl,et al.  Educational games for health professionals. , 2013, The Cochrane database of systematic reviews.

[40]  D. D. De Beurs,et al.  Reducing patients’ suicide ideation through training mental health teams in the application of the Dutch multidisciplinary practice guideline on assessment and treatment of suicidal behavior: study protocol of a randomized controlled trial , 2013, Trials.

[41]  B. Koes,et al.  Dutch Physiotherapy Guidelines for Low Back Pain , 2003 .

[42]  Jeffrey K Aronson,et al.  The road to health care , 2004, BMJ : British Medical Journal.

[43]  Mor Peleg,et al.  Extending the GuideLine Implementability Appraisal (GLIA) instrument to identify problems in control flow. , 2010, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[44]  M. Eccles,et al.  Evidence-based guideline on the primary care management of asthma. , 2001, Family practice.

[45]  Aziz A. Boxwala,et al.  Representation primitives, process models and patient data in computer-interpretable clinical practice guidelines: : A literature review of guideline representation models , 2002, Int. J. Medical Informatics.

[46]  Andrew D Oxman,et al.  Cluster randomised controlled trial of tailored interventions to improve the management of urinary tract infections in women and sore throat , 2002, BMJ : British Medical Journal.

[47]  L. Franck,et al.  Usability and knowledge testing of educational tools about infant vaccination pain management directed to postnatal nurses , 2015, BMC medical education.

[48]  J. Grimshaw,et al.  Tailored implementation for chronic diseases (TICD): A project protocol , 2011, Implementation science : IS.

[49]  Andrew D Oxman,et al.  Rational Prescribing in Primary Care (RaPP): Economic Evaluation of an Intervention to Improve Professional Practice , 2006, PLoS Medicine.

[50]  J. Grimshaw,et al.  Printed educational materials: effects on professional practice and healthcare outcomes. , 2012, The Cochrane database of systematic reviews.

[51]  C. Gale,et al.  Prevention of age related macular degeneration , 2002, BMJ : British Medical Journal.

[52]  J. Grimshaw,et al.  Developing clinically valid practice guidelines. , 1995, Journal of evaluation in clinical practice.

[53]  Martin Marshall,et al.  Systematic review of studies of quality of clinical care in general practice in the UK, Australia and New Zealand , 2001 .

[54]  S. Flottorp,et al.  Identifying barriers and tailoring interventions to improve the management of urinary tract infections and sore throat: a pragmatic study using qualitative methods , 2003, BMC health services research.

[55]  Paul Taylor,et al.  Research Paper: Use of a Computerized Guideline for Glucose Regulation in the Intensive Care Unit Improved Both Guideline Adherence and Glucose Regulation , 2004, J. Am. Medical Informatics Assoc..

[56]  Trisha Greenhalgh,et al.  Diffusion of Innovations in Health Service Organisations: A Systematic Literature Review , 2007 .

[57]  J. Grimshaw,et al.  Implementing evidence-based recommended practices for the management of patients with mild traumatic brain injuries in Australian emergency care departments: study protocol for a cluster randomised controlled trial , 2014, Trials.

[58]  Elena Parmelli,et al.  Local opinion leaders: effects on professional practice and health care outcomes. , 2011, The Cochrane database of systematic reviews.

[59]  C. Ramsay,et al.  Mass media interventions: effects on health services utilisation. , 2002, The Cochrane database of systematic reviews.

[60]  D. Kendrick,et al.  A cluster randomised controlled trial of the effect of a treatment algorithm for hypertension in patients with type 2 diabetes. , 2007, The British journal of general practice : the journal of the Royal College of General Practitioners.

[61]  B. Allegranzi,et al.  The WHO Clean Care is Safer Care programme: field-testing to enhance sustainability and spread of hand hygiene improvements. , 2008, Journal of infection and public health.

[62]  M. Fine,et al.  Implementation of an evidence-based guideline to reduce duration of intravenous antibiotic therapy and length of stay for patients hospitalized with community-acquired pneumonia: a randomized controlled trial. , 2003, The American journal of medicine.

[63]  E. Adang,et al.  Electronic reminders for pathologists promote recognition of patients at risk for Lynch syndrome: cluster-randomised controlled trial , 2010, Virchows Archiv.

[64]  Catherine H. Yu,et al.  Effect of an Educational Toolkit on Quality of Care: A Pragmatic Cluster Randomized Trial , 2014, PLoS medicine.

[65]  J. De Maeseneer,et al.  What is the role of quality circles in strategies to optimise antibiotic prescribing? A pragmatic cluster-randomised controlled trial in primary care , 2007, Quality and Safety in Health Care.

[66]  Michelle E. Kho,et al.  AGREE II: advancing guideline development, reporting and evaluation in health care , 2010, Canadian Medical Association Journal.

[67]  L. Everett,et al.  Translating research into practice intervention improves management of acute pain in older hip fracture patients. , 2009, Health services research.

[68]  Luke Vale,et al.  Toward evidence-based quality improvement. Evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies 1966-1998. , 2006, Journal of general internal medicine.

[69]  Lars Wallin,et al.  Individual determinants of research utilization by nurses: a systematic review update , 2011, Implementation science : IS.

[70]  J. Grimshaw,et al.  From best evidence to best practice: effective implementation of change in patients' care , 2003, The Lancet.

[71]  J. Wyatt,et al.  Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide , 2014, BMJ : British Medical Journal.

[72]  Derek de Beurs,et al.  An e-learning supported train-the-trainer program to implement a suicide practice guideline: Rationale, content and dissemination in Dutch mental health care , 2015 .

[73]  M. Eccles,et al.  Evidence-based guideline for the primary care management of stable angina. , 2001 .

[74]  Jane M. Young,et al.  Audit and feedback: effects on professional practice and healthcare outcomes. , 2012, The Cochrane database of systematic reviews.

[75]  A. Taddio,et al.  Implementation of a new clinical practice guideline regarding pain management during childhood vaccine injections. , 2013, Paediatrics & child health.

[76]  N. Crichton,et al.  A pragmatic cluster randomised trial evaluating three implementation interventions , 2012, Implementation Science.

[77]  Fredric Wolf,et al.  Continuing education meetings and workshops: effects on professional practice and health care outcomes. , 2009, The Cochrane database of systematic reviews.

[78]  E. Hendriks,et al.  Cost-effectiveness of an active implementation strategy for the Dutch physiotherapy guideline for low back pain. , 2005, Health policy.

[79]  Andrew D Oxman,et al.  Rational Prescribing in Primary Care (RaPP): A Cluster Randomized Trial of a Tailored Intervention , 2006, PLoS medicine.

[80]  Andrew D Oxman,et al.  Closing the gap between research and practice : an overview of systematic reviews of interventions to promote the implementation of research findings , 2011 .

[81]  A. Mayhew,et al.  Interventions to improve professional adherence to guidelines for prevention of device-related infections. , 2013, The Cochrane database of systematic reviews.

[82]  S. Ditlevsen,et al.  Academic detailing has no effect on prescribing of asthma medication in Danish general practice: a 3-year randomized controlled trial with 12-monthly follow-ups. , 2004, Family practice.

[83]  M. Field,et al.  Clinical practice guidelines : directions for a new program , 1990 .

[84]  I. McManus,et al.  Cross-comparison of MRCGP & MRCP(UK) in a database linkage study of 2,284 candidates taking both examinations: assessment of validity and differential performance by ethnicity , 2015, BMC medical education.

[85]  David Parkin,et al.  Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial , 2002, BMJ : British Medical Journal.

[86]  J. Brophy,et al.  Drug treatment of stable angina pectoris and mass dissemination of therapeutic guidelines: a randomized controlled trial. , 2004, QJM : monthly journal of the Association of Physicians.

[87]  J. Twisk,et al.  Improving the application of a practice guideline for the assessment and treatment of suicidal behavior by training the full staff of psychiatric departments via an e-learning supported Train-the-Trainer program: study protocol for a randomized controlled trial , 2013, Trials.

[88]  P. Michel,et al.  A Multicenter Cluster Randomized Controlled Trial of Strategies to Improve Thyroid Function Testing , 2003, Medical care.

[89]  Catherine H. Yu,et al.  Evaluation of a toolkit to improve cardiovascular disease screening and treatment for people with type 2 diabetes: protocol for a cluster-randomized pragmatic trial , 2010, Trials.

[90]  K. Shojania,et al.  The effects of on-screen, point of care computer reminders on processes and outcomes of care. , 2009, The Cochrane database of systematic reviews.

[91]  K. Schulman,et al.  Toward estimating the impact of changes in immigrants' insurance eligibility on hospital expenditures for uncompensated care , 2003, BMC health services research.