Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise

Background: Although several tools to evaluate the credibility of health care guidelines exist, guidance on practical steps for developing guidelines is lacking. We systematically compiled a comprehensive checklist of items linked to relevant resources and tools that guideline developers could consider, without the expectation that every guideline would address each item. Methods: We searched data sources, including manuals of international guideline developers, literature on guidelines for guidelines (with a focus on methodology reports from international and national agencies, and professional societies) and recent articles providing systematic guidance. We reviewed these sources in duplicate, extracted items for the checklist using a sensitive approach and developed overarching topics relevant to guidelines. In an iterative process, we reviewed items for duplication and omissions and involved experts in guideline development for revisions and suggestions for items to be added. Results: We developed a checklist with 18 topics and 146 items and a webpage to facilitate its use by guideline developers. The topics and included items cover all stages of the guideline enterprise, from the planning and formulation of guidelines, to their implementation and evaluation. The final checklist includes links to training materials as well as resources with suggested methodology for applying the items. Interpretation: The checklist will serve as a resource for guideline developers. Consideration of items on the checklist will support the development, implementation and evaluation of guidelines. We will use crowdsourcing to revise the checklist and keep it up to date.

[1]  A. Oxman,et al.  Improving the use of research evidence in guideline development: 9. Grading evidence and recommendations , 2006, Health research policy and systems.

[2]  A. Oxman,et al.  Improving the use of research evidence in guideline development: 8. Synthesis and presentation of evidence , 2006, Health research policy and systems.

[3]  G. Guyatt,et al.  Guideline group composition and group processes: article 3 in Integrating and coordinating efforts in COPD guideline development. An official ATS/ERS workshop report. , 2012, Proceedings of the American Thoracic Society.

[4]  T. Edejer.  Improving the use of research evidence in guideline development: 11. Incorporating considerations of cost-effectiveness, affordability and resource implications , 2006, Health Research Policy and Systems.

[5]  F. Cluzeau,et al.  Development of the AGREE II, part 2: assessment of validity of items and tools to support application , 2010, Canadian Medical Association Journal.

[6]  Wiley Chan,et al.  Transparency matters: Kaiser Permanente's National Guideline Program methodological processes. , 2012, The Permanente journal.

[7]  Andrew D Oxman,et al.  Improving the use of research evidence in guideline development: 2. Priority setting , 2006, Health research policy and systems.

[8]  Aniruddha M. Deshpande,et al.  Standardized Reporting of Clinical Practice Guidelines: A Proposal from the Conference on Guideline Standardization , 2003, Annals of Internal Medicine.

[9]  G. Guyatt,et al.  Reporting and publishing guidelines: article 12 in Integrating and coordinating efforts in COPD guideline development. An official ATS/ERS workshop report. , 2012, Proceedings of the American Thoracic Society.

[10]  Deepak L. Bhatt,et al.  ACCF/AHA clinical practice guideline methodology summit report: a report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines. , 2013, Journal of the American College of Cardiology.

[11]  S. Greenfield,et al.  Clinical practice guidelines we can trust , 2011 .

[12]  A. Oxman,et al.  Improving the use of research evidence in guideline development: 5. Group processes , 2006, Health research policy and systems.

[13]  Andrew D Oxman,et al.  Transparent Development of the WHO Rapid Advice Guidelines , 2007, PLoS medicine.

[14]  Gordon H Guyatt,et al.  GrADe : what is “ quality of evidence ” and why is it important to clinicians ? rATING quALITY of evIDeNCe AND STreNGTH of reCommeNDATIoNS , 2022 .

[15]  A. Horvath,et al.  Grading quality of evidence and strength of recommendations for diagnostic tests and strategies. , 2009, Clinical chemistry.

[16]  G. Guyatt,et al.  Deciding what type of evidence and outcomes to include in guidelines: article 5 in Integrating and coordinating efforts in COPD guideline development. An official ATS/ERS workshop report. , 2012, Proceedings of the American Thoracic Society.

[17]  G. Guyatt,et al.  Use of GRADE grid to reach decisions on clinical practice guidelines when consensus is elusive , 2008, BMJ : British Medical Journal.

[18]  P. Shekelle,et al.  Developing clinical practice guidelines: reviewing, reporting, and publishing guidelines; updating guidelines; and the emerging issues of enhancing guideline implementability and accounting for comorbid conditions in guideline development , 2012, Implementation Science.

[19]  F Guillemin,et al.  EULAR standardised operating procedures for the elaboration, evaluation, dissemination, and implementation of recommendations endorsed by the EULAR standing committees , 2004, Annals of the rheumatic diseases.

[20]  Marilyn J. Field,et al.  COMMITTEE TO ADVISE THE PUBLIC HEALTH SERVICE ON CLINICAL PRACTICE GUIDELINES , 1990 .

[21]  D. Atkins,et al.  Incorporating considerations of cost-effectiveness, affordability, and resource implications in guideline development: article 6 in Integrating and coordinating efforts in COPD guideline development. An official ATS/ERS workshop report. , 2012, Proceedings of the American Thoracic Society.

[22]  A. Oxman,et al.  Improving the use of research evidence in guideline development: 7. Deciding what evidence to include , 2006, Health research policy and systems.

[23]  A. Oxman,et al.  Improving the use of research evidence in guideline development: introduction , 2006, Health research policy and systems.

[24]  P. Shekelle,et al.  Developing clinical practice guidelines: types of evidence and outcomes; values and economics, synthesis, grading, and presentation and deriving recommendations , 2012, Implementation Science.

[25]  S. Greenfield,et al.  COMMITTEE ON STANDARDS FOR DEVELOPING TRUSTWORTHY CLINICAL PRACTICE GUIDELINES , 2011 .

[26]  Andrew D Oxman,et al.  Improving the use of research evidence in guideline development: 1. Guidelines for guidelines , 2006, Health research policy and systems.

[27]  Gordon H Guyatt,et al.  GRADE: grading quality of evidence and strength of recommendations for diagnostic tests and strategies , 2008, BMJ : British Medical Journal.

[28]  V. Carande-Kulis,et al.  Guidelines and Recommendations: A CDC Primer , 2012 .

[29]  H. Schünemann,et al.  Methods for developing evidence-based recommendations by the Advisory Committee on Immunization Practices (ACIP) of the U.S. Centers for Disease Control and Prevention (CDC). , 2011, Vaccine.

[30]  B. Yawn,et al.  Identifying target audiences: who are the guidelines for? : article 1 in Integrating and coordinating efforts in COPD guideline development. An official ATS/ERS workshop report. , 2012, Proceedings of the American Thoracic Society.

[31]  A. Oxman,et al.  Improving the use of research evidence in guideline development: 16. Evaluation , 2006, Health research policy and systems.

[32]  G. Guyatt,et al.  ANTITHROMBOTIC THERAPY AND PREVENTION OF THROMBOSIS, 9TH ED: ACCP GUIDELINES , 2012 .

[33]  A. Oxman,et al.  Health Research Policy and Systems BioMed Central Review Improving the use of research evidence in guideline development: 12. Incorporating considerations of equity , 2006 .

[34]  M. Field,et al.  Guideline funding and conflicts of interest: article 4 in Integrating and coordinating efforts in COPD guideline development. An official ATS/ERS workshop report. , 2012, Proceedings of the American Thoracic Society.

[35]  S. Grieve,et al.  SELECTIVE INHIBITION OF THE MASTER REGULATOR TRANSCRIPTION FACTOR EGR-1 USING CATALYTIC OLIGONUCLEOTIDES REDUCES MYOCARDIAL INJURY AND IMPROVES LV SYSTOLIC FUNCTION IN A PRECLINICAL MODEL OF MYOCARDIAL INFARCTION , 2013 .

[36]  J. Wedzicha,et al.  Stakeholder involvement: how to do it right: article 9 in Integrating and coordinating efforts in COPD guideline development. An official ATS/ERS workshop report. , 2012, Proceedings of the American Thoracic Society.

[37]  E. Boyd,et al.  Improving the use of research evidence in guideline development: 4. Managing conflicts of interests , 2006, Health research policy and systems.

[38]  B. Yawn,et al.  How to integrate multiple comorbidities in guideline development: article 10 in Integrating and coordinating efforts in COPD guideline development. An official ATS/ERS workshop report. , 2012, Proceedings of the American Thoracic Society.

[39]  G. Guyatt,et al.  Going from evidence to recommendations , 2008, BMJ : British Medical Journal.

[40]  A. Oxman,et al.  Improving the use of research evidence in guideline development: 14. Reporting guidelines , 2006, Health research policy and systems.

[41]  B. Yawn,et al.  Adaptation, evaluation, and updating of guidelines: article 14 in Integrating and coordinating efforts in COPD guideline development. An official ATS/ERS workshop report. , 2012, Proceedings of the American Thoracic Society.

[42]  Gene Feder,et al.  Development of the AGREE II, part 1: performance, usefulness and areas for improvement , 2010, Canadian Medical Association Journal.

[43]  Michelle E. Kho,et al.  AGREE II: advancing guideline development, reporting and evaluation in health care , 2010, Canadian Medical Association Journal.

[44]  G. Guyatt,et al.  Integrating values and consumer involvement in guidelines with the patient at the center: article 8 in Integrating and coordinating efforts in COPD guideline development. An official ATS/ERS workshop report. , 2012, Proceedings of the American Thoracic Society.

[45]  A. María.,et al.  Evaluación crítica y recomendaciones a la guía metodológica para la elaboración de guías de atención integral en el sistema general de seguridad social en salud colombiano , 2012 .

[46]  G. Guyatt,et al.  Synthesis, grading, and presentation of evidence in guidelines: article 7 in Integrating and coordinating efforts in COPD guideline development. An official ATS/ERS workshop report. , 2012, Proceedings of the American Thoracic Society.

[47]  P. Shekelle,et al.  Developing clinical practice guidelines: target audiences, identifying topics for guidelines, guideline group composition and functioning and conflicts of interest , 2012, Implementation Science.

[48]  Andrew D Oxman,et al.  Improving the use of research evidence in guideline development , 2007 .

[49]  B. Hofmann.  Toward a procedure for integrating moral issues in health technology assessment , 2005, International Journal of Technology Assessment in Health Care.

[50]  Andrew D Oxman,et al.  Health Research Policy and Systems BioMed Central Review Improving the use of research evidence in guideline development: 13. Applicability, transferability and adaptation , 2006 .

[51]  Kehu Yang,et al.  Editorial: can China master the guideline challenge? , 2013, Health Research Policy and Systems.

[52]  A. Buist,et al.  Priority setting in guideline development: article 2 in Integrating and coordinating efforts in COPD guideline development. An official ATS/ERS workshop report. , 2012, Proceedings of the American Thoracic Society.

[53]  A. Oxman,et al.  Improving the use of research evidence in guideline development: 3. Group composition and consultation process , 2006, Health research policy and systems.

[54]  M. Field.  Setting Priorities for Clinical Practice Guidelines , 1995 .

[55]  A. Buist,et al.  A guide to guidelines for professional societies and other developers of recommendations: introduction to integrating and coordinating efforts in COPD guideline development. An official ATS/ERS workshop report. , 2012, Proceedings of the American Thoracic Society.

[56]  M. Field,et al.  Clinical practice guidelines : directions for a new program , 1990 .

[57]  Sarah E. Rosenbaum,et al.  Developing and evaluating communication strategies to support informed decisions and practice based on evidence (DECIDE): protocol and preliminary results , 2013, Implementation Science.

[58]  G. Guyatt,et al.  Grading quality of evidence and strength of recommendations , 2004, BMJ : British Medical Journal.

[59]  Gordon H. Guyatt,et al.  Moving from evidence to developing recommendations in guidelines: article 11 in Integrating and coordinating efforts in COPD guideline development. An official ATS/ERS workshop report. , 2012, Proceedings of the American Thoracic Society.

[60]  Gordon H Guyatt,et al.  Incorporating considerations of resources use into grading recommendations , 2008, BMJ : British Medical Journal.

[61]  A. Oxman,et al.  Improving the use of research evidence in guideline development: 10. Integrating values and consumer involvement , 2006, Health research policy and systems.

[62]  G. Guyatt,et al.  GRADE: an emerging consensus on rating quality of evidence and strength of recommendations , 2008, BMJ : British Medical Journal.

[63]  A. Oxman,et al.  Improving the use of research evidence in guideline development: 15. Disseminating and implementing guidelines , 2006, Health research policy and systems.

[64]  D. Cook,et al.  Disseminating and implementing guidelines: article 13 in Integrating and coordinating efforts in COPD guideline development. An official ATS/ERS workshop report. , 2012, Proceedings of the American Thoracic Society.

[65]  Günter Ollenschläger,et al.  Guidelines International Network: Toward International Standards for Clinical Practice Guidelines , 2012, Annals of Internal Medicine.