Evaluation of clinical practice guidelines using the AGREE instrument: comparison between data obtained from AGREE I and AGREE II

ObjectiveThe Appraisal of Guidelines for Research and Evaluation (AGREE) is a representative, quantitative evaluation tool for evidence-based clinical practice guidelines (CPGs). Recently, AGREE was revised (AGREE II). The continuity of evaluation data obtained from the original version (AGREE I) has not yet been demonstrated. The present study investigated the relationship between data obtained from AGREE I and AGREE II to evaluate the continuity between the two measurement tools.ResultsAn evaluation team consisting of three trained librarians evaluated 68 CPGs issued in 2011–2012 in Japan using AGREE I and AGREE II. The correlation coefficients for the six domains were: (1) scope and purpose 0.758; (2) stakeholder involvement 0.708; (3) rigor of development 0.982; (4) clarity of presentation 0.702; (5) applicability 0.919; and (6) editorial independence 0.971. The item “Overall Guideline Assessment” was newly introduced in AGREE II. This global item had a correlation coefficient of 0.628 using the six AGREE I domains, and 0.685 using the 23 items. Our results suggest that data obtained from AGREE I can be transferred to AGREE II, and the “Overall Guideline Assessment” data can be determined with high reliability using a standardized score of the 23 items.

[1]  T Philip,et al.  International assessment of the quality of clinical practice guidelines in oncology using the Appraisal of Guidelines and Research and Evaluation Instrument. , 2004, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[2]  Michelle E. Kho,et al.  AGREE II: advancing guideline development, reporting and evaluation in health care , 2010, Canadian Medical Association Journal.

[3]  Gene Feder,et al.  Development of the AGREE II, part 1: performance, usefulness and areas for improvement , 2010, Canadian Medical Association Journal.

[4]  Jeffrey W. Jutai,et al.  A Systematic Critical Appraisal of Clinical Practice Guidelines in Juvenile Idiopathic Arthritis Using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) Instrument , 2015, PloS one.

[5]  G. Feder,et al.  Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project , 2003, Quality & safety in health care.

[6]  F. Cluzeau,et al.  Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project , 2003 .

[7]  Naohito Yamaguchi,et al.  Preferred Information Media for Providing Clinical Practice Guidelines to Physicians in Japan : A Needs Assessment Study by the Medical Information Network Distribution Service (Minds) , 2006 .

[8]  L. Leibovici,et al.  Guidelines for the treatment of pneumonia and urinary tract infections: evaluation of methodological quality using the Appraisal of Guidelines, Research and Evaluation II instrument. , 2013, Clinical microbiology and infection : the official publication of the European Society of Clinical Microbiology and Infectious Diseases.

[9]  N. Klazinga,et al.  Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project [AGREE] , 2003 .

[10]  F. Cluzeau,et al.  Development of the AGREE II, part 2: assessment of validity of items and tools to support application , 2010, Canadian Medical Association Journal.