Development and validation of the guideline for reporting evidence-based practice educational interventions and teaching (GREET)

BackgroundThe majority of reporting guidelines assist researchers to report consistent information concerning study design, however, they contain limited information for describing study interventions. Using a three-stage development process, the Guideline for Reporting Evidence-based practice Educational interventions and Teaching (GREET) checklist and accompanying explanatory paper were developed to provide guidance for the reporting of educational interventions for evidence-based practice (EBP). The aim of this study was to complete the final development for the GREET checklist, incorporating psychometric testing to determine inter-rater reliability and criterion validity.MethodsThe final development for the GREET checklist incorporated the results of a prior systematic review and Delphi survey. Thirty-nine items, including all items from the prior systematic review, were proposed for inclusion in the GREET checklist. These 39 items were considered over a series of consensus discussions to determine the inclusion of items in the GREET checklist. The GREET checklist and explanatory paper were then developed and underwent psychometric testing with tertiary health professional students who evaluated the completeness of the reporting in a published study using the GREET checklist. For each GREET checklist item, consistency (%) of agreement both between participants and the consensus criterion reference measure were calculated. Criterion validity and inter-rater reliability were analysed using intra-class correlation coefficients (ICC).ResultsThree consensus discussions were undertaken, with 14 items identified for inclusion in the GREET checklist. Following further expert review by the Delphi panelists, three items were added and minor wording changes were completed, resulting in 17 checklist items. Psychometric testing for the updated GREET checklist was completed by 31 participants (n = 11 undergraduate, n = 20 postgraduate). The consistency of agreement between the participant ratings for completeness of reporting with the consensus criterion ratings ranged from 19 % for item 4 Steps of EBP, to 94 % for item 16 Planned delivery. The overall consistency of agreement, for criterion validity (ICC 0.73) and inter-rater reliability (ICC 0.96), was good to almost perfect.ConclusionThe final GREET checklist comprises 17 items which are recommended for reporting EBP educational interventions. Further validation of the GREET checklist with experts in EBP research and education is recommended.

[1]  S. Downing,et al.  Teaching of evidence-based medicine to medical students in Mexico: a randomized controlled trial , 2012, BMC medical education.

[2]  D. Moher,et al.  Guidance for Developers of Health Research Reporting Guidelines , 2010, PLoS medicine.

[3]  G. Norman,et al.  A comprehensive checklist for reporting the use of OSCEs , 2009, Medical teacher.

[4]  Curtis L. Meinert,et al.  A proposal for structured reporting of randomized controlled trials. The Standards of Reporting Trials Group. , 1994, JAMA.

[5]  I. Olkin,et al.  Improving the quality of reporting of randomized controlled trials. The CONSORT statement. , 1996, JAMA.

[6]  D. Sackett,et al.  Evidence based medicine: what it is and what it isn't , 1996, BMJ.

[7]  D. Ilic,et al.  Methods of teaching medical trainees evidence‐based medicine: a systematic review , 2014, Medical education.

[8]  D. Kolb.  Experiential Learning: Experience as the Source of Learning and Development , 1983 .

[9]  J. Wyatt,et al.  Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide , 2014, BMJ : British Medical Journal.

[10]  G. Cummings,et al.  Clinical trials focusing on cancer pain educational interventions: core components to include during planning and reporting. , 2010, Journal of pain and symptom management.

[11]  D. Moher,et al.  A Delphi survey to determine how educational interventions for evidence-based practice should be reported: Stage 2 of the development of a reporting guideline , 2014, BMC medical education.

[12]  C. Abraham,et al.  A checklist to improve reporting of group-based behaviour-change interventions , 2015, BMC Public Health.

[13]  J. Tilson,et al.  Promoting physical therapists’ of research evidence to inform clinical practice: part 1 - theoretical foundation, evidence, and description of the PEAK program , 2014, BMC Medical Education.

[14]  M. Clarke,et al.  What Are the Effects of Teaching Evidence-Based Health Care (EBHC)? Overview of Systematic Reviews , 2014, PloS one.

[15]  C. Olson,et al.  Evaluations of Educational Interventions: Getting Them Published and Increasing Their Impact , 2013, The Journal of continuing education in the health professions.

[16]  R. Taylor,et al.  A systematic review of postgraduate teaching in evidence-based medicine and critical appraisal , 2003, Medical teacher.

[17]  Lisa D Howley,et al.  Quality of standardised patient research reports in the medical education literature: review and recommendations , 2008, Medical education.

[18]  David Moher,et al.  A systematic review of how studies describe educational interventions for evidence-based practice: stage 1 of the development of a reporting guideline , 2014, BMC medical education.

[19]  Frances A. Kennedy,et al.  Perspective: Guidelines for Reporting Team-Based Learning Activities in the Medical and Health Sciences Education Literature , 2012, Academic medicine : journal of the Association of American Medical Colleges.

[20]  L. Wiles,et al.  Magnitude of change in outcomes following entry-level evidence-based practice training: a systematic review , 2013 .

[21]  David L. Sackett,et al.  Evidence based medicine: What it is and what it isn't (reprinted from BMJ, vol 312, pg 71-72, 1996) , 2007 .

[22]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[23]  D. Moher,et al.  Protocol for development of the guideline for reporting evidence based practice educational interventions and teaching (GREET) statement , 2013, BMC medical education.

[24]  Bridget C. O’Brien,et al.  Evidence-Based Medicine Training in Undergraduate Medical Education: A Review and Critique of the Literature Published 2006–2011 , 2013, Academic medicine : journal of the Association of American Medical Colleges.