Effectiveness of teaching evidence-based medicine to undergraduate medical students: A BEME systematic review

Abstract Background: Despite the widespread teaching of evidence-based medicine (EBM) to medical students, the relevant literature has not been synthesized appropriately as to its value and effectiveness. Aim: To systematically review the literature regarding the impact of teaching EBM to medical students on their EBM knowledge, attitudes, skills and behaviors. Methods: MEDLINE, SCOPUS, Web of science, ERIC, CINAHL and Current Controlled Trials up to May 2011 were searched; backward and forward reference checking of included and relevant studies was also carried out. Two investigators independently extracted data and assessed the quality of the studies. Results: 10,111 potential studies were initially found, of which 27 were included in the review. Six studies examined the effect of clinically integrated methods, of which five had a low quality and the other one used no validated assessment tool. Twelve studies evaluated the effects of seminars, workshops and short courses, of which 11 had a low quality and the other one lacked a validated assessment tool. Six studies examined e-learning, of which five having a high or acceptable quality reported e-learning to be as effective as traditional teaching in improving knowledge, attitudes and skills. One robust study found problem-based learning less effective compared to usual teaching. Two studies with high or moderate quality linked multicomponent interventions to improved knowledge and attitudes. No included study assessed the long-term effects of the teaching of EBM. Conclusions: Our findings indicated that some EBM teaching strategies have the potential to improve knowledge, attitudes and skills in undergraduate medical students, but the evidenced base does not demonstrate superiority of one method. There is no evidence demonstrating transfer to clinical practice.

[1]  Mark C. Wilson Evidence-Based Medicine: How to Practice and Teach EBM , 2001, ACP Journal Club.

[2]  R Mears,et al.  A systematic review of the effectiveness of critical appraisal skills training for clinicians , 2000, Medical education.

[3]  Katherine Schilling,et al.  An interactive web-based curriculum on evidence-based medicine: design and effectiveness. , 2006, Family medicine.

[4]  T. Weberschock,et al.  Change in knowledge and skills of Year 3 undergraduates in evidence‐based medicine seminars , 2005, Medical education.

[5]  Lisa Hartling,et al.  Problem-based learning in pre-clinical medical education: 22 years of outcome research , 2010, Medical teacher.

[6]  Joshua C Denny,et al.  Teaching evidence-based medicine: Impact on students’ literature use and inpatient clinical documentation , 2011, Medical teacher.

[7]  G R Norman,et al.  Effectiveness of instruction in critical appraisal (evidence-based medicine) skills: a critical appraisal. , 1998, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[8]  G. Flores-Mateo,et al.  Evidence based practice in postgraduate healthcare education: A systematic review , 2007, BMC Health Services Research.

[9]  N. Lai,et al.  Information-seeking practices of senior medical students: the impact of an evidence-based medicine training programme. , 2010, Education for health.

[10]  Michael A. Miller,et al.  Teaching evidence-based medicine. , 2005, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[11]  Gordon Guyatt,et al.  Evaluating the teaching of evidence-based medicine. , 2002, JAMA.

[12]  John Parboosingh,et al.  CPD and maintenance of certification in the Royal College of Physicians and Surgeons of Canada , 2003, Canadian Medical Association journal.

[13]  D. Bell,et al.  Instruments for evaluating education in evidence-based practice: a systematic review. , 2006, JAMA.

[14]  K. Kroenke,et al.  A controlled trial of a seminar to improve medical student attitudes toward, knowledge about, and use of the medical literature , 1994, Journal of General Internal Medicine.

[15]  P. Krueger Teaching Critical Appraisal: A Pilot Randomized Controlled Outcomes Trial in Undergraduate Osteopathic Medical Education , 2006, The Journal of the American Osteopathic Association.

[16]  Theodoros N. Arvanitis,et al.  Effectiveness of an e-learning course in evidence-based medicine for foundation (internship) training , 2010, Journal of the Royal Society of Medicine.

[17]  Scott C. Graziano Randomized surgical training for medical students: resident versus peer-led teaching. , 2011, American journal of obstetrics and gynecology.

[18]  P. Adibi,et al.  Evidence-based medicine (EBM) for undergraduate medical students. , 2008, Annals of the Academy of Medicine, Singapore.

[19]  D. Vinson,et al.  Experiential curriculum improves medical students' ability to answer clinical questions using the internet. , 2005, Family medicine.

[20]  L. Dwarakanath,et al.  Assessments in evidence-based medicine workshops: loose connection between perception of knowledge and its objective assessment , 2001, Medical teacher.

[21]  T. Greenhalgh,et al.  Do short courses in evidence based medicine improve knowledge and skills? Validation of Berlin questionnaire and before and after study of courses in evidence based medicine , 2002, BMJ : British Medical Journal.

[22]  W. Rosenberg,et al.  Improving Searching Skills and Evidence Retrieval , 1998, Journal of the Royal College of Physicians of London.

[23]  D. Cook,et al.  Internet-based learning in the health professions: a meta-analysis. , 2008, JAMA.

[24]  Saravana Kumar,et al.  Current evidence on evidence-based practice training in allied health: a systematic review of the literature. , 2012, International journal of evidence-based healthcare.

[25]  Edbert B. Hsu,et al.  Challenges in Systematic Reviews of Educational Intervention Studies , 2005, Annals of Internal Medicine.

[26]  Jason R. Frank,et al.  The CanMEDS 2005 Physician Competency Framework: Better standards. Better physicians. Better care. , 2005 .

[27]  H. Vermeulen,et al.  Are Journal Clubs effective in supporting evidence-based decision making? A systematic review , 2012 .

[28]  Evidence-based medicine teaching in the Mexican army medical school , 2004, Medical teacher.

[29]  J. Herrin,et al.  Comparison of directed and self‐directed learning in evidence‐based medicine: a randomised controlled trial , 2005, Medical education.

[30]  G. Leung,et al.  Randomised controlled trial of clinical decision support tools to improve learning of evidence based medicine in medical students , 2003, BMJ : British Medical Journal.

[31]  Theodoros N. Arvanitis,et al.  How are "teaching the teachers" courses in evidence based medicine evaluated? A systematic review , 2010, BMC medical education.

[32]  Erik N. Kubiak,et al.  ACGME core competencies , 2009 .

[33]  M. Crilly,et al.  Does the current version of ‘Tomorrow's Doctors’ adequately support the role of evidence-based medicine in the undergraduate curriculum? , 2009, Medical teacher.

[34]  T. Horsley,et al.  Teaching critical appraisal skills in healthcare settings. , 2011, The Cochrane database of systematic reviews.

[35]  Arri Coomarasamy,et al.  A hierarchy of effective teaching and learning to acquire competence in evidenced-based medicine , 2006, BMC medical education.

[36]  Brian S Alper,et al.  Physicians Answer More Clinical Questions and Change Clinical Decisions More Often With Synthesized Evidence: A Randomized Trial in Primary Care , 2005, The Annals of Family Medicine.

[37]  James Davis,et al.  Computer-based teaching is as good as face to face lecture-based teaching of evidence based medicine: a randomized controlled trial , 2008, Medical teacher.

[38]  K. Khan,et al.  Bmc Medical Education Computer-based Teaching Is as Good as Face to Face Lecture-based Teaching of Evidence Based Medicine: a Randomised Controlled Trial , 2007 .

[39]  Sharon E Straus,et al.  Evidence-Based Medicine: How to Practice and Teach It , 2010 .

[40]  T Greenhalgh,et al.  Computer assisted learning in undergraduate medical education , 2001, BMJ : British Medical Journal.

[41]  S. Satya‐Murti Evidence-based Medicine: How to Practice and Teach EBM , 1997 .

[42]  P. Glasziou,et al.  Sicily statement on evidence-based practice , 2005, BMC medical education.

[43]  A. Ho,et al.  Effect of an integrated teaching intervention on clinical decision analysis: a randomized, controlled study of undergraduate medical students , 2007, Medical Teacher.

[44]  J Parkes,et al.  Teaching critical appraisal skills in health care settings. , 2001, The Cochrane database of systematic reviews.

[45]  J. Dorsch,et al.  A multidisciplinary approach to information management and critical appraisal instruction: a controlled study. , 1992, Bulletin of the Medical Library Association.

[46]  G. Leung,et al.  A randomised-controlled trial of two educational modes for undergraduate evidence-based medicine learning in Asia , 2009, BMC medical education.

[47]  J. Wilson,et al.  Comparing fourth‐year medical students with faculty in the teaching of physical examination skills to first‐year students , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[48]  D. Fleece,et al.  Integrating Evidence Based Medicine Into Undergraduate Medical Education: Combining Online Instruction With Clinical Clerkships , 2010, Teaching and learning in medicine.

[49]  L. Gruppen,et al.  A Controlled Comparison Study of the Efficacy of Training Medical Students in Evidence-Based Medicine Literature Searching Skills , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[50]  J. Geddes,et al.  What is a randomised controlled trial? , 2009, Epidemiologia e Psichiatria Sociale.

[51]  Arri Coomarasamy,et al.  What is the evidence that postgraduate teaching in evidence based medicine changes anything? A systematic review , 2004, BMJ : British Medical Journal.

[52]  D. Wall Curriculum for the foundation years in postgraduate education and training* , 2005, Medical teacher.

[53]  R. Perera,et al.  Are journal clubs effective in supporting evidence-based decision making? A systematic review. BEME Guide No. 16. , 2011, Medical teacher.

[54]  L. Sechrest,et al.  Evidence-based medicine: discrepancy between perceived competence and actual performance among graduating medical students , 2006, Medical teacher.

[55]  D. Sackett,et al.  Evidence based medicine: what it is and what it isn't , 1996, BMJ.

[56]  V. Montori,et al.  The journal club in postgraduate medical education: a systematic review , 2001, Medical teacher.

[57]  Furman S. McDonald,et al.  Extended Evaluation of a Longitudinal Medical School Evidence-Based Medicine Curriculum , 2011, Journal of General Internal Medicine.

[58]  J. Dorsch,et al.  Impact of an evidence-based medicine curriculum on medical students' attitudes and skills. , 2004, Journal of the Medical Library Association : JMLA.

[59]  C. Ringsted,et al.  Student teachers can be as good as associate professors in teaching clinical skills , 2007, Medical teacher.

[60]  S. Johna,et al.  Accreditation Council for Graduate Medical Education Core Competencies at a Community Teaching Hospital: Is There a Gap in Awareness? , 2016, The Permanente journal.

[61]  D. Dowding,et al.  Teaching evidence-based practice on foot , 2005, Evidence-based nursing.

[62]  Eduardo Ortiz,et al.  Evaluating the teaching of evidence based medicine: conceptual framework , 2004, BMJ : British Medical Journal.

[63]  D. Sackett,et al.  A controlled trial of teaching critical appraisal of the clinical literature to medical students. , 1987, JAMA.

[64]  M. Wong,et al.  The effects of problem-based learning during medical school on physician competency: a systematic review , 2008, Canadian Medical Association Journal.

[65]  C. Teng,et al.  Competence in evidence-based medicine of senior medical students following a clinically integrated training programme. , 2009, Hong Kong medical journal = Xianggang yi xue za zhi.

[66]  Lotty Hooft,et al.  What Are the Barriers to Residents' Practicing Evidence-Based Medicine? A Systematic Review , 2010, Academic medicine : journal of the Association of American Medical Colleges.