Randomised controlled trial of clinical decision support tools to improve learning of evidence based medicine in medical students

Abstract Objective To assess the educational effectiveness on learning evidence based medicine of a handheld computer clinical decision support tool compared with a pocket card containing guidelines and a control. Design Randomised controlled trial. Setting University of Hong Kong, 2001. Participants 169 fourth year medical students. Main outcome measures Factor and individual item scores from a validated questionnaire on five key self reported measures: personal application and current use of evidence based medicine; future use of evidence based medicine; use of evidence during and after clerking patients; frequency of discussing the role of evidence during teaching rounds; and self perceived confidence in clinical decision making. Results The handheld computer improved participants' educational experience with evidence based medicine the most, with significant improvements in all outcome scores. More modest improvements were found with the pocket card, whereas the control group showed no appreciable changes in any of the key outcomes. No significant deterioration was observed in the improvements even after withdrawal of the handheld computer during an eight week washout period, suggesting at least short term sustainability of effects. Conclusions Rapid and convenient access to valid and relevant evidence on a portable computing device can improve learning in evidence based medicine, increase current and future use of evidence, and boost students' confidence in clinical decision making.

[1]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[2]  Education: Past, Present and Future , 1970, Nature.

[3]  D. Sackett,et al.  A controlled trial of teaching critical appraisal of the clinical literature to medical students. , 1987, JAMA.

[4]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[5]  K. A. McKibbon,et al.  Online access to medline in clinical settings , 2020 .

[6]  J. Marshall,et al.  The impact of the hospital library on clinical decision making: the Rochester study. , 1992, Bulletin of the Medical Library Association.

[7]  K. Koenig,et al.  Computerized literature search in the ED: patient care impact. , 1995, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[8]  D. Sackett,et al.  Finding and applying evidence during clinical rounds: the "evidence cart". , 1998, JAMA.

[9]  Linda Hutchinson,et al.  Evaluating and researching the effectiveness of educational interventions , 1999, BMJ.

[10]  M. Green,et al.  Evidence-based medicine training in graduate medical education: past, present and future. , 2000, Journal of evaluation in clinical practice.

[11]  M. Ebell,et al.  Information in the palm of your hand. , 2000, The Journal of family practice.

[12]  P. Sandercock,et al.  Framework for design and evaluation of complex interventions to improve health , 2000, BMJ : British Medical Journal.

[13]  H. Quan,et al.  Successful teaching in evidence‐based medicine , 2000, Medical education.

[14]  D. Altman,et al.  Analysing controlled trials with baseline and follow up measurements , 2001, BMJ : British Medical Journal.

[15]  G. Leung,et al.  Evidence-based practice revisited , 2001, Asia-Pacific journal of public health.

[16]  Gordon Guyatt,et al.  Evaluating the teaching of evidence-based medicine. , 2002, JAMA.

[17]  Evidence-based Ophthalmology , 2003 .

[18]  G. Leung,et al.  Is ophthalmology evidence based? A clinical audit of the emergency unit of a regional eye hospital , 2003, The British journal of ophthalmology.

[19]  L. Ho,et al.  The development and validation of a knowledge, attitude and behaviour questionnaire to assess undergraduate evidence‐based practice teaching and learning , 2003, Medical education.

[20]  R. Cheloha,et al.  The of a Development , 2004 .