Evaluation of best practices in the design of online evidence-based practice instructional modules.

OBJECTIVES The research determined to what extent best practices are being followed by freely available online modules aimed at teaching critical thinking and evidence-based practices (EBPs) in health sciences fields. METHODS In phase I, an evaluation rubric was created after reviewing the literature. Individual rubric questions were assigned point values and grouped into sections, and the sections weighted. Phase II involved searching Internet platforms to locate online EBP modules, which were screened to determine if they met predetermined criteria for inclusion. Phase III comprised a first evaluation, in which two authors assessed each module, followed by a second evaluation of the top-scoring modules by five representatives from different health sciences units. RESULTS The rubric's 28 questions were categorized into 4 sections: content, design, interactivity, and usability. After retrieving 170 online modules and closely screening 91, 42 were in the first evaluation and 8 modules were in the second evaluation. Modules in the first evaluation earned, on average, 59% of available points; modules in the second earned an average of 68%. Both evaluations had a moderate level of inter-rater reliability. CONCLUSIONS The rubric was effective and reliable in evaluating the modules. Most modules followed best practices for content and usability but not for design and interactivity. IMPLICATIONS By systematically collecting and evaluating instructional modules, the authors found many potentially useful elements for module creation. Also, by reviewing the limitations of the evaluated modules, the authors were able to anticipate and plan ways to overcome potential issues in module design.

[1]  How to confidently teach EBM on foot: development and evaluation of a web-based e-learning course , 2012, Evidence-Based Medicine.

[2]  Lin Wu,et al.  Supporting Evidence-Based Medicine: A Survey of U.S. Medical Librarians , 2011, Medical reference services quarterly.

[3]  Shiao-Feng Su,et al.  Design and Development of Web-based Information Literacy Tutorials , 2010 .

[4]  T. Gillingwater,et al.  Development of a supported self‐directed learning approach for anatomy education , 2012, Anatomical sciences education.

[5]  Louise C. Miller,et al.  Beyond Google: Finding and Evaluating Web-Based Information for Community-Based Nursing Practice , 2010, International journal of nursing education scholarship.

[6]  A. Honigsfeld,et al.  Impact of Learning-Style Instructional Strategies on Students' Achievement and Attitudes: Perceptions of Educators in Diverse Institutions , 2009 .

[7]  Jerry W. Robinson,et al.  Learning Modules: A Concept for Extension Educators. , 1972 .

[8]  Katherine Schilling,et al.  An interactive web-based curriculum on evidence-based medicine: design and effectiveness. , 2006, Family medicine.

[9]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[10]  Rozalynd P Anderson,et al.  Topics and Features of Academic Medical Library Tutorials , 2008, Medical reference services quarterly.

[11]  M. Plana,et al.  Effectiveness of a clinically integrated e-learning course in evidence-based medicine for reproductive health training: a randomized trial. , 2012, JAMA.

[12]  Enhancing RN-to-BSN students' information literacy skills through the use of instructional technology. , 2009, The Journal of nursing education.

[13]  Nadaleen Tempelman-Kluit Multimedia Learning Theories and Online Instruction , 2006 .

[14]  L. Wikander,et al.  Assessment of simulated clinical skills and distance students: can we do it better? , 2013, Nurse education today.

[15]  Roger W. Morrell,et al.  Usability Testing of BusinessThinkingTM e-Learning CD-ROMs with Older Adults , 2005 .

[16]  R. Kassam,et al.  An Interprofessional Web-Based Resource for Health Professions Preceptors , 2012, American Journal of Pharmaceutical Education.

[17]  J. Parboosingh,et al.  Internal medicine residents' acceptance of self-directed learning plans at the point of care. , 2011, Journal of graduate medical education.

[18]  G. Walton,et al.  Effective e-learning for health professionals and students--barriers and their solutions. A systematic review of the literature--findings from the HeXL project. , 2005, Health information and libraries journal.

[19]  Cameron Richards,et al.  Developing Interactive Learning Objects for a Computing Mathematics Module , 2006 .

[20]  Li Zhang,et al.  Effectively incorporating instructional media into web-based information literacy , 2006, Electron. Libr..

[21]  ALISON KONIECZNY,et al.  Experiences as an Embedded Librarian in Online Courses , 2010, Medical reference services quarterly.

[22]  A. Merkouris,et al.  Learning styles and critical thinking relationship in baccalaureate nursing education: a systematic review. , 2014, Nurse education today.

[23]  Geert Jacobs,et al.  Assessing QuADEM: preliminary notes on a new method for evaluating online language learning courseware , 2011 .

[24]  I. Widyahening,et al.  From west to east; experience with adapting a curriculum in evidence-based medicine , 2012, Perspectives on medical education.

[25]  Jakob Nielsen,et al.  Usability inspection methods , 1994, CHI 95 Conference Companion.

[26]  B. Bloom Taxonomy of educational objectives , 1956 .

[27]  Rozalynd P Anderson,et al.  Characteristics and content of medical library tutorials: a review. , 2008, Journal of the Medical Library Association : JMLA.

[28]  Jakob Nielsen,et al.  Heuristic Evaluation of Prototypes (individual) , 2022 .

[29]  Susan M. Brookhart,et al.  Gronlund's Writing Instructional Objectives , 2008 .

[30]  M. Klem,et al.  Evidence-based resources and the role of librarians in developing evidence-based practice curricula. , 2005, Journal of professional nursing : official journal of the American Association of Colleges of Nursing.

[31]  J. Boruff,et al.  Integrating evidence-based practice and information literacy skills in teaching physical and occupational therapy students. , 2011, Health information and libraries journal.

[32]  B. Woodard,et al.  Accommodating diverse learning styles in an online environment , 2006 .

[33]  Making Generic Tutorials Content Specific: Recycling Evidence-based Practice (EBP) Tutorials for Two Disciplines , 2009, Medical reference services quarterly.

[34]  J. Dorsch,et al.  Evidence-based medicine at the intersection of research interests between academic health sciences librarians and medical educators: a review of the literature. , 2012, Journal of the Medical Library Association : JMLA.

[35]  Geert Jacobs,et al.  Quadem: manual for the quality assessment of digital educational material , 2010 .

[36]  Betzi L. Bateman,et al.  Improving education in primary care: development of an online curriculum using the blended learning model , 2009, BMC medical education.