Environmental scan and evaluation of best practices for online systematic review resources

Objective Online training for systematic review methodology is an attractive option due to flexibility and limited availability of in-person instruction. Librarians often direct new reviewers to these online resources, so they should be knowledgeable about the variety of available resources. The objective for this project was to conduct an environmental scan of online systematic review training resources and evaluate those identified resources. Methods The authors systematically searched for electronic learning resources pertaining to systematic review methods. After screening for inclusion, we collected data about characteristics of training resources and assigned scores in the domains of (1) content, (2) design, (3) interactivity, and (4) usability by applying a previously published evaluation rubric for online instruction modules. We described the characteristics and scores for each training resource and compared performance across the domains. Results Twenty training resources were evaluated. Average overall score of online instructional resources was 61%. Online courses (n=7) averaged 73%, web modules (n=5) 64%, and videos (n=8) 48%. The top 5 highest scoring resources were in course or web module format, featured high interactivity, and required a longer (>5hrs) time commitment from users. Conclusion This study revealed that resources include appropriate content but are less likely to adhere to principles of online training design and interactivity. Awareness of these resources will allow librarians to make informed recommendations for training based on patrons’ needs. Future online systematic review training resources should use established best practices for e-learning to provide high-quality resources, regardless of format or user time commitment.

[1]  C. Farkas,et al.  Publicly Available Online Educational Videos Regarding Pediatric Needle Pain: A Scoping Review , 2015, The Clinical journal of pain.

[2]  A. Voutilainen,et al.  Conventional vs. e-learning in nursing education: A systematic review and meta-analysis. , 2017, Nurse education today.

[3]  Ann Harrington,et al.  E-learning & information communication technology (ICT) in nursing education: A review of the literature. , 2014, Nurse education today.

[4]  Robin Parker,et al.  Lost in Translation: Supporting learners to search comprehensively across databases , 2015 .

[5]  G. Walton,et al.  Effective e-learning for health professionals and students--barriers and their solutions. A systematic review of the literature--findings from the HeXL project. , 2005, Health information and libraries journal.

[6]  Kamel Mansi,et al.  Cochrane systematic reviewing for the uninitiated: An interactive demo , 2014 .

[7]  A. Madani,et al.  Systematic review of e‐learning for surgical training , 2016, The British journal of surgery.

[8]  Catherine Boden,et al.  Efficacy of Screen-Capture Tutorials in Literature Search Training: A Pilot Study of a Research Method , 2013, Medical reference services quarterly.

[9]  J. Polanin,et al.  The Campbell Collaboration’s Systematic Review and Meta-Analysis Online Training Videos , 2013 .

[10]  Laura A. Levit,et al.  Finding what works in health care : standards for systematic reviews , 2011 .

[11]  Susan A. Murphy,et al.  The Latent Curriculum: Breaking Conceptual Barriers to Information Architecture , 2012 .

[12]  Geert Jacobs,et al.  Quadem: manual for the quality assessment of digital educational material , 2010 .

[13]  Melissa L Rethlefsen,et al.  Librarian co-authors correlated with higher quality reported search strategies in general internal medicine systematic reviews. , 2015, Journal of clinical epidemiology.

[14]  G. De Luca Canto,et al.  Effectiveness of E-Learning in Oral Radiology Education: A Systematic Review. , 2016, Journal of dental education.

[15]  S. Tarpada,et al.  E-learning in orthopedic surgery training: A systematic review. , 2016, Journal of orthopaedics.

[16]  Trisha Greenhalgh,et al.  Internet-based medical education: a realist review of what works, for whom and in what circumstances , 2010, BMC medical education.

[17]  A. Kable,et al.  The effectiveness of Internet-based e-learning on clinician behaviour and patient outcomes: A systematic review. , 2016, International journal of nursing studies.

[18]  Suzanne Shurtz,et al.  Evaluation of best practices in the design of online evidence-based practice instructional modules. , 2014, Journal of the Medical Library Association : JMLA.

[19]  J. Glanville,et al.  Searching for Studies , 2008 .

[20]  Marc J. Gibber,et al.  Resident and student education in otolaryngology: A 10‐year update on e‐learning , 2017, The Laryngoscope.