Design and Implementation of a Novel Web-Based E-Learning Tool for Education of Health Professionals on the Antibiotic Vancomycin

Background Traditional approaches to health professional education are being challenged by increased clinical demands and decreased available time. Web-based e-learning tools offer a convenient and effective method of delivering education, particularly across multiple health care facilities. The effectiveness of this model for health professional education needs to be explored in context. Objectives The study aimed to (1) determine health professionals’ experience and knowledge of clinical use of vancomycin, an antibiotic used for treatment of serious infections caused by methicillin-resistant Staphylococcus aureus (MRSA) and (2) describe the design and implementation of a Web-based e-learning tool created to improve knowledge in this area. Methods We conducted a study on the design and implementation of a video-enhanced, Web-based e-learning tool between April 2014 and January 2016. A Web-based survey was developed to determine prior experience and knowledge of vancomycin use among nurses, doctors, and pharmacists. The Vancomycin Interactive (VI) involved a series of video clips interspersed with question and answer scenarios, where a correct response allowed for progression. Dramatic tension and humor were used as tools to engage users. Health professionals’ knowledge of clinical vancomycin use was obtained from website data; qualitative participant feedback was also collected. Results From the 577 knowledge survey responses, pharmacists (n=70) answered the greatest number of questions correctly (median score 4/5), followed by doctors (n=271; 3/5) and nurses (n=236; 2/5; P<.001). Survey questions on target trough concentration (75.0%, 433/577) and rate of administration (64.9%, 375/577) were answered most correctly, followed by timing of first level (49%, 283/577), maintenance dose (41.9%, 242/577), and loading dose (38.0%, 219/577). Self-reported “very” and “reasonably” experienced health professionals were also more likely to achieve correct responses. The VI was completed by 163 participants during the study period. The rate of correctly answered VI questions on first attempt was 65% for nurses (n=63), 68% for doctors (n=86), and 82% for pharmacists (n=14; P<.001), reflecting a similar pattern to the knowledge survey. Knowledge gaps were identified for loading dose (39.2% correct on first attempt; 64/163), timing of first trough level (50.3%, 82/163), and subsequent trough levels (47.9%, 78/163). Of the 163 participants, we received qualitative user feedback from 51 participants following completion of the VI. Feedback was predominantly positive with themes of “entertaining,” “engaging,” and “fun” identified; however, there were some technical issues identified relating to accessibility from different operating systems and browsers. Conclusions A novel Web-based e-learning tool was successfully developed combining game design principles and humor to improve user engagement. Knowledge gaps were identified that allowed for targeting of future education strategies. The VI provides an innovative model for delivering Web-based education to busy health professionals in different locations.

[1]  Ann L. Fruhling,et al.  A Serious Game for Teaching Nursing Students Clinical Reasoning and Decision-Making Skills , 2016, Nursing Informatics.

[2]  Kristopher J Preacher,et al.  Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models , 2008, Behavior research methods.

[3]  D. Cook,et al.  Internet-based learning in the health professions: a meta-analysis. , 2008, JAMA.

[4]  David A Cook,et al.  Time and learning efficiency in Internet-based learning: a systematic review and meta-analysis , 2010, Advances in health sciences education : theory and practice.

[5]  Jeff Cain,et al.  Are Serious Games a Good Strategy for Pharmacy Education? , 2015, American Journal of Pharmaceutical Education.

[6]  Enrique Castro-Sánchez,et al.  "On call: antibiotics"- development and evaluation of a serious antimicrobial prescribing game for hospital care , 2014, GFHEU.

[7]  R. Mckinnon,et al.  The impact of a pilot continuing professional development module on hospital pharmacists’ preparedness to provide contemporary advice on the clinical use of vancomycin , 2016, SpringerPlus.

[8]  Bryan P. Bergeron,et al.  Developing serious games , 2006 .

[9]  B. Lomaestro Vancomycin dosing and monitoring 2 years after the guidelines , 2011, Expert review of anti-infective therapy.

[10]  Are online learning modules an effective way to deliver hand trauma management continuing medical education to emergency physicians? , 2014, Plastic surgery.

[11]  Maurits Graafland,et al.  How to Systematically Assess Serious Games Applied to Health Care , 2014, JMIR serious games.

[12]  Maurits Graafland,et al.  A Serious Game Can Be a Valid Method to Train Clinical Decision-Making in Surgery , 2014, World Journal of Surgery.

[13]  M. Cruickshank,et al.  Antimicrobial stewardship in Australian hospitals , 2011 .

[14]  Deborah I Thompson,et al.  The Narrative Impact of Active Video Games on Physical Activity Among Children: A Feasibility Study , 2016, Journal of medical Internet research.

[15]  Jeffrey M Taekman,et al.  Virtual Environments in Healthcare: Immersion, Disruption, and Flow , 2010, International anesthesiology clinics.

[16]  Deborah I Thompson Designing Serious Video Games for Health Behavior Change: Current Status and Future Directions , 2012, Journal of diabetes science and technology.

[17]  W. L. Heinrichs,et al.  Design, Development, and Evaluation of an Online Virtual Emergency Department for Training Trauma Teams , 2008, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[18]  Elie A Akl,et al.  Educational games for health professionals. , 2013, The Cochrane database of systematic reviews.

[19]  Bryan P. Bergeron,et al.  Learning & Retention in Adaptive Serious Games , 2008, MMVR.

[20]  P. F. Kauff Group , 2000, Elegant Design.

[21]  Weirong Yan,et al.  The Effectiveness of Blended Learning in Health Professions: Systematic Review and Meta-Analysis , 2016, Journal of medical Internet research.

[22]  D. Levine,et al.  Therapeutic Monitoring of Vancomycin in Adults , 2009, Pharmacotherapy.

[23]  Nicky Lambert,et al.  Enjoyable learning: the role of humour, games, and fun activities in nursing and midwifery education. , 2010, Nurse education today.

[24]  J. Ziegler Humour in medical teaching , 1999, The Medical journal of Australia.

[25]  M. Schijven,et al.  Systematic review of serious games for medical education and surgical skills training , 2012, The British journal of surgery.

[26]  Martin Boeker,et al.  Game-Based E-Learning Is More Effective than a Conventional Instructional Method: A Randomized Controlled Trial with Third-Year Medical Students , 2013, PloS one.

[27]  Daniel Katz,et al.  A Systematic Review of Serious Games in Training Health Care Professionals , 2016, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[28]  Lindsay K. Coleman,et al.  Impact of Nursing Education on the Proportion of Appropriately Drawn Vancomycin Trough Concentrations , 2016, Journal of pharmacy practice.

[29]  H. Humphreys,et al.  Vancomycin administration: the impact of multidisciplinary interventions , 2007, Journal of Clinical Pathology.

[30]  M. Swartling,et al.  Short term impact of guidelines on vancomycin dosing and therapeutic drug monitoring , 2012, International Journal of Clinical Pharmacy.

[31]  M. Lustik,et al.  Optimization of time to initial vancomycin target trough improves clinical outcomes , 2015, SpringerPlus.