Efficacy of virtual patients in medical education: A meta-analysis of randomized studies

A meta-analysis was performed to assess the Effect Size (ES) from randomized studies comparing the effect of educational interventions in which Virtual patients (VPs) were used either as an alternative method or additive to usual curriculum versus interventions based on more traditional methods. Meta-analysis was designed, conducted and reported according to QUORUM statement on quality of reporting of meta-analyses. Twelve randomized controlled studies were retrieved, assessing a total of 25 different outcomes. Under a random-effect model, meta-analysis showed a clear positive pooled overall effect for VPs compared to other educational methods (Odds Ratio: 2.39; 95% C.I. 1.48 @? 3.84). A positive effect has been documented both when VPs have been used as an additive resource (O.R.: 2.55; C.I. 1.36 @? 4.79) and when they have been compared as an alternative to a more traditional method (O.R.: 2.19; 1.06 @? 4.52). When grouped for type of outcome, the pooled ES for studies addressing communication skills and ethical reasoning was lower than for clinical reasoning outcome. There is evidence that VPs are effective but further research is needed to clarify which is their best possible integration in curricula and their value and cost/benefit ratio with respect to other active learning methods.

[1]  U Fors,et al.  The use of a virtual patient case in an OSCE-based exam – A pilot study , 2008, Medical teacher.

[2]  D. Davies,et al.  Design for learning: deconstructing virtual patient activities , 2011, Medical teacher.

[3]  Uno Fors,et al.  The use of virtual patients to assess the clinical skills and reasoning of medical students: initial insights on student acceptance , 2009, Medical teacher.

[4]  Amy O. Stevens,et al.  Do medical students respond empathetically to a virtual patient? , 2007, American journal of surgery.

[5]  Terry Poulton,et al.  The replacement of ‘paper’ cases by interactive online virtual patients in problem-based learning , 2009, Medical teacher.

[6]  Bernard Charlin,et al.  Is case-specificity content-specificity? An analysis of data from extended-matching questions , 2010, Advances in health sciences education : theory and practice.

[7]  David A Cook,et al.  Time and learning efficiency in Internet-based learning: a systematic review and meta-analysis , 2010, Advances in health sciences education : theory and practice.

[8]  W. Vaught,et al.  MedEthEx Online: A Computer-Based Learning Program in Medical Ethics and Communication Skills , 2000, Teaching and learning in medicine.

[9]  Phillip M. Harter,et al.  Simulation for Team Training and Assessment: Case Studies of Online Training with Virtual Worlds , 2008, World Journal of Surgery.

[10]  N Mattheos,et al.  Simulation of patient encounters using a virtual patient in periodontology instruction of dental students: design, usability, and learning effect in history-taking skills. , 2004, European journal of dental education : official journal of the Association for Dental Education in Europe.

[11]  Joseph Y. C. Leung,et al.  Virtual patients and undergraduate anaesthesia teaching , 2008, Medical education.

[12]  W. L. Heinrichs,et al.  Design, Development, and Evaluation of an Online Virtual Emergency Department for Training Trauma Teams , 2008, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[13]  Uta-Maria Waldmann,et al.  Virtual patients for assessing medical students–important aspects when considering the introduction of a new assessment format , 2008, Medical teacher.

[14]  Adeline M. Deladisma,et al.  A pilot study to integrate an immersive virtual patient with a breast complaint and breast examination simulator into a surgery clerkship. , 2009, American journal of surgery.

[15]  Uno Fors,et al.  Virtual patient simulation: Knowledge gain or knowledge loss? , 2010, Medical teacher.

[16]  Jack C. Y. Cheng,et al.  Fostering Critical Thinking Skills Through a Web-Based Tutorial Programme for Final Year Medical Students— A Randomized Controlled Study , 2003 .

[17]  Randall Stewart,et al.  Virtual reality training improves students' knowledge structures of medical concepts. , 2005, Studies in health technology and informatics.

[18]  David R. Jones,et al.  Empirical assessment of effect of publication bias on meta-analyses , 2000, BMJ : British Medical Journal.

[19]  L. Arnold,et al.  Assessing Professional Behavior: Yesterday, Today, and Tomorrow , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[20]  W. DeWolf,et al.  A Multi-Institutional Randomized Controlled Trial of Adjuvant Web-Based Teaching to Medical Students , 2006, Academic medicine : journal of the Association of American Medical Colleges.

[21]  D. Altman,et al.  Measuring inconsistency in meta-analyses , 2003, BMJ : British Medical Journal.

[22]  M. Huff,et al.  Virtual patient training to improve reproductive health care for women with intellectual disabilities. , 2008, Journal of midwifery & women's health.

[23]  Adeline Deladisma,et al.  Mixed Reality Humans: Evaluating Behavior, Usability, and Acceptability , 2009, IEEE Transactions on Visualization and Computer Graphics.

[24]  Markus Kreuzthaler,et al.  Development of an Interactive Application for Learning Medical Procedures and Clinical Decision Making , 2011, USAB.

[25]  Andreas Holzinger,et al.  Learning performance with interactive simulations in medical education: Lessons learned from results of learning complex physiological models with the HAEMOdynamics SIMulator , 2009, Comput. Educ..

[26]  Andrei Sherstyuk,et al.  Teaching mass casualty triage skills using immersive three-dimensional virtual reality. , 2008, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[27]  D. Cook,et al.  Virtual patients: a critical literature review and proposed next steps , 2009, Medical education.

[28]  Jasminka M Vukanovic-Criley,et al.  Using Virtual Patients to Improve Cardiac Examination Competency in Medical Students , 2008, Clinical cardiology.

[29]  Nabil Zary,et al.  Towards a typology of virtual patients , 2009, Medical teacher.

[30]  M. Bearman.  Is Virtual the Same as Real? Medical Students' Experiences of a Virtual Patient , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[31]  Nabil Zary,et al.  Development, implementation and pilot evaluation of a Web-based Virtual Patient Case Simulation environment – Web-SP , 2006, BMC medical education.

[32]  Terry Poulton,et al.  Virtual patients come of age , 2009, Medical teacher.

[33]  Robin Deterding,et al.  Student's perceptions of a virtual PBL experience. , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[34]  Andrzej A. Kononowicz,et al.  Enabling Interoperability, Accessibility and Reusability of Virtual Patients across Europe - Design and Implementation , 2009, MIE.

[35]  Joann G Elmore,et al.  Trends in study methods used in undergraduate medical education research, 1969-2007. , 2007, JAMA.

[36]  M. Lipkin,et al.  A randomized trial of teaching clinical skills using virtual and live standardized patients , 2006, Journal of General Internal Medicine.

[37]  Matthew S. Prewett,et al.  A systematic review of the reliability of objective structured clinical examination scores , 2011, Medical education.

[38]  Laura Boteler,et al.  Virtual Reality Skills Training for Health Care Professionals in Alcohol Screening and Brief Intervention , 2009, The Journal of the American Board of Family Medicine.

[39]  Lynn Foster-Johnson,et al.  Integration Strategies for Using Virtual Patients in Clinical Clerkships , 2009, Academic medicine : journal of the Association of American Medical Colleges.

[40]  Robin Deterding,et al.  A Comparison of Critical Thinking in Groups of Third‐year Medical Students in Text, Video, and Virtual PBL Case Modalities , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[41]  Anthony F Jerant,et al.  Validity of Scores Generated by a Web-Based Multimedia Simulated Patient Case Software: A Pilot Study , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[42]  Amy O. Stevens,et al.  The use of virtual patients to teach medical students history taking and communication skills. , 2006, American journal of surgery.

[43]  G. Norman.  Research in clinical reasoning: past history and current trends , 2005, Medical education.

[44]  Sarah Garside,et al.  Method and reporting quality in health professions education research: a systematic review , 2011, Medical education.

[45]  Uno Fors,et al.  Building a virtual patient commons , 2008, Medical teacher.

[46]  Kevin Fung,et al.  Interactive Internet-based cases for undergraduate otolaryngology education , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[47]  C. Sanders,et al.  Caring for children with intellectual and developmental disabilities: virtual patient instruction improves students' knowledge and comfort level. , 2007, Journal of pediatric nursing.

[48]  James J. Quattrochi,et al.  Evaluation of an Interactive Case-based Online Network (ICON) in a Problem Based Learning Environment , 2005, Advances in health sciences education : theory and practice.

[49]  Brent Rossen,et al.  Medical Student Satisfaction Using a Virtual Patient System to Learn History-Taking Communication Skills , 2008, MMVR.

[50]  Uno Fors,et al.  Bmc Medical Education Evaluation of an Interactive Case Simulation System in Dermatology and Venereology for Medical Students , 2022 .

[51]  Chara Balasubramaniam,et al.  Virtual patients: A year of change , 2011, Medical teacher.

[52]  M. Shariati,et al.  VIRTUAL PATIENTS IN UNDERGRADUATE SURGERY EDUCATION: A RANDOMIZED CONTROLLED STUDY , 2007, ANZ journal of surgery.

[53]  I. Olkin,et al.  Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement , 1999, The Lancet.

[54]  Kamran Z Khan,et al.  Simulation in Medical Education , 2018, Understanding Medical Education.

[55]  Keiko Abe,et al.  The use of simulated patients in medical education: AMEE Guide No 42 , 2009, Medical teacher.

[56]  M. Bearman,et al.  Random comparison of ‘virtual patient’ models in the context of teaching clinical communication skills , 2001, Medical education.

[57]  Stephen Senn,et al.  (www.interscience.wiley.com) DOI: 10.1002/sim.2639 Trying to be precise about vagueness , 2022 .

[58]  K. Eva.  What every teacher needs to know about clinical reasoning , 2005, Medical education.