Effects of Low- Versus High-Fidelity Simulations on the Cognitive Burden and Performance of Entry-Level Paramedicine Students: A Mixed-Methods Comparison Trial Using Eye-Tracking, Continuous Heart Rate, Difficulty Rating Scales, Video Observation and Interviews

Introduction High-fidelity simulation-based training is often avoided for early-stage students because of the assumption that while practicing newly learned skills, they are ill suited to processing multiple demands, which can lead to “cognitive overload” and poorer learning outcomes. We tested this assumption using a mixed-methods experimental design manipulating psychological immersion. Methods Thirty-nine randomly assigned first-year paramedicine students completed low- or high-environmental fidelity simulations [low–environmental fidelity simulations (LFenS) vs. high–environmental fidelity simulation (HFenS)] involving a manikin with obstructed airway (SimMan3G). Psychological immersion and cognitive burden were determined via continuous heart rate, eye tracking, self-report questionnaire (National Aeronautics and Space Administration Task Load Index), independent observation, and postsimulation interviews. Performance was assessed by successful location of obstruction and time-to-termination. Results Eye tracking confirmed that students attended to multiple, concurrent stimuli in HFenS and interviews consistently suggested that they experienced greater psychological immersion and cognitive burden than their LFenS counterparts. This was confirmed by significantly higher mean heart rate (P < 0.001) and National Aeronautics and Space Administration Task Load Index mental demand (P < 0.05). Although group allocation did not influence the proportion of students who ultimately revived the patient (58% vs. 30%, P < 0.10), the HFenS students did so significantly more quickly (P < 0.01). The LFenS students had low immersion resulting in greater assessment anxiety. Conclusions High–environmental fidelity simulation engendered immersion and a sense of urgency in students, whereas LFenS created assessment anxiety and slower performance. We conclude that once early-stage students have learned the basics of a clinical skill, throwing them in the “deep end” of high-fidelity simulation creates significant additional cognitive burden but this has considerable educational merit.

[1]  Adam Dubrowski,et al.  The application of the challenge point framework in medical education , 2012, Medical education.

[2]  James Agutter,et al.  Evaluation of Graphic Cardiovascular Display in a High-Fidelity Simulator , 2003, Anesthesia and analgesia.

[3]  Zhi-ming Wang,et al.  [The appraisal of reliability and validity of subjective workload assessment technique and NASA-task load index]. , 2005, Zhonghua lao dong wei sheng zhi ye bing za zhi = Zhonghua laodong weisheng zhiyebing zazhi = Chinese journal of industrial hygiene and occupational diseases.

[4]  Göran Goldkuhl,et al.  Pragmatism vs interpretivism in qualitative information systems research , 2012, Eur. J. Inf. Syst..

[5]  Matthew B Weinger,et al.  Multiple Measures of Anesthesia Workload During Teaching and Nonteaching Cases , 2004, Anesthesia and analgesia.

[6]  H. Carnahan,et al.  Coordinating Progressive Levels of Simulation Fidelity to Maximize Educational Benefit , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[7]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[8]  J. Beaubien,et al.  The use of simulation for training teamwork skills in health care: how low can you go? , 2004, Quality and Safety in Health Care.

[9]  P. Roth MISSING DATA: A CONCEPTUAL REVIEW FOR APPLIED PSYCHOLOGISTS , 1994 .

[10]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[11]  R. Glavin,et al.  Low‐ to high‐fidelity simulation – a continuum of medical education? , 2003, Medical education.

[12]  Jamil Norman Systematic review of the literature on simulation in nursing education. , 2012, The ABNF journal : official journal of the Association of Black Nursing Faculty in Higher Education, Inc.

[13]  Alan Kennedy,et al.  Book Review: Eye Tracking: A Comprehensive Guide to Methods and Measures , 2016, Quarterly journal of experimental psychology.

[14]  C. Kuo,et al.  Clinical nursing competence of RN-to-BSN students in a nursing concept-based curriculum in Taiwan. , 2003, The Journal of nursing education.

[15]  Albert Rehmann,et al.  A Handbook of Flight Simulation Fidelity Requirements for Human Factors Research. , 1995 .

[16]  G. Young,et al.  Assessment of workload using NASA Task Load Index in perianesthesia nursing. , 2008, Journal of perianesthesia nursing : official journal of the American Society of PeriAnesthesia Nurses.

[17]  R. Haase,et al.  Multivariate analysis of variance. , 1987 .

[18]  Joseph Krummenacher,et al.  Usability of a theory of visual attention (TVA) for parameter-based measurement of attention I: Evidence from normal subjects , 2005, Journal of the International Neuropsychological Society.

[19]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[20]  Samuel Lapkin,et al.  Effectiveness of Patient Simulation Manikins in Teaching Clinical Reasoning Skills to Undergraduate Nursing Students: A Systematic Review , 2010 .

[21]  R. Cant,et al.  Simulation-based learning in nurse education: systematic review. , 2010, Journal of advanced nursing.

[22]  Dong Pyo Jang,et al.  Analysis of Physiological Response to Two Virtual Environments: Driving and Flying Simulation , 2002, Cyberpsychology Behav. Soc. Netw..

[23]  M. Endsley,et al.  Objective measures of situation awareness in a simulated medical environment , 2004, Quality and Safety in Health Care.

[24]  M. Harrison,et al.  Effectiveness of simulation on health profession students' knowledge, skills, confidence and satisfaction , 2008, JBI library of systematic reviews.

[25]  A. Weaver High‐Fidelity Patient Simulationin Nursing Education: An Integrative Review , 2011, Nursing education perspectives.

[26]  William F. Moroney,et al.  A comparison of two scoring procedures with the NASA task load index in a simulated flight task , 1992, Proceedings of the IEEE 1992 National Aerospace and Electronics Conference@m_NAECON 1992.

[27]  Jan T. van der Veen,et al.  The learning effects of computer simulations in science education , 2012, Comput. Educ..