Assessing Correlation Between Virtual Reality Based Serious Gaming Performance and Cognitive Workload Changes via Functional Near Infrared Spectroscopy

Serious game modules enhance knowledge and performance by offering participants to control the content and to arrange the suitable time for learning. Virtual Reality (VR)- based serious gaming modules are used as a complimentary tool for simulation based medical trainings and an emerging method to potentially replace lecture-based learning by enabling us to use the resources in the simulation centers in a much more efficient way. Due to their higher level of immersion, VR-based serious gaming modules have been widely deployed for different types medical trainings. In this study, a VR based serious gaming module was used for teaching “Adult Basic Life Protocol (BLS)” based on the European Resuscitation Council (ERC)-2015 Guidelines. Total number of the participants was 11. There were two groups; the first group consisted of six non-healthcare workers without prior VR experience and the second group consisted of five healthcare workers with prior VR experience. The participants underwent the training sessions via VR based serious gaming module and were expected to achieve a minimum score of 80 out of 100 points in order to become successful. They were asked to take part in the training protocol on the first day and on the 7th day. In addition to recording the training score, we utilized the functional Near Infrared Spectroscopy (fNIRS) sensor to monitor participant’s brain activity acquired from prefrontal cortex, that is the area known to be associated with higher order cognitive functioning, such as working memory, attention, decision making and problem solving. The advantages of using fNIRS in everyday working environments for learning and training were reported by various studies. Hence, in this preliminary study, we investigated the correlation between participants’ behavior measures, i.e., training performance acquired from the scoring system of the serious gaming module and cognitive workload changes while practicing the training session via the fNIRS system. Based on the analyses of the fNIRS data and performance scores, VR training was found to be effective and helped the trainees to learn the BLS (Basic Life Support) algorithm faster.

[1]  Hiroki Sato,et al.  A NIRS–fMRI investigation of prefrontal cortex activity during a working memory task , 2013, NeuroImage.

[2]  S. Bunce,et al.  Functional near-infrared spectroscopy , 2006, IEEE Engineering in Medicine and Biology Magazine.

[3]  Britton Chance,et al.  Functional Optical Brain Imaging Using Near-Infrared During Cognitive Tasks , 2004, Int. J. Hum. Comput. Interact..

[4]  Hasan Ayaz,et al.  Optical brain monitoring for operator training and mental workload assessment , 2012, NeuroImage.

[5]  Andreas Holzinger,et al.  Dynamic Media in Computer Science Education; Content Complexity and Learning Performance: Is Less More? , 2008, J. Educ. Technol. Soc..

[6]  J. Soar,et al.  Adult basic life support and automated external defibrillation , 2015 .

[7]  Brett E. Shelton,et al.  Design and Development of Virtual Reality: Analysis of Challenges Faced by Educators , 2008, J. Educ. Technol. Soc..

[8]  David Wells,et al.  Augmenting the learning experience in primary and secondary school education: a systematic review of recent trends in augmented reality game-based learning , 2019, Virtual Reality.

[9]  Hideaki Koizumi,et al.  Correlation of within-individual fluctuation of depressed mood with prefrontal cortex activity during verbal working memory task: optical topography study. , 2011, Journal of biomedical optics.

[10]  S. Bunce,et al.  Functional near-infrared neuroimaging , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  Maaret Castrén,et al.  European Resuscitation Council Guidelines for Resuscitation 2010 Section 2. Adult basic life support and use of automated external defibrillators , 2010, Resuscitation.

[12]  Dale Richards,et al.  Human Performance Assessment: Evaluation of Wearable Sensors for Monitoring Brain Activity , 2019 .

[13]  Hasan Ayaz,et al.  Using MazeSuite and Functional Near Infrared Spectroscopy to Study Learning in Spatial Navigation , 2011, Journal of visualized experiments : JoVE.