Using Biosignals for Objective Measurement of Presence in Virtual Reality Environments

The concept of ‘presence’ in the context of virtual reality (VR) refers to the experience of being in the virtual environment, even when one is physically situated in the real world. Therefore, it is a key parameter of assessing a VR system, based on which, improvements can be made to it. To overcome the limitations of existing methods that are based on standard questionnaires and behavioral analysis, this study proposes to investigate the suitability of biosignals of the user to derive an objective measure of presence. The proposed approach includes experiments conducted on 20 users, recording EEG, ECG and electrodermal activity (EDA) signals while experiencing custom designed VR scenarios with factors contributing to presence suppressed and unsuppressed. Mutual Information based feature selection and subsequent paired t-tests used to identify significant variations in biosignal features when each factor of presence is suppressed revealed significant (p < 0.05) differences in the mean values of EEG signal power and coherence within alpha, beta and gamma bands distributed in specific regions of the brain. Statistical features showed a significant variation with the suppression of realism factor. The variations of activity in the temporal region lead to the assumption of insula activation which may be related to the sense of presence. Therefore, the use of biosignals for an objective measurement of presence in VR systems indicates promise.

[1]  Won-Hyung Lee,et al.  BCI Sensor Based Environment Changing System for Immersion of 3D Game , 2014, Int. J. Distributed Sens. Networks.

[2]  Alessandro De Gloria,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < , 2022 .

[3]  M. Tangermann,et al.  Automatic Classification of Artifactual ICA-Components for Artifact Removal in EEG Signals , 2011, Behavioral and Brain Functions.

[4]  Helmut Hlavacs,et al.  Is virtual reality emotionally arousing? Investigating five emotion inducing virtual park scenarios , 2015, Int. J. Hum. Comput. Stud..

[5]  Philippe Fuchs,et al.  Virtual Reality: Concepts and Technologies , 2011 .

[6]  A. Leuchter,et al.  Synaptic dysfunction in Alzheimer's disease: clinical assessment using quantitative EEG , 1996, Behavioural Brain Research.

[7]  M. Benedek,et al.  Decomposition of skin conductance data by means of nonnegative deconvolution , 2010, Psychophysiology.

[8]  F. Brooks,et al.  Physiological Reaction as an Objective Measure of Presence in Virtual Environments , 2001 .

[9]  Daniel Mestre,et al.  Immersion and presence , 2011 .

[10]  Tzyy-Ping Jung,et al.  EEG correlates of haptic feedback in a visuomotor tracking task , 2012, NeuroImage.

[11]  C. Neuper,et al.  Cortical correlate of spatial presence in 2D and 3D interactive virtual reality: an EEG study. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[12]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[13]  Stephen H. Fairclough,et al.  Use of auditory event-related potentials to measure immersion during a computer game , 2015, Int. J. Hum. Comput. Stud..

[14]  Beatriz Rey,et al.  Measuring Presence During the Navigation In a Virtual Environment Using EEG , 2013, Annual Review of Cybertherapy and Telemedicine.

[15]  J. L. Higuera-Trujillo,et al.  Psychological and physiological human responses to simulated and real environments: A comparison between Photographs, 360° Panoramas, and Virtual Reality. , 2017, Applied ergonomics.

[16]  Mel Slater,et al.  Using Presence Questionnaires in Reality , 2000, Presence: Teleoperators & Virtual Environments.

[17]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[18]  Tzyy-Ping Jung,et al.  Evaluation of Artifact Subspace Reconstruction for Automatic EEG Artifact Removal , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[19]  Mel Slater,et al.  Depth of Presence in Virtual Environments , 1994, Presence: Teleoperators & Virtual Environments.

[20]  Thomas D. Parsons,et al.  Modality specific assessment of video game player's experience using the Emotiv , 2015, Entertain. Comput..

[21]  Jérémy Frey,et al.  Framework for Electroencephalography-based Evaluation of User Experience , 2016, CHI.