Embodiment Is Related to Better Performance on a Brain–Computer Interface in Immersive Virtual Reality: A Pilot Study

Electroencephalography (EEG)-based brain–computer interfaces (BCIs) for motor rehabilitation aim to “close the loop” between attempted motor commands and sensory feedback by providing supplemental information when individuals successfully achieve specific brain patterns. Existing EEG-based BCIs use various displays to provide feedback, ranging from displays considered more immersive (e.g., head-mounted display virtual reality (HMD-VR)) to displays considered less immersive (e.g., computer screens). However, it is not clear whether more immersive displays improve neurofeedback performance and whether there are individual performance differences in HMD-VR versus screen-based neurofeedback. In this pilot study, we compared neurofeedback performance in HMD-VR versus a computer screen in 12 healthy individuals and examined whether individual differences on two measures (i.e., presence, embodiment) were related to neurofeedback performance in either environment. We found that, while participants’ performance on the BCI was similar between display conditions, the participants’ reported levels of embodiment were significantly different. Specifically, participants experienced higher levels of embodiment in HMD-VR compared to a computer screen. We further found that reported levels of embodiment positively correlated with neurofeedback performance only in HMD-VR. Overall, these preliminary results suggest that embodiment may relate to better performance on EEG-based BCIs and that HMD-VR may increase embodiment compared to computer screens.

[1]  Axel Cleeremans,et al.  The relationship between human agency and embodiment , 2015, Consciousness and Cognition.

[2]  Akio Kimura,et al.  Brain-computer interface with somatosensory feedback improves functional recovery from severe hemiplegia due to chronic stroke , 2014, Front. Neuroeng..

[3]  Mel Slater,et al.  Virtual Embodiment of White People in a Black Virtual Body Leads to a Sustained Reduction in Their Implicit Racial Bias , 2016, Front. Hum. Neurosci..

[4]  M. Slater,et al.  Illusory ownership of a virtual child body causes overestimation of object sizes and implicit attitude changes , 2013, Proceedings of the National Academy of Sciences.

[5]  Mel Slater,et al.  Conversations between self and self as Sigmund Freud—A virtual body ownership paradigm for self counselling , 2015, Scientific Reports.

[6]  Julien Doyon,et al.  Functional cerebral reorganization following motor sequence learning through mental practice with motor imagery , 2003, NeuroImage.

[7]  Mingyu Kim,et al.  A Study on Immersion and VR Sickness in Walking Interaction for Immersive Virtual Reality Applications , 2017, Symmetry.

[8]  G Pfurtscheller,et al.  Spatiotemporal ERD/ERS patterns during voluntary movement and motor imagery. , 2000, Supplements to Clinical neurophysiology.

[9]  Maria V. Sanchez-Vives,et al.  Extending Body Space in Immersive Virtual Reality: A Very Long Arm Illusion , 2012, PloS one.

[10]  Cuntai Guan,et al.  Motor imagery BCI for upper limb stroke rehabilitation: An evaluation of the EEG recordings using coherence analysis , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[11]  Michael J. Singer,et al.  The Factor Structure of the Presence Questionnaire , 2005, Presence: Teleoperators & Virtual Environments.

[12]  E. Biryukova,et al.  Post-stroke Rehabilitation Training with a Motor-Imagery-Based Brain-Computer Interface (BCI)-Controlled Hand Exoskeleton: A Randomized Controlled Multicenter Trial , 2017, Front. Neurosci..

[13]  Daniel Casasanto,et al.  When Does Virtual Embodiment Change Our Minds? , 2016, PRESENCE: Teleoperators and Virtual Environments.

[14]  Shuichi Nishio,et al.  The Importance of Visual Feedback Design in BCIs; from Embodiment to Motor Imagery Learning , 2016, PloS one.

[15]  Trieu Phat Luu,et al.  Gait adaptation to visual kinematic perturbations using a real-time closed-loop brain–computer interface to a virtual reality avatar , 2016, Journal of neural engineering.

[16]  Judy Illes,et al.  Embodiment and Estrangement: Results from a First-in-Human “Intelligent BCI” Trial , 2017, Science and Engineering Ethics.

[17]  P. Dechent,et al.  Is the human primary motor cortex involved in motor imagery? , 2004, Brain research. Cognitive brain research.

[18]  Salvatore Maria Aglioti,et al.  Embodying Others in Immersive Virtual Reality: Electro-Cortical Signatures of Monitoring the Errors in the Actions of an Avatar Seen from a First-Person Perspective , 2016, The Journal of Neuroscience.

[19]  P. Welch The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[20]  Mel Slater,et al.  Enhancing Our Lives with Immersive Virtual Reality , 2016, Front. Robot. AI.

[21]  B He,et al.  Combined rTMS and virtual reality brain–computer interface training for motor recovery after stroke , 2018, Journal of neural engineering.

[22]  J. Bailenson,et al.  The Proteus Effect: The Effect of Transformed Self-Representation on Behavior , 2007 .

[23]  Fabio Babiloni,et al.  Electroencephalographic Correlates of Sensorimotor Integration and Embodiment during the Appreciation of Virtual Architectural Environments , 2015, Front. Psychol..

[24]  Tabitha C. Peck,et al.  Avatar Embodiment. Towards a Standardized Questionnaire , 2018, Front. Robot. AI.

[25]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[26]  M. Slater Immersion and the illusion of presence in virtual reality. , 2018, British journal of psychology.

[27]  L. Cohen,et al.  Brain–machine interface in chronic stroke rehabilitation: A controlled study , 2013, Annals of neurology.

[28]  Cuntai Guan,et al.  Brain-computer interface-based robotic end effector system for wrist and hand rehabilitation: results of a three-armed randomized controlled trial for chronic stroke , 2014, Front. Neuroeng..

[29]  G. Lucchetti,et al.  The effects of mental practice based on motor imagery for mobility recovery after subacute stroke: Protocol for a randomized controlled trial. , 2018, Complementary therapies in clinical practice.

[30]  Athanasios Vourvopoulos,et al.  Motor priming in virtual reality can augment motor-imagery training efficacy in restorative brain-computer interaction: a within-subject analysis , 2016, Journal of NeuroEngineering and Rehabilitation.

[31]  H. Jasper,et al.  The ten-twenty electrode system of the International Federation. The International Federation of Clinical Neurophysiology. , 1999, Electroencephalography and clinical neurophysiology. Supplement.

[32]  Mel Slater,et al.  The Sense of Embodiment in Virtual Reality , 2012, PRESENCE: Teleoperators and Virtual Environments.

[33]  E. Naito,et al.  Internally Simulated Movement Sensations during Motor Imagery Activate Cortical Motor Areas and the Cerebellum , 2002, The Journal of Neuroscience.

[34]  Mel Slater,et al.  Drumming in Immersive Virtual Reality: The Body Shapes the Way We Play , 2013, IEEE Transactions on Visualization and Computer Graphics.

[35]  J. Millán,et al.  Brain-actuated functional electrical stimulation elicits lasting arm motor recovery after stroke , 2018, Nature Communications.

[36]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[37]  G. Pfurtscheller,et al.  ERD/ERS patterns reflecting sensorimotor activation and deactivation. , 2006, Progress in brain research.

[38]  Sook-Lei Liew,et al.  Effects of a Brain-Computer Interface With Virtual Reality (VR) Neurofeedback: A Pilot Study in Chronic Stroke Patients , 2019, Front. Hum. Neurosci..

[39]  D. Carrasco,et al.  Effectiveness of motor imagery or mental practice in functional recovery after stroke: a systematic review , 2016 .

[40]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[41]  Febo Cincotti,et al.  EEG-based Brain-Computer Interface to support post-stroke motor rehabilitation of the upper limb , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[42]  Vacius Jusas,et al.  Development of a Modular Board for EEG Signal Acquisition , 2018, Sensors.

[43]  Patrícia Figueiredo,et al.  Efficacy and Brain Imaging Correlates of an Immersive Motor Imagery BCI-Driven VR System for Upper Limb Motor Rehabilitation: A Clinical Case Report , 2019, Front. Hum. Neurosci..

[44]  M. Molinari,et al.  Brain–computer interface boosts motor imagery practice during stroke recovery , 2015, Annals of neurology.

[45]  G. Pfurtscheller,et al.  Motor imagery activates primary sensorimotor area in humans , 1997, Neuroscience Letters.