Move your virtual body: differences and similarities in brain activation patterns during hand movements in real world and virtual reality

Virtual reality (VR) is a promising tool for neurological rehabilitation, especially for motor rehabilitation. In the present study, we investigate whether brain activation patterns that are evoked by active movements are comparable when these movements are carried out in reality and in VR. Therefore, 40 healthy adults (20 men, mean age 25.31 years) performed hand movements and viewed these movements in a first-person view in reality, a VR scene showing realistic virtual hands, and a VR scene showing abstract virtual hands, in a randomized order. The VR conditions were presented via an immersive 3D head-mounted display system. EEG activity was assessed over the hand motor areas during and after movement execution. All three conditions led to typical EEG activation patterns over the motor cortex. Hence, brain activation patterns were largely comparable between conditions. However, the VR conditions, especially the abstract VR condition, led to a weaker hemispheric lateralization effect compared to the real-world condition. This indicates that hand models in VR should be realistic to be able to evoke activation patterns in the motor cortex comparable to real-world scenarios.

[1]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[2]  Mayank R Mehta,et al.  Impaired spatial selectivity and intact phase precession in two-dimensional virtual reality , 2014, Nature Neuroscience.

[3]  M. Levin,et al.  Virtual Reality in Stroke Rehabilitation: A Meta-Analysis and Implications for Clinicians , 2011, Stroke.

[4]  N. A. Borghese,et al.  Different Brain Correlates for Watching Real and Virtual Hand Actions , 2001, NeuroImage.

[5]  Najaf Aghaei,et al.  Use of virtual reality (immersive vs. non immersive) for pain management in children and adults: A systematic review of evidence from randomized controlled trials , 2012 .

[6]  S. V. Adamovich,et al.  Visuomotor Discordance During Visually-Guided Hand Movement in Virtual Reality Modulates Sensorimotor Cortical Activity in Healthy and Hemiparetic Subjects , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[8]  Jochen Baumeister,et al.  Brain activity in goal-directed movements in a real compared to a virtual environment using the Nintendo Wii , 2010, Neuroscience Letters.

[9]  Mark Hallett,et al.  Cortical reorganization and associated functional motor recovery after virtual reality in patients with chronic stroke: an experimenter-blind preliminary study. , 2005, Archives of physical medicine and rehabilitation.

[10]  David Putrino,et al.  Telerehabilitation and emerging virtual reality approaches to stroke rehabilitation. , 2014, Current opinion in neurology.

[11]  Síria Monyelle Silva de Oliveira,et al.  Electroencephalographic changes using virtual reality program: technical note , 2018, Neurological research.

[12]  E. Tunik,et al.  Sensorimotor training in virtual reality: a review. , 2009, NeuroRehabilitation.

[13]  David Ibarra-Zarate,et al.  Comparative Analysis of Alpha Power Spectral Density in Real and Virtual Environments , 2019, IFMBE Proceedings.

[14]  G. Pfurtscheller,et al.  Post-movement beta synchronization. A correlate of an idling motor area? , 1996, Electroencephalography and clinical neurophysiology.

[15]  S. Perrey,et al.  Does a Combination of Virtual Reality, Neuromodulation and Neuroimaging Provide a Comprehensive Platform for Neurorehabilitation? – A Narrative Review of the Literature , 2016, Front. Hum. Neurosci..

[16]  Gustavo Saposnik,et al.  واقعیت مجازی برای توانبخشی استروک , 2017 .

[17]  T. Campos,et al.  Brain activity during a lower limb functional task in a real and virtual environment: A comparative study. , 2017, NeuroRehabilitation.

[18]  Heidi Sveistrup,et al.  Motor rehabilitation using virtual reality , 2004, Journal of NeuroEngineering and Rehabilitation.

[19]  Paul M. G. Emmelkamp,et al.  Virtual Reality Exposure Therapy for Anxiety Disorders: The State of the Art , 2011 .

[20]  G. Pfurtscheller,et al.  ERD/ERS patterns reflecting sensorimotor activation and deactivation. , 2006, Progress in brain research.

[21]  M. Slater,et al.  The building blocks of the full body ownership illusion , 2013, Front. Hum. Neurosci..

[22]  H. Lee,et al.  The Effects of Virtual Reality Training on Function in Chronic Stroke Patients: A Systematic Review and Meta-Analysis , 2019, BioMed research international.

[23]  S. Small,et al.  Lateralization of motor circuits and handedness during finger movements , 2001, European journal of neurology.

[24]  Beomjoo Seo,et al.  Effects of virtual reality-based rehabilitation on distal upper extremity function and health-related quality of life: a single-blinded, randomized controlled trial , 2016, Journal of NeuroEngineering and Rehabilitation.

[25]  J. Wolpaw,et al.  Mu and Beta Rhythm Topographies During Motor Imagery and Actual Movements , 2004, Brain Topography.

[26]  R. Hari,et al.  Spatiotemporal characteristics of sensorimotor neuromagnetic rhythms related to thumb movement , 1994, Neuroscience.

[27]  G Pfurtscheller,et al.  Discrimination between phase-locked and non-phase-locked event-related EEG activity. , 1995, Electroencephalography and clinical neurophysiology.

[28]  Stephen A Coombes,et al.  A Novel Method to Understand Neural Oscillations During Full-Body Reaching: A Combined EEG and 3D Virtual Reality Study , 2020, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[29]  Eugene Tunik,et al.  Virtual reality to maximize function for hand and arm rehabilitation: exploration of neural mechanisms. , 2009, Studies in health technology and informatics.

[30]  Mel Slater,et al.  Immersion, presence and performance in virtual environments: an experiment with tri-dimensional chess , 1996, VRST.

[31]  J. Ushiba,et al.  Daily training with realistic visual feedback improves reproducibility of event-related desynchronisation following hand motor imagery , 2013, Clinical Neurophysiology.

[32]  B. Lange,et al.  Virtual reality for stroke rehabilitation. , 2015, The Cochrane database of systematic reviews.

[33]  G. Pfurtscheller,et al.  Motor imagery activates primary sensorimotor area in humans , 1997, Neuroscience Letters.

[34]  Shuichi Nishio,et al.  Brain-Computer Interface and Motor Imagery Training: The Role of Visual Feedback and Embodiment , 2018, Evolving BCI Therapy - Engaging Brain State Dynamics.

[35]  C. Neuper,et al.  Cortical correlate of spatial presence in 2D and 3D interactive virtual reality: an EEG study. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[36]  Mel Slater,et al.  Manipulating the Perceived Shape and Color of a Virtual Limb Can Modulate Pain Responses , 2020, Journal of clinical medicine.

[37]  Jörg Krüger,et al.  Movement visualisation in virtual reality rehabilitation of the lower limb: a systematic review , 2016, BioMedical Engineering OnLine.

[38]  Christa Neuper,et al.  Viewing Moving Objects in Virtual Reality Can Change the Dynamics of Sensorimotor EEG Rhythms , 2007, PRESENCE: Teleoperators and Virtual Environments.

[39]  M. Pyasik,et al.  Visual appearance of the virtual hand affects embodiment in the virtual hand illusion , 2020, Scientific Reports.

[40]  Lynne V. Gauthier,et al.  Effectiveness of Virtual Reality- and Gaming-Based Interventions for Upper Extremity Rehabilitation Post-Stroke: A Meta-Analysis. , 2019, Archives of physical medicine and rehabilitation.

[41]  Patrice L. Weiss,et al.  Virtual Reality Versus Conventional Treatment of Reaching Ability in Chronic Stroke: Clinical Feasibility Study , 2012, Neurology and Therapy.

[42]  Domján Andrea,et al.  World Medical Association Declaration of Helsinki (WMA) - Ethical principles for medical research involving human subjects , 2014 .

[43]  K. Laumann,et al.  Questionnaire Measures and Physiological Correlates of Presence: A Systematic Review , 2020, Frontiers in Psychology.

[44]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[45]  Jeremy N. Bailenson,et al.  How Immersive Is Enough? A Meta-Analysis of the Effect of Immersive Technology on User Presence , 2016 .

[46]  Gert Pfurtscheller,et al.  Spatiotemporal analysis of alpha frequency components with the ERD technique , 2005, Brain Topography.

[47]  Andrea Turolla,et al.  Exercises for paretic upper limb after stroke: a combined virtual-reality and telemedicine approach. , 2009, Journal of rehabilitation medicine.