An immersive virtual reality game to train spatial attention orientation after stroke: A feasibility

Immersive virtual reality (IVR) may boost neglect recovery, as it can provide an engaging experience in a 3D environment. We designed an IVR rehabilitation game for neglect patients using the Oculus Rift. Multisensory cues were presented in the neglected visual field in a patient-tailored way. We acquired pilot data in 15 neurologically healthy controls and 7 stroke patients. First, we compared cybersickness before and after VR exposure. Second, we assessed the user experience through a questionnaire. Third, we tested whether neglect symptoms corresponded between the VR game and a computerized cancelation task. Fourth, we evaluated the effect of the multisensory cueing on target discrimination. Last, we tested two algorithms to tailor the game to the characteristics of the neglected visual field. Cybersickness significantly reduced after VR exposure in six stroke patients and was low in healthy controls. Patients rated the user experience neutral to positive. In addition, neglect symptoms were consistent between a computerized cancelation and VR rehabilitation task. The multisensory cue positively affected target discrimination in the game and we successfully presented sensory stimulation to the neglected visual field in a patient-tailored way. Our results show that it is promising to use gamified patient-tailored immersive VR for neglect rehabilitation.

[1]  A. Geurts,et al.  Is Visuospatial Hemineglect Really a Determinant of Postural Control Following Stroke? An Acute-Phase Study , 2009, Neurorehabilitation and neural repair.

[2]  Vero Vanden Abeele,et al.  The Design of a Virtual Reality Game for Stroke-Induced Attention Deficits , 2017, CHI PLAY.

[3]  Sung-Taek Chung,et al.  K-CBS-based unilateral spatial neglect rehabilitation training contents utilizing virtual reality , 2019, 2019 International Conference on Electronics, Information, and Communication (ICEIC).

[4]  A. Mirelman,et al.  Effects of Training With a Robot-Virtual Reality System Compared With a Robot Alone on the Gait of Individuals After Stroke , 2009, Stroke.

[5]  N. A. Borghese,et al.  Using Virtual Reality to Rehabilitate Neglect , 2013, Behavioural neurology.

[6]  J. DeGutis,et al.  The nonspatial side of spatial neglect and related approaches to treatment. , 2013, Progress in brain research.

[7]  Descriptors Higher.  Annual Meeting of the International Communication Association , 1974 .

[8]  H. Iwata,et al.  Validation of an immersive virtual reality system for training near and far space neglect in individuals with stroke: a pilot study , 2017, Topics in stroke rehabilitation.

[9]  Alfonso Caramazza,et al.  Dissociable Coordinate Frames of Unilateral Spatial Neglect: “Viewer-Centered” Neglect , 1998, Brain and Cognition.

[10]  Gert Kwakkel,et al.  The Impact of Recovery of Visuo-Spatial Neglect on Motor Recovery of the Upper Paretic Limb after Stroke , 2014, PloS one.

[11]  A. Pollock,et al.  Cognitive rehabilitation for spatial neglect following stroke. , 2013, The Cochrane database of systematic reviews.

[12]  S. Pintea,et al.  Play seriously: Effectiveness of serious games and their features in motor rehabilitation. A meta-analysis. , 2017, NeuroRehabilitation.

[13]  R. Tallis,et al.  Reasons for variability in the reported rate of occurrence of unilateral spatial neglect after stroke. , 1999, Stroke.

[14]  U. Castiello,et al.  Improving left hemispatial neglect using virtual reality , 2004, Neurology.

[15]  P L Weiss,et al.  Interactive virtual environment training for safe street crossing of right hemisphere stroke patients with Unilateral Spatial Neglect , 2005, Disability and rehabilitation.

[16]  Margherita Russo,et al.  Use of virtual reality in improving poststroke neglect: Promising neuropsychological and neurophysiological findings from a case study , 2019, Applied neuropsychology. Adult.

[17]  Francesco Pavani,et al.  Acoustical Vision of Neglected Stimuli: Interaction among Spatially Converging Audiovisual Inputs in Neglect Patients , 2002, Journal of Cognitive Neuroscience.

[18]  Zhen He,et al.  The effectiveness of adaptive difficulty adjustments on students' motivation and learning in an educational computer game , 2013, Comput. Educ..

[19]  D. Robbins.  Partial reinforcement: A selective review of the alleyway literature since 1960. , 1971 .

[20]  Jae-Hun Kim,et al.  Virtual Environment Training System for Rehabilitation of Stroke Patients with Unilateral Neglect: Crossing the Virtual Street , 2007, Cyberpsychology Behav. Soc. Netw..

[21]  G. R. Fink,et al.  Impact of alertness training on spatial neglect: A behavioural and fMRI study , 2006, Neuropsychologia.

[22]  Rodney L. Myers,et al.  Virtual Reality and Left Hemineglect: A Technology for Assessment and Therapy , 2000, Cyberpsychology Behav. Soc. Netw..

[23]  H. Karnath,et al.  Trunk orientation as the determining factor of the 'contralateral' deficit in the neglect syndrome and as the physical anchor of the internal representation of body orientation in space. , 1991, Brain : a journal of neurology.

[24]  J. Eriksson,et al.  Increase of frontal neuronal activity in chronic neglect after training in virtual reality , 2018, Acta neurologica Scandinavica.

[25]  Stefania Serafin,et al.  Restorative Virtual Environment Design for Augmenting Nursing Home Rehabilitation , 2016 .

[26]  Paul-Christian Bürkner,et al.  brms: An R Package for Bayesian Multilevel Models Using Stan , 2017 .

[27]  R. Walker.  Eye Patching and the Rehabilitation of Visual Neglect , 1996 .

[28]  M. Behrmann,et al.  Competition between simultaneous stimuli modulated by location probability in hemispatial neglect , 2006, Neuropsychologia.

[29]  N A Borghese,et al.  Duckneglect: video-games based neglect rehabilitation. , 2013, Technology and health care : official journal of the European Society for Engineering and Medicine.

[30]  Marko Wilke,et al.  Fast semi-automated lesion demarcation in stroke , 2015, NeuroImage: Clinical.

[31]  Luciano Fasotti,et al.  Novel Insights in the Rehabilitation of Neglect , 2013, Front. Hum. Neurosci..

[32]  Gaetano Tieri,et al.  Virtual reality in cognitive and motor rehabilitation: facts, fiction and fallacies , 2018, Expert review of medical devices.

[33]  Anjan Chatterjee,et al.  Quantitative Analysis of Cancellation Tasks in Neglect , 1999, Cortex.

[34]  Pier Luca Lanzi,et al.  Exergaming and rehabilitation: A methodology for the design of effective and safe therapeutic exergames , 2016, Entertain. Comput..

[35]  S. Rafaeli,et al.  Studying Gamification: The Effect of Rewards and Incentives on Motivation , 2015 .

[36]  Chris Rorden,et al.  Non-spatially lateralized mechanisms in hemispatial neglect , 2003, Nature Reviews Neuroscience.

[37]  A. Geurts,et al.  Is Visuospatial Hemineglect Longitudinally Associated with Postural Imbalance in the Postacute Phase of Stroke? , 2009, Neurorehabilitation and neural repair.

[38]  D. Guitton,et al.  Gaze control in humans: eye-head coordination during orienting movements to targets within and beyond the oculomotor range. , 1987, Journal of neurophysiology.

[39]  J. Mattingley,et al.  Phasic alerting of neglect patients overcomes their spatial deficit in visual awareness , 1998, Nature.

[40]  H. Karnath,et al.  Spontaneous eye and head position in patients with spatial neglect , 2005, Journal of Neurology.

[41]  M. Corbetta,et al.  Spatial neglect and attention networks. , 2011, Annual review of neuroscience.

[42]  J. Visser-Meily,et al.  Pharmacological Treatment of Visuospatial Neglect: A Systematic Review. , 2017, Journal of stroke and cerebrovascular diseases : the official journal of National Stroke Association.

[43]  Joseph M. DeGutis,et al.  Human Neuroscience , 2022 .

[44]  Marco Pitteri,et al.  Ask the experts how to treat individuals with spatial neglect: a survey study , 2018, Disability and rehabilitation.

[45]  Terry E. Duncan,et al.  Psychometric properties of the Intrinsic Motivation Inventory in a competitive sport setting: a confirmatory factor analysis. , 1989, Research quarterly for exercise and sport.

[46]  Jan L. Plass,et al.  The effect of adaptive difficulty adjustment on the effectiveness of a game to develop executive function skills for learners of different ages , 2019, Cognitive Development.

[47]  Anouk Lamontagne,et al.  Perceptual and locomotor factors affect obstacle avoidance in persons with visuospatial neglect , 2014, Journal of NeuroEngineering and Rehabilitation.

[48]  Frederik Cornillie,et al.  The effectiveness of adaptive versus non-adaptive learning with digital educational games , 2019, J. Comput. Assist. Learn..

[49]  Jeffrey N. Rouder,et al.  Bayesian t tests for accepting and rejecting the null hypothesis , 2009, Psychonomic bulletin & review.

[50]  Tanja Nijboer,et al.  Predicting Functional Outcome after Stroke: The Influence of Neglect on Basic Activities in Daily Living , 2013, Front. Hum. Neurosci..

[51]  Helena Bilandzic,et al.  Measuring Narrative Engagement , 2009 .

[52]  Umberto Castiello,et al.  Virtual reality applications for the remapping of space in neglect patients. , 2006, Restorative neurology and neuroscience.

[53]  Chris Rorden,et al.  Age-specific CT and MRI templates for spatial normalization , 2012, NeuroImage.

[54]  Clayton Lewis,et al.  Designing for usability—key principles and what designers think , 1983, CHI '83.

[55]  Sabine Coquillart,et al.  Uses of Virtual Reality for Diagnosis, Rehabilitation and Study of Unilateral Spatial Neglect: Review and Analysis , 2009, Cyberpsychology Behav. Soc. Netw..

[56]  Sungmin Cho,et al.  Development and validation of virtual prism adaptation therapy , 2017, 2017 International Conference on Virtual Rehabilitation (ICVR).

[57]  Daniel F. Keefe,et al.  Virtual reality for persistent pain: A new direction for behavioral pain management , 2012, PAIN®.

[58]  Robert J. Moore,et al.  "Alone together?": exploring the social dynamics of massively multiplayer online games , 2006, CHI.

[59]  N. A. Borghese,et al.  User Perspectives on Exergames Designed to Explore the Hemineglected Space for Stroke Patients With Visuospatial Neglect: Usability Study , 2017, JMIR serious games.

[60]  P. Bartolomeo,et al.  Modulating the attentional bias in unilateral neglect: the effects of the strategic set , 2001, Experimental Brain Research.

[61]  Pamela J. Wisniewski,et al.  A comparison of eye-head coordination between virtual and physical realities , 2018, SAP.

[62]  B. Anderson,et al.  Spatial probability cuing and right hemisphere damage , 2012, Brain and Cognition.

[63]  Cinara Stein,et al.  Noninvasive Brain Stimulation Improves Hemispatial Neglect After Stroke: A Systematic Review and Meta-Analysis. , 2017, Archives of physical medicine and rehabilitation.

[64]  Kenneth M. Heilman,et al.  Hemispace and Hemispatial Neglect , 1987 .

[65]  K. Bodin,et al.  RehAtt – scanning training for neglect enhanced by multi-sensory stimulation in Virtual Reality , 2016, Topics in stroke rehabilitation.

[66]  H. Iwata,et al.  Differing effects of an immersive virtual reality programme on unilateral spatial neglect on activities of daily living , 2018, BMJ Case Reports.

[67]  C. Gillebert,et al.  The Dutch version of the Oxford Cognitive Screen (OCS-NL): normative data and their association with age and socio-economic status , 2019, Neuropsychology, development, and cognition. Section B, Aging, neuropsychology and cognition.

[68]  Phil Wilkinson,et al.  A Brief History of Serious Games , 2016, Entertainment Computing and Serious Games.

[69]  Donald A. Norman,et al.  Natural user interfaces are not natural , 2010, INTR.

[70]  M. Jane Riddoch,et al.  Test–retest stability of three tests for unilateral visual neglect in patients with stroke: Star Cancellation, Line Bisection, and the Baking Tray Task , 2004 .

[71]  Werner X. Schneider,et al.  Using the virtual reality device Oculus Rift for neuropsychological assessment of visual processing capabilities , 2016, Scientific Reports.

[72]  G. Fink,et al.  Combined Space and Alertness Related Therapy of Visual Hemineglect: Effect of Therapy Frequency , 2013, Front. Hum. Neurosci..

[73]  Ricardo Gutierrez-Osuna,et al.  Partial Reinforcement in Game Biofeedback for Relaxation Training , 2021, IEEE Transactions on Affective Computing.

[74]  Giuseppe Riva,et al.  Assessment and rehabilitation of neglect using virtual reality: a systematic review , 2015, Front. Behav. Neurosci..

[75]  David Alais,et al.  A bias for looming stimuli to predominate in binocular rivalry , 2007, Vision Research.

[76]  Hans-Otto Karnath,et al.  A simple measure of neglect severity , 2010, Neuropsychologia.

[77]  Albert A. Rizzo,et al.  Is clinical virtual reality ready for primetime? , 2017, Neuropsychology.

[78]  S. Cermak,et al.  The Behavioral Inattention Test for Unilateral Visual Neglect , 1989 .

[79]  C. Gillebert,et al.  Quantifying egocentric spatial neglect with cancellation tasks: A theoretical validation. , 2018, Journal of neuropsychology.

[80]  Kevin Dent,et al.  Neuropsychological evidence for a competitive bias against contracting stimuli , 2011, Neurocase.

[81]  M M Mesulam,et al.  Visual hemispatial inattention: stimulus parameters and exploratory strategies. , 1988, Journal of neurology, neurosurgery, and psychiatry.

[82]  Ralf Dörner,et al.  Entertainment Computing and Serious Games - International GI-Dagstuhl Seminar 15283 , 2016 .

[83]  Albert A. Rizzo,et al.  Analysis of assets for virtual reality applications in neuropsychology , 2004 .

[84]  Maša Popović,et al.  Feedback-Mediated Upper Extremities Exercise: Increasing Patient Motivation in Poststroke Rehabilitation , 2014, BioMed research international.

[85]  W. H. Brouwer,et al.  Visual Scanning Training for Neglect after Stroke with and without a Computerized Lane Tracking Dual Task , 2013, Front. Hum. Neurosci..

[86]  C. Gillebert,et al.  Non-Spatial Impairments Affect False-Positive Neglect Diagnosis Based on Cancellation Tasks , 2020, Journal of the International Neuropsychological Society.

[87]  Peter König,et al.  Eye–Head Coordination during Free Exploration in Human and Cat , 2009, Annals of the New York Academy of Sciences.

[88]  Darryl Charles,et al.  Optimising engagement for stroke rehabilitation using serious games , 2009, The Visual Computer.

[89]  Gazihan Alankus,et al.  Towards customizable games for stroke rehabilitation , 2010, CHI.

[90]  Jonathan Freeman,et al.  A Cross-Media Presence Questionnaire: The ITC-Sense of Presence Inventory , 2001, Presence: Teleoperators & Virtual Environments.