Multi-modal Sensing System for Unilateral Spatial Neglect in Computational System Rehabilitation

This paper presents a multi-modal sensing system for USN assessment with eye tracker, 3D image sensor and tablet PC. First, we introduce the multi-modal sensing system based on the concept of computational system rehabilitation. Next, we propose a computational approach to extract behavioral and perceptional features of USN patients from the heterogeneous data. Furthermore, we show an experimental example to discuss the effectiveness and applicability to the feature extraction.

[1]  J. Fung,et al.  Visuomotor Control Post Stroke Can be Affected by a History of Visuospatial Neglect , 2012 .

[2]  G. Riva,et al.  The Use of Virtual Reality Tools for the Assessment of Executive Functions and Unilateral Spatial Neglect , 2016 .

[3]  H. Iwata,et al.  Validation of an immersive virtual reality system for training near and far space neglect in individuals with stroke: a pilot study , 2017, Topics in stroke rehabilitation.

[4]  Bernd Fritzke.  Growing Cell Structures – a Self-organizing Network in k Dimensions , 1992 .

[5]  Min Ho Chun,et al.  The Effect of Virtual Reality Training on Unilateral Spatial Neglect in Stroke Patients , 2011, Annals of rehabilitation medicine.

[6]  Laurel J Buxbaum,et al.  Assessment of spatial attention and neglect with a virtual wheelchair navigation task , 2008, Journal of clinical and experimental neuropsychology.

[7]  Elena Navarro,et al.  Multisensory Treatment of the Hemispatial Neglect by Means of Virtual Reality and Haptic Techniques , 2015, IWINAC.

[8]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[9]  A. Lamontagne,et al.  Exploring barriers and facilitators to the clinical use of virtual reality for post-stroke unilateral spatial neglect assessment , 2019, Disability and rehabilitation.

[10]  N. Kubota,et al.  Motion analysis for unilateral spatial neglect in computational system rehabilitation , 2017, 2017 6th International Conference on Informatics, Electronics and Vision & 2017 7th International Symposium in Computational Medical and Health Technology (ICIEV-ISCMHT).

[11]  Bernd Fritzke,et al.  Unsupervised clustering with growing cell structures , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[12]  N. Kubota,et al.  Human motion tracking and feature extraction for cognitive rehabilitation in informationally structured space , 2012, 2012 9th France-Japan & 7th Europe-Asia Congress on Mechatronics (MECATRONICS) / 13th Int'l Workshop on Research and Education in Mechatronics (REM).

[13]  Bernd Fritzke,et al.  A Growing Neural Gas Network Learns Topologies , 1994, NIPS.

[14]  Stephen R. Marsland,et al.  A self-organising network that grows when required , 2002, Neural Networks.

[15]  A. Carter,et al.  Inducing Visuomotor Adaptation Using Virtual Reality Gaming with a Virtual Shift as a Treatment for Unilateral Spatial Neglect , 2016 .

[16]  E. Reed.  The Ecological Approach to Visual Perception , 1989 .

[17]  J Whyte,et al.  Hemispatial neglect , 2004, Neurology.

[18]  Drew Linsley,et al.  Reliability and validity of the Virtual Reality Lateralized Attention Test in assessing hemispatial neglect in right-hemisphere stroke. , 2012, Neuropsychology.

[19]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[20]  G. Riva,et al.  Assessing Unilateral Spatial Neglect using advanced technologies: The potentiality of mobile virtual reality. , 2015, Technology and health care : official journal of the European Society for Engineering and Medicine.

[21]  Makoto Yoshizawa,et al.  Virtual Reality Pencil and Paper Tests for Neglect: A Protocol , 2006, Cyberpsychology Behav. Soc. Netw..

[22]  Bernd Fritzke.  Growing self-organizing networks - Why ? , 1996, ESANN.

[23]  Sasan Mosadeghi,et al.  Feasibility of an Immersive Virtual Reality Intervention for Hospitalized Patients: An Observational Cohort Study , 2016, JMIR mental health.

[24]  R. Tallis,et al.  Reasons for variability in the reported rate of occurrence of unilateral spatial neglect after stroke. , 1999, Stroke.