A virtual reality platform for safe evaluation and training of natural gaze-based wheelchair driving

The importance of ensuring user safety throughout the training and evaluation process of brain-machine interfaces is not to be neglected. In this study, a virtual reality software system was built with the intention to create a safe environment, where the performance of wheelchair control interfaces could be tested and compared. We use this to evaluate our eye tracking input methodology, a promising solution for hands-free wheelchair navigation, because of the abundance of control commands that it offers and its intuitive nature. Natural eye movements have long been considered to reflect cognitive processes and are highly correlated with user intentions. Therefore, the sequence of gaze locations during navigation is recorded and analyzed, in order to search and unveil patterns in saccadic movements. Moreover, this study compares different eye-based solutions that have previously been implemented, and proposes a new, more natural approach. The preliminary results on N = 6 healthy subjects indicate that the proposed free-view solution leads to 18.4% faster completion of the task (440 sec) benchmarked against a naive free-view approach.

[1]  S. P. Levine,et al.  Adaptive shared control of a smart wheelchair operated by voice control , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[2]  S. P. Levine,et al.  Voice control of a powered wheelchair , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Kazuo Tanaka,et al.  Electroencephalogram-based control of an electric wheelchair , 2005, IEEE Transactions on Robotics.

[4]  Huosheng Hu,et al.  Head gesture recognition for hands-free control of an intelligent wheelchair , 2007, Ind. Robot.

[5]  Huosheng Hu,et al.  A Human – Computer Interface based on Forehead Multi-Channel Bio-signals to Control a Virtual Wheelchair , 2002 .

[6]  Laurel J Buxbaum,et al.  Assessment of spatial attention and neglect with a virtual wheelchair navigation task , 2008, Journal of clinical and experimental neuropsychology.

[7]  William W. Abbott,et al.  Large-field study of ultra low-cost, non-invasive task level BMI , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[8]  Gernot R. Müller-Putz,et al.  Self-Paced (Asynchronous) BCI Control of a Wheelchair in Virtual Environments: A Case Study with a Tetraplegic , 2007, Comput. Intell. Neurosci..

[9]  Hiroshi Mitsumoto,et al.  Differential Susceptibility of the Ocular Motor System to Disease , 2002, Annals of the New York Academy of Sciences.

[10]  Chern-Sheng Lin,et al.  Powered Wheelchair Controlled by Eye-Tracking System , 2006 .

[11]  Huosheng Hu,et al.  EMG-based hands-free wheelchair control with EOG attention shift detection , 2007, 2007 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[12]  E. A. Attree,et al.  Application of virtual reality technology to the assessment and training of powered wheelchair users , 2000 .

[13]  Meike Jipp,et al.  Easing Wheelchair Control by Gaze-based Estimation of Intended Motion , 2008 .

[14]  John R. Hershey,et al.  Approximating the Kullback Leibler Divergence Between Gaussian Mixture Models , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[15]  Y. Matsumoto Development of intelligent wheelchair system with face and gaze based interface , 2001 .

[16]  E. A. Attree,et al.  The role of virtual reality technology in the assessment and training of inexperienced powered wheelchair users , 2002, Disability and rehabilitation.

[17]  Kazuhiko Takahashi,et al.  Wheelchair control using an EOG- and EMG-based gesture interface , 2009, 2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[18]  W W Abbott,et al.  Ultra-low-cost 3D gaze estimation: an intuitive high information throughput compliment to direct brain–machine interfaces , 2012, Journal of neural engineering.

[19]  Adam Jacoff,et al.  A Standard Test Course for Urban Search and Rescue Robots , 2000 .

[20]  Erik Wästlund,et al.  What you see is where you go: testing a gaze-driven power wheelchair for individuals with severe multiple disabilities , 2010, ETRA.

[21]  N. Hogan,et al.  The effect of robot-assisted therapy and rehabilitative training on motor recovery following stroke. , 1997, Archives of neurology.

[22]  Nigel Foreman,et al.  VR and spatial awareness in disabled children , 1997, CACM.

[23]  L Fehr,et al.  Adequacy of power wheelchair control interfaces for persons with severe disabilities: a clinical survey. , 2000, Journal of rehabilitation research and development.

[24]  Kohei Arai,et al.  A Prototype of ElectricWheelchair Controlled by Eye-Only for Paralyzed User , 2011, J. Robotics Mechatronics.

[25]  Manuel Mazo,et al.  Electro-Oculographic Guidance of a Wheelchair Using Eye Movements Codification , 2003, Int. J. Robotics Res..