Commanding a Brain-Controlled Wheelchair Using Steady-State Somatosensory Evoked Potentials

In this work, we propose a novel brain-controlled wheelchair, one of the major applications of brain–machine interfaces (BMIs), that allows an individual with mobility impairments to perform daily living activities independently. Specifically, we propose to use a steady-state somatosensory evoked potential (SSSEP) paradigm, which elicits brain responses to tactile stimulation of specific frequencies, for a user’s intention to control a wheelchair. In our system, a user had three possible commands by concentrating on one of three vibration stimuli, which were attached to the left-hand, right-hand, and right-foot, to selectively control the wheelchair. The three stimuli were associated with three wheelchair commands: turn-left, turn-right, and move-forward. From a machine learning perspective, we also devise a novel feature representation by combining spatial and spectral characteristics of brain signals. In order to validate the effectiveness of the proposed SSSEP-based system, we considered two different tasks: 1) a simple obstacle-avoidance task within a limited time and; 2) a driving task along the predefined trajectory of about 40 m length, where there were a narrow pathway, a door, and obstacles. In both experiments, we recruited 12 subjects and compared the average time of motor imagery (MI) and SSSEP-based controls to complete the task. With the SSSEP-based control, all subjects successfully completed the task without making any collision while four subjects failed it with MI-based control. It is also noteworthy that in terms of the average time to complete the task, the SSSEP-based control outperformed the MI-based control. In the other more challenging task, all subjects successfully reached the target location.

[1]  J. Friedman Regularized Discriminant Analysis , 1989 .

[2]  Arun Khosla,et al.  Influence of stimuli colour in SSVEP-based BCI wheelchair control using support vector machines , 2014, Journal of medical engineering & technology.

[3]  Andrzej Cichocki,et al.  Common spatial patterns for steady-state somatosensory evoked potentials , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[4]  Jianjun Meng,et al.  Combining Motor Imagery With Selective Sensation Toward a Hybrid-Modality BCI , 2014, IEEE Transactions on Biomedical Engineering.

[5]  Yuanqing Li,et al.  A Hybrid BCI System Combining P300 and SSVEP and Its Application to Wheelchair Control , 2013, IEEE Transactions on Biomedical Engineering.

[6]  Urbano Nunes,et al.  Assisted navigation for a brain-actuated intelligent wheelchair , 2013, Robotics Auton. Syst..

[7]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[8]  D. Regan Human brain electrophysiology: Evoked potentials and evoked magnetic fields in science and medicine , 1989 .

[9]  G. Pfurtscheller,et al.  Steady-state somatosensory evoked potentials: suitable brain signals for brain-computer interfaces? , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Brice Rebsamen,et al.  A brain controlled wheelchair to navigate in familiar environments. , 2010, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[11]  M. Nuttin,et al.  A brain-actuated wheelchair: Asynchronous and non-invasive Brain–computer interfaces for continuous control of robots , 2008, Clinical Neurophysiology.

[12]  Wanderley Cardoso Celeste,et al.  Brain-computer Interface Based on Visual Evoked Potentials to Command Autonomous Robotic Wheelchair , 2010 .

[13]  Iñaki Iturrate,et al.  A Noninvasive Brain-Actuated Wheelchair Based on a P300 Neurophysiological Protocol and Automated Navigation , 2009, IEEE Transactions on Robotics.

[14]  O. Bai,et al.  Electroencephalography (EEG)-Based Brain–Computer Interface (BCI): A 2-D Virtual Wheelchair Control Based on Event-Related Desynchronization/Synchronization and State Control , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  Vera Kaiser,et al.  Stability and distribution of steady-state somatosensory evoked potentials elicited by vibro-tactile stimulation , 2012, Medical & Biological Engineering & Computing.

[16]  G. Pfurtscheller,et al.  „Resonance-like“ Frequencies of Sensorimotor Areas Evoked by Repetitive Tactile Stimulation - Resonanzeffekte in sensomotorischen Arealen, evoziert durch rhythmische taktile Stimulation , 2001, Biomedizinische Technik. Biomedical engineering.

[17]  Jason Farquhar,et al.  A multi-signature brain–computer interface: use of transient and steady-state responses , 2013, Journal of neural engineering.

[18]  Heung-Il Suk,et al.  Non-homogeneous spatial filter optimization for ElectroEncephaloGram (EEG)-based motor imagery classification , 2013, Neurocomputing.

[19]  Sangtae Ahn,et al.  Achieving a hybrid brain–computer interface with tactile selective attention and motor imagery , 2014, Journal of neural engineering.

[20]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[21]  Kyuwan Choi Control of a vehicle with EEG signals in real-time and system evaluation , 2011, European Journal of Applied Physiology.

[22]  Salil H. Patel,et al.  Characterization of N200 and P300: Selected Studies of the Event-Related Potential , 2005, International journal of medical sciences.

[23]  C. Neuper,et al.  Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges , 2010, Front. Neurosci..

[24]  Mário Sarcinelli-Filho,et al.  Commanding a robotic wheelchair with a high-frequency steady-state visual evoked potential based brain-computer interface. , 2013, Medical engineering & physics.

[25]  H. Flor,et al.  A multimodal brain-based feedback and communication system , 2004, Experimental Brain Research.

[26]  D J McFarland,et al.  An EEG-based brain-computer interface for cursor control. , 1991, Electroencephalography and clinical neurophysiology.

[27]  A. Kübler,et al.  Toward brain-computer interface based wheelchair control utilizing tactually-evoked event-related potentials , 2014, Journal of NeuroEngineering and Rehabilitation.

[28]  L. Cohen,et al.  Brain–computer interfaces: communication and restoration of movement in paralysis , 2007, The Journal of physiology.

[29]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[30]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[31]  J. Wolpaw,et al.  A P300-based brain–computer interface for people with amyotrophic lateral sclerosis , 2008, Clinical Neurophysiology.

[32]  Stefan Haufe,et al.  Detection of braking intention in diverse situations during simulated driving based on EEG feature combination , 2015, Journal of neural engineering.

[33]  Jie Li,et al.  A hybrid brain computer interface system based on the neurophysiological protocol and brain-actuated switch for wheelchair control , 2014, Journal of Neuroscience Methods.

[34]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[35]  J. Wolpaw,et al.  Brain-computer communication: unlocking the locked in. , 2001, Psychological bulletin.

[36]  Yuanqing Li,et al.  A Hybrid Brain Computer Interface to Control the Direction and Speed of a Simulated or Real Wheelchair , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[37]  J. Wolpaw,et al.  Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface , 2005, Neurology.

[38]  Jianjun Meng,et al.  Selective Sensation Based Brain-Computer Interface via Mechanical Vibrotactile Stimulation , 2013, PloS one.

[39]  Klaus-Robert Müller,et al.  Predicting BCI Subject Performance Using Probabilistic Spatio-Temporal Filters , 2014, PloS one.

[40]  Heung-Il Suk,et al.  A Novel Bayesian Framework for Discriminative Feature Extraction in Brain-Computer Interfaces , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  A. Cichocki,et al.  Steady-state visually evoked potentials: Focus on essential paradigms and future perspectives , 2010, Progress in Neurobiology.

[42]  Benjamin Blankertz,et al.  Towards a Cure for BCI Illiteracy , 2009, Brain Topography.

[43]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.