An asynchronous wheelchair control by hybrid EEG–EOG brain–computer interface

Wheelchair control requires multiple degrees of freedom and fast intention detection, which makes electroencephalography (EEG)-based wheelchair control a big challenge. In our previous study, we have achieved direction (turning left and right) and speed (acceleration and deceleration) control of a wheelchair using a hybrid brain–computer interface (BCI) combining motor imagery and P300 potentials. In this paper, we proposed hybrid EEG-EOG BCI, which combines motor imagery, P300 potentials, and eye blinking to implement forward, backward, and stop control of a wheelchair. By performing relevant activities, users (e.g., those with amyotrophic lateral sclerosis and locked-in syndrome) can navigate the wheelchair with seven steering behaviors. Experimental results on four healthy subjects not only demonstrate the efficiency and robustness of our brain-controlled wheelchair system but also indicate that all the four subjects could control the wheelchair spontaneously and efficiently without any other assistance (e.g., an automatic navigation system).

[1]  Iñaki Iturrate,et al.  A Noninvasive Brain-Actuated Wheelchair Based on a P300 Neurophysiological Protocol and Automated Navigation , 2009, IEEE Transactions on Robotics.

[2]  Xiaoou Li,et al.  A brain controlled wheelchair based on common spatial pattern , 2015, 2015 International Symposium on Bioelectronics and Bioinformatics (ISBB).

[3]  Klaus-Robert Müller,et al.  Boosting bit rates in noninvasive EEG single-trial classifications by feature combination and multiclass paradigms , 2004, IEEE Transactions on Biomedical Engineering.

[4]  John Shawe-Taylor,et al.  Canonical Correlation Analysis: An Overview with Application to Learning Methods , 2004, Neural Computation.

[5]  G Pfurtscheller,et al.  Current trends in Graz Brain-Computer Interface (BCI) research. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[6]  Wan Kyun Chung,et al.  Development of human-mobile communication system using electrooculogram signals , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[7]  Yuanqing Li,et al.  A Hybrid Brain Computer Interface to Control the Direction and Speed of a Simulated or Real Wheelchair , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  Masaki Nakanishi,et al.  Wheelchair control system by using electrooculogram signal processing , 2013, The 19th Korea-Japan Joint Workshop on Frontiers of Computer Vision.

[9]  Ali Bülent Usakli,et al.  Improvement of EEG Signal Acquisition: An Electrical Aspect for State of the Art of Front End , 2010, Comput. Intell. Neurosci..

[10]  G. Pfurtscheller,et al.  Self-Paced Operation of an SSVEP-Based Orthosis With and Without an Imagery-Based “Brain Switch:” A Feasibility Study Towards a Hybrid BCI , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  M. Nuttin,et al.  Asynchronous non-invasive brain-actuated control of an intelligent wheelchair , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Gilles Blanchard,et al.  BCI competition 2003-data set IIa: spatial patterns of self-controlled brain rhythm modulations , 2004, IEEE Transactions on Biomedical Engineering.

[13]  Haihong Zhang,et al.  A Brain-Controlled Wheelchair Based on P300 and Path Guidance , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[14]  G Pfurtscheller,et al.  Toward a hybrid brain–computer interface based on imagined movement and visual attention , 2010, Journal of neural engineering.

[15]  Yuanqing Li,et al.  An EEG-Based BCI System for 2-D Cursor Control by Combining Mu/Beta Rhythm and P300 Potential , 2010, IEEE Transactions on Biomedical Engineering.

[16]  N. Birbaumer slow Cortical Potentials: Plasticity, Operant Control, and Behavioral Effects , 1999 .

[17]  Yuanqing Li,et al.  A Hybrid BCI System Combining P300 and SSVEP and Its Application to Wheelchair Control , 2013, IEEE Transactions on Biomedical Engineering.

[18]  D. Borghetti,et al.  A low-cost interface for control of computer functions by means of eye movements , 2007, Comput. Biol. Medicine.

[19]  Fabio Babiloni,et al.  On the Use of Electrooculogram for Efficient Human Computer Interfaces , 2009, Comput. Intell. Neurosci..

[20]  Chao Zhang,et al.  Implementation of the EOG-Based Human Computer Interface System , 2008, 2008 2nd International Conference on Bioinformatics and Biomedical Engineering.

[21]  Brice Rebsamen,et al.  A brain controlled wheelchair to navigate in familiar environments. , 2010, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[22]  O. Bai,et al.  Electroencephalography (EEG)-Based Brain–Computer Interface (BCI): A 2-D Virtual Wheelchair Control Based on Event-Related Desynchronization/Synchronization and State Control , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  E. Donchin,et al.  Brain-computer interface research at the university of south Florida cognitive psychophysiology laboratory: the P300 speller , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Yuanqing Li,et al.  Joint feature re-extraction and classification using an iterative semi-supervised support vector machine algorithm , 2008, Machine Learning.

[25]  Mark B Bromberg,et al.  Quality of life in amyotrophic lateral sclerosis. , 2008, Physical medicine and rehabilitation clinics of North America.

[26]  James P Donnelly,et al.  ALS: Family caregiver needs and quality of life , 2008, Amyotrophic lateral sclerosis : official publication of the World Federation of Neurology Research Group on Motor Neuron Diseases.

[27]  Ying Sun,et al.  Asynchronous P300 BCI: SSVEP-based control state detection , 2010, 2010 18th European Signal Processing Conference.

[28]  Xiaorong Gao,et al.  An online multi-channel SSVEP-based brain–computer interface using a canonical correlation analysis method , 2009, Journal of neural engineering.