Using finite state machine and a hybrid of EEG signal and EOG artifacts for an asynchronous wheelchair navigation

Asynchronous wheelchair navigation system using EEG signals and EOG artifacts.Horizontal gazes are observed at C3, C4 and eyelid positions at O2.The system is modeled as a finite state machine with three states for each mode.Total of six different directions move in forward and backward.Actual navigation tasks are performed and registered an average accuracy of 97.5%. In this study, an asynchronous wheelchair navigation system using a hybrid of EEG signal and EOG artifacts embedded in EEG signals is demonstrated. The EEG signals are recorded at three different locations on the scalp in the occipital and motor cortex regions. First, an EEG signal related to eyelid position is analyzed and used to determine whether the eyes are closed or open. If the eyes are closed, no wheelchair movement is allowed. If the eyes are open, EOG traces (artifacts) from two other EEG signals are examined to infer the gaze direction of the eyes. A sliding window is utilized to position important cues in the trace signals at the center of the window for effective classification. The variance of the EEG signal is used to determine the eyelid position by thresholding. Then, features extracted from the EOG traces are used as inputs to a pair of minimum distance classifiers whose outputs reveal the gaze shift performed by the eyes. The wheelchair navigation system is designed to move forward and backward in a total of six different directions. However, the number of distinct gaze direction that can be used as commands to move the wheelchair is only three. Therefore, we model the system as a finite state machine with three modes, each containing three states to overcome this deficiency. The system is equipped with proximity sensor to avoid collision with obstacles. A stop command is also available for safety measures. In a real-time experiment involving 20 participants, the system performed well as it registered a high accuracy of 97.88% with an average of computational time less than 1s. The system was also tested by five participants in a navigation experiment where each participant successfully completed all tasks without collision while showing improvement in maneuvering ability over attempts.

[1]  Dirk Hagemann,et al.  The effects of ocular artifacts on (lateralized) broadband power in the EEG , 2001, Clinical Neurophysiology.

[2]  Doru Talaba,et al.  EOG-based visual navigation interface development , 2012, Expert Syst. Appl..

[3]  Jie Li,et al.  A hybrid brain computer interface system based on the neurophysiological protocol and brain-actuated switch for wheelchair control , 2014, Journal of Neuroscience Methods.

[4]  G Pfurtscheller,et al.  EEG-based communication: improved accuracy by response verification. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[5]  Sungho Jo,et al.  Electric wheelchair control using head pose free eye-gaze tracker , 2012 .

[6]  Yuanqing Li,et al.  An asynchronous wheelchair control by hybrid EEG–EOG brain–computer interface , 2014, Cognitive Neurodynamics.

[7]  M. Ghovanloo,et al.  The Tongue Enables Computer and Wheelchair Control for People with Spinal Cord Injury , 2013, Science Translational Medicine.

[8]  Nguyen Thanh Hai,et al.  Mean Threshold and ARNN Algorithms for Identification of Eye Commands in an EEG-Controlled Wheelchair , 2013 .

[9]  Sneh Anand,et al.  Brain Computer Interface Based Real Time Control of Wheelchair Using Electroencephalogram , 2011 .

[10]  Sungho Jo,et al.  A Low-Cost EEG System-Based Hybrid Brain-Computer Interface for Humanoid Robot Navigation and Recognition , 2013, PloS one.

[11]  José del R. Millán,et al.  Context-Based Filtering for Assisted Brain-Actuated Wheelchair Driving , 2007, Comput. Intell. Neurosci..

[12]  Dongyi Chen,et al.  Robust Bio-Signal Based Control of an Intelligent Wheelchair , 2013, Robotics.

[13]  Urbano Nunes,et al.  Assisted navigation for a brain-actuated intelligent wheelchair , 2013, Robotics Auton. Syst..

[14]  Yuanqing Li,et al.  A Hybrid Brain Computer Interface to Control the Direction and Speed of a Simulated or Real Wheelchair , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  Panagiotis D. Bamidis,et al.  REG-ICA: A hybrid methodology combining Blind Source Separation and regression techniques for the rejection of ocular artifacts , 2011, Biomed. Signal Process. Control..

[16]  E-J Hoogerwerf,et al.  Clinical evaluation of BrainTree, a motor imagery hybrid BCI speller , 2014, Journal of neural engineering.

[17]  Brice Rebsamen,et al.  A brain controlled wheelchair to navigate in familiar environments. , 2010, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[18]  Christian Mandel,et al.  Navigating a smart wheelchair with a brain-computer interface interpreting steady-state visual evoked potentials , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  M. Nuttin,et al.  A brain-actuated wheelchair: Asynchronous and non-invasive Brain–computer interfaces for continuous control of robots , 2008, Clinical Neurophysiology.

[20]  Huosheng Hu,et al.  A Self-Paced Motor Imagery Based Brain-Computer Interface for Robotic Wheelchair Control , 2011, Clinical EEG and neuroscience.

[21]  Luis Montesano,et al.  Towards an Intelligent Wheelchair System for Users With Cerebral Palsy , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  O. Bai,et al.  Electroencephalography (EEG)-Based Brain–Computer Interface (BCI): A 2-D Virtual Wheelchair Control Based on Event-Related Desynchronization/Synchronization and State Control , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  Imad Mougharbel,et al.  Comparative study on different adaptation approaches concerning a sip and puff controller for a powered wheelchair , 2013, 2013 Science and Information Conference.

[24]  Haibo Li,et al.  Active vision for controlling an electric wheelchair , 2011, Intelligent Service Robotics.

[25]  Holly A. Yanco,et al.  Improved interfaces for human-robot interaction in urban search and rescue , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[26]  A. Kübler,et al.  Toward brain-computer interface based wheelchair control utilizing tactually-evoked event-related potentials , 2014, Journal of NeuroEngineering and Rehabilitation.

[27]  Andrés Úbeda,et al.  Assistive robot application based on an RFID control architecture and a wireless EOG interface , 2012, Robotics Auton. Syst..

[28]  Kyuwan Choi,et al.  Control of a Wheelchair by Motor Imagery in Real Time , 2008, IDEAL.

[29]  P. Berg,et al.  Ocular artifacts in EEG and event-related potentials I: Scalp topography , 2005, Brain Topography.

[30]  Iñaki Iturrate,et al.  A Noninvasive Brain-Actuated Wheelchair Based on a P300 Neurophysiological Protocol and Automated Navigation , 2009, IEEE Transactions on Robotics.

[31]  G. Vanacker,et al.  Adaptive Shared Control of a Brain-Actuated Simulated Wheelchair , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[32]  Mário Sarcinelli-Filho,et al.  Commanding a robotic wheelchair with a high-frequency steady-state visual evoked potential based brain-computer interface. , 2013, Medical engineering & physics.

[33]  Horst Bischof,et al.  Toward Self-Paced Brain–Computer Communication: Navigation Through Virtual Worlds , 2008, IEEE Transactions on Biomedical Engineering.

[34]  R. Sudirman,et al.  Guiding Wheelchair Motion Based on EOG Signals Using Tangent Bug Algorithm , 2011, 2011 Third International Conference on Computational Intelligence, Modelling & Simulation.

[35]  Guanglin Li,et al.  Hybrid brain/muscle-actuated control of an intelligent wheelchair , 2013, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[36]  Haihong Zhang,et al.  A Brain-Controlled Wheelchair Based on P300 and Path Guidance , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[37]  Mohamed Moncef Ben Khelifa,et al.  A brain and gaze-controlled wheelchair , 2013, Computer methods in biomechanics and biomedical engineering.

[38]  Tong Liu,et al.  Human Brain Control of Electric Wheelchair with Eye-Blink Electrooculogram Signal , 2012, ICIRA.