A Brain-Wave-Actuated Small Robot Car Using Ensemble Empirical Mode Decomposition-Based Approach

An ensemble empirical mode decomposition (EEMD)-based approach was developed to extract steady-state visual evoked potentials (SSVEPs) for wireless handling of a small robot car. Three visual stimuli, flickering at 13, 14, and 15 Hz, were displayed on a liquid crystal display monitor to induce user's SSVEPs. The induced SSVEPs were used to control three movement functions (forward, left, and right) of the small robot car. Users gazed at one chosen visual stimulus at one time, and the induced SSVEP was recognized to activate the desired movement function. In this paper, all subjects were requested to handle the small robot car to complete an S-shaped course four times. The proposed system utilized only one electroencephalography (EEG) channel placed at the Oz position. The acquired EEG signals were first segmented into 1-s epochs, and each epoch was then decomposed by EEMD into a series of oscillation components, denoted as intrinsic oscillatory functions (IOFs), representing multiscale features of the recorded signal. The SSVEP-related IOFs were then recognized using a matched filter detector (MFD), including a matched filter demodulator and an amplitude detector. The visual stimulus, which contributed maximum power to the MFD, was recognized as the gazed target. In this paper, all subjects could actuate the small robot car using the proposed EEMD-based brain computer interface system to complete an S-shaped course four times; the mean execution time, number of valid detections, and command transfer interval over the 11 subjects were 84.5 s, 51.13 commands, and 1.65 s/command, respectively.

[1]  Y C Fung,et al.  Engineering analysis of biological variables: an example of blood pressure over 1 day. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[2]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[3]  Erich E. Sutter,et al.  The brain response interface: communication through visually-induced electrical brain responses , 1992 .

[4]  Y C Fung,et al.  Nonlinear indicial response of complex nonstationary oscillations as pulmonary hypertension responding to step hypoxia. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Xiaorong Gao,et al.  Design and implementation of a brain-computer interface with high transfer rates , 2002, IEEE Transactions on Biomedical Engineering.

[6]  M. Nuttin,et al.  A brain-actuated wheelchair: Asynchronous and non-invasive Brain–computer interfaces for continuous control of robots , 2008, Clinical Neurophysiology.

[7]  M. V. Gerven,et al.  Attention modulations of posterior alpha as a control signal for two-dimensional brain–computer interfaces , 2009, Journal of Neuroscience Methods.

[8]  Po-Lei Lee,et al.  Extraction of single-trial cortical beta oscillatory activities in EEG signals using empirical mode decomposition , 2010, Biomedical engineering online.

[9]  Guillaume Chanel,et al.  Emotion Assessment From Physiological Signals for Adaptation of Game Difficulty , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[10]  Dezhong Yao,et al.  Frequency detection with stability coefficient for steady-state visual evoked potential (SSVEP)-based BCIs. , 2008, Journal of neural engineering.

[11]  Gary E. Birch,et al.  A brain-controlled switch for asynchronous control applications , 2000, IEEE Trans. Biomed. Eng..

[12]  T. Heskes,et al.  Covert attention allows for continuous control of brain–computer interfaces , 2010, The European journal of neuroscience.

[13]  Jose M. Carmena,et al.  System Architecture for Stiffness Control in Brain–Machine Interfaces , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[14]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[15]  A. Engel,et al.  An independent brain–computer interface using covert non-spatial visual selective attention , 2010, Journal of neural engineering.

[16]  Norden E. Huang,et al.  Ensemble Empirical Mode Decomposition: a Noise-Assisted Data Analysis Method , 2009, Adv. Data Sci. Adapt. Anal..

[17]  G Pfurtscheller,et al.  EEG-based communication: improved accuracy by response verification. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[18]  Ivan Volosyak,et al.  Multiple Channel Detection of Steady-State Visual Evoked Potentials for Brain-Computer Interfaces , 2007, IEEE Transactions on Biomedical Engineering.

[19]  Rainer Spehlmann.  Evoked potential primer: Visual, auditory, and somatosensory evoked potentials in clinical diagnosis , 1985 .

[20]  H. Flor,et al.  The thought translation device (TTD) for completely paralyzed patients. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[21]  Chia-Wei Sun,et al.  Single-Trial Analysis of Cortical Oscillatory Activities During Voluntary Movements Using Empirical Mode Decomposition (EMD)-Based Spatiotemporal Approach , 2009, Annals of Biomedical Engineering.

[22]  Wei Wu,et al.  Frequency Recognition Based on Canonical Correlation Analysis for SSVEP-Based BCIs , 2006, IEEE Transactions on Biomedical Engineering.

[23]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[24]  Yu-Te Wu,et al.  Brain computer interface using flash onset and offset visual evoked potentials , 2008, Clinical Neurophysiology.

[25]  Chia-Wei Sun,et al.  An SSVEP-Actuated Brain Computer Interface Using Phase-Tagged Flickering Sequences: A Cursor System , 2010, Annals of Biomedical Engineering.

[26]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis of Complex Valued Signals , 2000, Int. J. Neural Syst..

[27]  John J. Foxe,et al.  Visual spatial attention tracking using high-density SSVEP data for independent brain-computer communication , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  G Pfurtscheller,et al.  Current trends in Graz Brain-Computer Interface (BCI) research. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[29]  Shangkai Gao,et al.  A practical VEP-based brain-computer interface. , 2006, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[30]  Po-Lei Lee,et al.  Frequency recognition in an SSVEP-based brain computer interface using empirical mode decomposition and refined generalized zero-crossing , 2011, Journal of Neuroscience Methods.

[31]  Yonina C. Eldar,et al.  Orthogonal and projected orthogonal matched filter detection , 2004, Signal Process..

[32]  I. Osorio,et al.  Intrinsic time-scale decomposition: time–frequency–energy analysis and real-time filtering of non-stationary signals , 2007, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[33]  Andrzej Cichocki,et al.  Fully Online Multicommand Brain-Computer Interface with Visual Neurofeedback Using SSVEP Paradigm , 2007, Comput. Intell. Neurosci..

[34]  Gernot R. Müller-Putz,et al.  Comparison of DFT and lock-in amplifier features and search for optimal electrode positions in SSVEP-based BCI , 2008, Journal of Neuroscience Methods.

[35]  José del R. Millán,et al.  Noninvasive brain-actuated control of a mobile robot by human EEG , 2004, IEEE Transactions on Biomedical Engineering.

[36]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.