Decoding Three-Dimensional Trajectory of Executed and Imagined Arm Movements From Electroencephalogram Signals

Decoding motor commands from noninvasively measured neural signals has become important in brain-computer interface (BCI) research. Applications of BCI include neurorehabilitation after stroke and control of limb prostheses. Until now, most studies have tested simple movement trajectories in two dimensions by using constant velocity profiles. However, most real-world scenarios require much more complex movement trajectories and velocity profiles. In this study, we decoded motor commands in three dimensions from electroencephalography (EEG) recordings while the subjects either executed or observed/imagined complex upper limb movement trajectories. We compared the accuracy of simple linear methods and nonlinear methods. In line with previous studies our results showed that linear decoders are an efficient and robust method for decoding motor commands. However, while we took the same precautions as previous studies to suppress eye-movement related EEG contamination, we found that subtracting residual electro-oculogram activity from the EEG data resulted in substantially lower motor decoding accuracy for linear decoders. This effect severely limits the transfer of previous results to practical applications in which neural activation is targeted. We observed that nonlinear methods showed no such drop in decoding performance. Our results demonstrate that eye-movement related contamination of brain signals constitutes a severe problem for decoding motor signals from EEG data. These results are important for developing accurate decoders of motor signal from neural signals for use with BCI-based neural prostheses and neurorehabilitation in real-world scenarios.

[1]  M. Aizerman,et al.  Theoretical Foundations of the Potential Function Method in Pattern Recognition Learning , 1964 .

[2]  Andreas Ziehe,et al.  TDSEP { an e(cid:14)cient algorithm for blind separation using time structure , 1998 .

[3]  K.-R. Muller,et al.  Linear and nonlinear methods for brain-computer interfaces , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  M. Nuttin,et al.  A brain-actuated wheelchair: Asynchronous and non-invasive Brain–computer interfaces for continuous control of robots , 2008, Clinical Neurophysiology.

[5]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[6]  Jan Peters,et al.  Model Learning with Local Gaussian Process Regression , 2009, Adv. Robotics.

[7]  G. Berns,et al.  BAD TO WORSE , 1975, The Lancet.

[8]  Dean J. Krusienski,et al.  Extending the discrete selection capabilities of the P300 speller to goal-oriented robotic arm control , 2010, 2010 3rd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[9]  Christa Neuper,et al.  Temporal Coding of Brain Patterns for Direct Limb Control in Humans , 2010, Front. Neurosci..

[10]  Z. Gu,et al.  Decoding hand movement velocity from electroencephalogram signals during a drawing task , 2010, Biomedical engineering online.

[11]  Trent J. Bradberry,et al.  Reconstructing Three-Dimensional Hand Movements from Noninvasive Electroencephalographic Signals , 2010, The Journal of Neuroscience.

[12]  M. Tangermann,et al.  Automatic Classification of Artifactual ICA-Components for Artifact Removal in EEG Signals , 2011, Behavioral and Brain Functions.

[13]  Trent J. Bradberry,et al.  Fast attainment of computer cursor control with noninvasively acquired brain signals , 2011, Journal of neural engineering.

[14]  A. Doud,et al.  Continuous Three-Dimensional Control of a Virtual Helicopter Using a Motor Imagery Based Brain-Computer Interface , 2011, PloS one.

[15]  Bin He,et al.  Hand movement decoding by phase-locking low frequency EEG signals , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[16]  Ronald N. Goodman,et al.  Neural decoding of treadmill walking from noninvasive electroencephalographic signals. , 2011, Journal of neurophysiology.

[17]  Klaus-Robert Müller,et al.  Introduction to machine learning for brain imaging , 2011, NeuroImage.

[18]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[19]  C Grozea,et al.  On the feasibility of using motor imagery EEG-based brain–computer interface in chronic tetraplegics for assistive robotic arm control: a clinical test and long-term post-trial follow-up , 2012, Spinal Cord.

[20]  Gernot R. Müller-Putz,et al.  Decoding of velocities and positions of 3D arm movement from EEG , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[21]  J. Millán,et al.  Detection of self-paced reaching movement intention from EEG signals , 2012, Front. Neuroeng..

[22]  José del R. Millán,et al.  3D Trajectory Reconstruction of Upper Limb Based on EEG , 2013 .

[23]  Yasuharu Koike,et al.  Prediction of Three-Dimensional Arm Trajectories Based on ECoG Signals Recorded from Human Sensorimotor Cortex , 2013, PloS one.

[24]  A. Schwartz,et al.  High-performance neuroprosthetic control by an individual with tetraplegia , 2013, The Lancet.

[25]  Heung-Il Suk,et al.  Non-homogeneous spatial filter optimization for ElectroEncephaloGram (EEG)-based motor imagery classification , 2013, Neurocomputing.

[26]  N. Birbaumer,et al.  On the Usage of Linear Regression Models to Reconstruct Limb Kinematics from Low Frequency EEG Signals , 2013, PloS one.

[27]  Stefan Haufe,et al.  On the interpretation of weight vectors of linear models in multivariate neuroimaging , 2014, NeuroImage.