Single trial variability in brain–computer interfaces based on motor imagery: Learning in the presence of labeling noise

This article addresses the issue of learning efficient linear spatial filters and a classification function to match noninvasive electroencephalographic (EEG) signals to motor imagery tasks voluntarily performed by the subjects. The new perspective used in this article consists in releasing the widely accepted hypothesis stating that motor tasks‐related brain activities should have similar time course across trials. This work proposes a learning model that takes into account two previously unconsidered sources of variability. First, the time course of the subject's brain activity, while performing a motor imagery task, will be considered as a trial‐dependent variable. This means that the optimal time, defined as an amount of time after the trial cue, chosen to determine the task performed by the subject might be different between distinct trials. The second released hypothesis deals with the spectral discriminative brain response. Although usual learning methods do not allow any dependency between the optimal discriminative time and frequency bands, our model takes into account this possible source of variability. Therefore, the brain response in distinct frequency bands, e.g., in the mu band or beta band, could be used by the decision function at distinct instants. Based on this underlying enhanced model, we propose a two‐step procedure. In the first step, the algorithm carefully analyzes, using cross‐validation techniques, the training data to identify previously mentioned sources of variability. In the second step, the enhanced frequency‐dependent linear spatial filters and the classification function are determined. As by‐products of this analysis, substantial piece of knowledge about motor imagery is provided. First, the method allows the identification and quantification of labeling noise in brain–computer interfaces (BCIs) based on motor imagery. Second, the algorithm gives a comparative estimation of the spectral time courses during motor imagery. This article makes an extensive use of the dataset I of BCI Competition IV, which took place in 2008. It consists of a training set and a test set of 59 EEG signals recording on four subjects while performing an asynchronous BCI experiment. The two‐step procedure presented in this article is shown to significantly outperform a comparative naive approach. © 2011 Wiley Periodicals, Inc. Int J Imaging Syst Technol, 21, 148–157, 2011

[1]  Klaus-Robert Müller,et al.  Towards Zero Training for Brain-Computer Interfacing , 2008, PloS one.

[2]  J. Fermaglich Electric Fields of the Brain: The Neurophysics of EEG , 1982 .

[3]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[4]  Klaus-Robert Müller,et al.  Spatio-spectral filters for improving the classification of single trial EEG , 2005, IEEE Transactions on Biomedical Engineering.

[5]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[6]  Klaus-Robert Müller,et al.  The non-invasive Berlin Brain–Computer Interface: Fast acquisition of effective performance in untrained subjects , 2007, NeuroImage.

[7]  G. Pfurtscheller,et al.  Could the beta rebound in the EEG be suitable to realize a “brain switch”? , 2009, Clinical Neurophysiology.

[8]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[9]  Klaus-Robert Müller,et al.  A regularized discriminative framework for EEG analysis with application to brain–computer interface , 2010, NeuroImage.

[10]  Miguel A. L. Nicolelis,et al.  Actions from thoughts , 2001, Nature.

[11]  Haixian Wang,et al.  Local Temporal Common Spatial Patterns for Robust Single-Trial EEG Classification , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Ming Li,et al.  Learning in the presence of malicious errors , 1993, STOC '88.

[13]  Gary E. Birch,et al.  A brain-controlled switch for asynchronous control applications , 2000, IEEE Trans. Biomed. Eng..

[14]  L. Cohen,et al.  Brain–computer interfaces: communication and restoration of movement in paralysis , 2007, The Journal of physiology.

[15]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[16]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.

[17]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[18]  Clemens Brunner,et al.  Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks , 2006, NeuroImage.

[19]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[20]  G. Pfurtscheller,et al.  Designing optimal spatial filters for single-trial EEG classification in a movement task , 1999, Clinical Neurophysiology.

[21]  Guillaume Gibert,et al.  xDAWN Algorithm to Enhance Evoked Potentials: Application to Brain–Computer Interface , 2009, IEEE Transactions on Biomedical Engineering.

[22]  Stephen J. Roberts,et al.  Adaptive BCI based on variational Bayesian Kalman filtering: an empirical evaluation , 2004, IEEE Transactions on Biomedical Engineering.

[23]  D. Angluin,et al.  Learning From Noisy Examples , 1988, Machine Learning.

[24]  J. Decety The neurophysiological basis of motor imagery , 1996, Behavioural Brain Research.

[25]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[26]  R. Hari,et al.  Magnetoencephalography in the study of human somatosensory cortical processing. , 1999, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[27]  Christian Jutten,et al.  On the blind source separation of human electroencephalogram by approximate joint diagonalization of second order statistics , 2008, Clinical Neurophysiology.

[28]  Klaus-Robert Müller,et al.  Combined Optimization of Spatial and Temporal Filters for Improving Brain-Computer Interfacing , 2006, IEEE Transactions on Biomedical Engineering.

[29]  Clemens Brunner,et al.  Nonstationary Brain Source Separation for Multiclass Motor Imagery , 2010, IEEE Transactions on Biomedical Engineering.

[30]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[31]  Clemens Brunner,et al.  Nonstationary Brain Source Separation for Multiclass Motor Imagery , 2010, IEEE Transactions on Biomedical Engineering.

[32]  J.J. Vidal,et al.  Real-time detection of brain events in EEG , 1977, Proceedings of the IEEE.

[33]  J. Colebatch,et al.  Movement-related potentials associated with self-paced, cued and imagined arm movements , 2002, Experimental Brain Research.

[34]  J J Vidal,et al.  Toward direct brain-computer communication. , 1973, Annual review of biophysics and bioengineering.

[35]  Desney S. Tan,et al.  Brain-Computer Interfacing for Intelligent Systems , 2008, IEEE Intelligent Systems.

[36]  Rabab K Ward,et al.  A survey of signal processing algorithms in brain–computer interfaces based on electrical brain signals , 2007, Journal of neural engineering.