Robust Common Spatial Filters with a Maxmin Approach

Electroencephalographic signals are known to be nonstationary and easily affected by artifacts; therefore, their analysis requires methods that can deal with noise. In this work, we present a way to robustify the popular common spatial patterns (CSP) algorithm under a maxmin approach. In contrast to standard CSP that maximizes the variance ratio between two conditions based on a single estimate of the class covariance matrices, we propose to robustly compute spatial filters by maximizing the minimum variance ratio within a prefixed set of covariance matrices called the tolerance set. We show that this kind of maxmin optimization makes CSP robust to outliers and reduces its tendency to overfit. We also present a data-driven approach to construct a tolerance set that captures the variability of the covariance matrices over time and shows its ability to reduce the nonstationarity of the extracted features and significantly improve classification accuracy. We test the spatial filters derived with this approach and compare them to standard CSP and a state-of-the-art method on a real-world brain-computer interface (BCI) data set in which we expect substantial fluctuations caused by environmental differences. Finally we investigate the advantages and limitations of the maxmin approach with simulations.

[1]  Motoaki Kawanabe,et al.  Toward Unsupervised Adaptation of LDA for Brain–Computer Interfaces , 2011, IEEE Transactions on Biomedical Engineering.

[2]  Motoaki Kawanabe,et al.  Robust common spatial filters with a maxmin approach , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  Desney S. Tan,et al.  Brain-Computer Interfacing for Intelligent Systems , 2008, IEEE Intelligent Systems.

[4]  Motoaki Kawanabe,et al.  Machine Learning in Non-Stationary Environments - Introduction to Covariate Shift Adaptation , 2012, Adaptive computation and machine learning.

[5]  Haiping Lu,et al.  Regularized Common Spatial Pattern With Aggregation for EEG Classification in Small-Sample Setting , 2010, IEEE Transactions on Biomedical Engineering.

[6]  Matthias Krauledat,et al.  Analysis of nonstationarities in EEG signals for improving brain-computer interface performance , 2008 .

[7]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[8]  M. Kawanabe,et al.  Improving BCI Performance by Modified Common Spatial Patterns with Robustly Averaged Covariance Matrices , 2009 .

[9]  Reinhold Scherer,et al.  A fully on-line adaptive BCI , 2006, IEEE Transactions on Biomedical Engineering.

[10]  Bernhard Schölkopf,et al.  Causal influence of gamma oscillations on the sensorimotor rhythm , 2011, NeuroImage.

[11]  Klaus-Robert Müller,et al.  Improving BCI performance by task-related trial pruning , 2009, Neural Networks.

[12]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[13]  Cuntai Guan,et al.  Unsupervised Brain Computer Interface Based on Intersubject Information and Online Adaptation , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[14]  Klaus-Robert Müller,et al.  Analyzing Local Structure in Kernel-Based Learning: Explanation, Complexity, and Reliability Assessment , 2013, IEEE Signal Processing Magazine.

[15]  Klaus-Robert Muller,et al.  Finding stationary brain sources in EEG data , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[16]  Cuntai Guan,et al.  Optimizing Spatial Filters by Minimizing Within-Class Dissimilarities in Electroencephalogram-Based Brain–Computer Interface , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Z J Koles,et al.  The quantitative extraction and topographic mapping of the abnormal components in the clinical EEG. , 1991, Electroencephalography and clinical neurophysiology.

[18]  Lucas C. Parra,et al.  Recipes for the linear analysis of EEG , 2005, NeuroImage.

[19]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[20]  Cuntai Guan,et al.  Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms , 2011, IEEE Transactions on Biomedical Engineering.

[21]  Klaus-Robert Müller,et al.  The Berlin Brain-Computer Interface: Accurate performance from first-session in BCI-naive subjects , 2008, IEEE Transactions on Biomedical Engineering.

[22]  Pavel Pudil,et al.  Introduction to Statistical Pattern Recognition , 2006 .

[23]  Klaus-Robert Müller,et al.  Feature Discovery in Non-Metric Pairwise Data , 2004, J. Mach. Learn. Res..

[24]  S. Amari,et al.  Dualistic differential geometry of positive definite matrices and its applications to related problems , 1996 .

[25]  Klaus-Robert Müller,et al.  Machine learning for real-time single-trial EEG-analysis: From brain–computer interfacing to mental state monitoring , 2008, Journal of Neuroscience Methods.

[26]  Yuanqing Li,et al.  An Extended EM Algorithm for Joint Feature Extraction and Classification in Brain-Computer Interfaces , 2006, Neural Computation.

[27]  Lucas C. Parra,et al.  Bilinear Discriminant Component Analysis , 2007, J. Mach. Learn. Res..

[28]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[29]  Seungjin Choi,et al.  Composite Common Spatial Pattern for Subject-to-Subject Transfer , 2009, IEEE Signal Processing Letters.

[30]  Klaus-Robert Müller,et al.  The non-invasive Berlin Brain–Computer Interface: Fast acquisition of effective performance in untrained subjects , 2007, NeuroImage.

[31]  Klaus-Robert Müller,et al.  Covariate Shift Adaptation by Importance Weighted Cross Validation , 2007, J. Mach. Learn. Res..

[32]  Klaus-Robert Müller,et al.  Machine-Learning-Based Coadaptive Calibration for Brain-Computer Interfaces , 2011, Neural Computation.

[33]  Terrence J. Sejnowski,et al.  Toward Brain-Computer Interfacing (Neural Information Processing) , 2007 .

[34]  Rajesh P. N. Rao,et al.  Towards adaptive classification for BCI , 2006, Journal of neural engineering.

[35]  Motoaki Kawanabe,et al.  Stationary common spatial patterns for brain–computer interfacing , 2012, Journal of neural engineering.

[36]  Klaus-Robert Müller,et al.  Introduction to machine learning for brain imaging , 2011, NeuroImage.

[37]  Stephen P. Boyd,et al.  Robust Fisher Discriminant Analysis , 2005, NIPS.

[38]  Reinhold Scherer,et al.  Study of On-Line Adaptive Discriminant Analysis for EEG-Based Brain Computer Interfaces , 2007, IEEE Transactions on Biomedical Engineering.

[39]  J. Blumberg,et al.  Adaptive Classification for Brain Computer Interfaces , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[40]  Michael Biehl,et al.  Handbook of Brain Theory and Neural Networks (second editon) , 2002 .

[41]  Klaus-Robert Müller,et al.  A regularized discriminative framework for EEG analysis with application to brain–computer interface , 2010, NeuroImage.

[42]  A. Buttfield,et al.  Towards a robust BCI: error potentials and online learning , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[43]  Motoaki Kawanabe,et al.  Invariant Common Spatial Patterns: Alleviating Nonstationarities in Brain-Computer Interfacing , 2007, NIPS.

[44]  Motoaki Kawanabe,et al.  Brain-computer interfacing in discriminative and stationary subspaces , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[45]  Yijun Wang,et al.  Implementation of a Brain-Computer Interface Based on Three States of Motor Imagery , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[46]  Cuntai Guan,et al.  Learning from other subjects helps reducing Brain-Computer Interface calibration time , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[47]  Olivier Ledoit,et al.  A well-conditioned estimator for large-dimensional covariance matrices , 2004 .

[48]  Wojciech Samek,et al.  Transferring Subspaces Between Subjects in Brain--Computer Interfacing , 2012, IEEE Transactions on Biomedical Engineering.

[49]  Boris Reuderink,et al.  Robust Brain-Computer Interfaces , 2011 .

[50]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[51]  K. Müller,et al.  Finding stationary subspaces in multivariate time series. , 2009, Physical review letters.

[52]  José del R. Millán,et al.  Brain-Computer Interfaces , 2020, Handbook of Clinical Neurology.

[53]  Klaus-Robert Müller,et al.  Neurophysiological predictor of SMR-based BCI performance , 2010, NeuroImage.

[54]  G. Pfurtscheller,et al.  The BCI competition III: validating alternative approaches to actual BCI problems , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.