On robust parameter estimation in brain–computer interfacing

OBJECTIVE The reliable estimation of parameters such as mean or covariance matrix from noisy and high-dimensional observations is a prerequisite for successful application of signal processing and machine learning algorithms in brain-computer interfacing (BCI). This challenging task becomes significantly more difficult if the data set contains outliers, e.g. due to subject movements, eye blinks or loose electrodes, as they may heavily bias the estimation and the subsequent statistical analysis. Although various robust estimators have been developed to tackle the outlier problem, they ignore important structural information in the data and thus may not be optimal. Typical structural elements in BCI data are the trials consisting of a few hundred EEG samples and indicating the start and end of a task. APPROACH This work discusses the parameter estimation problem in BCI and introduces a novel hierarchical view on robustness which naturally comprises different types of outlierness occurring in structured data. Furthermore, the class of minimum divergence estimators is reviewed and a robust mean and covariance estimator for structured data is derived and evaluated with simulations and on a benchmark data set. MAIN RESULTS The results show that state-of-the-art BCI algorithms benefit from robustly estimated parameters. SIGNIFICANCE Since parameter estimation is an integral part of various machine learning algorithms, the presented techniques are applicable to many problems beyond BCI.

[1]  Toshihisa Tanaka,et al.  Active Data Selection for Motor Imagery EEG Classification , 2015, IEEE Transactions on Biomedical Engineering.

[2]  Yijun Wang,et al.  Common Spatial Pattern Method for Channel Selelction in Motor Imagery Based Brain-computer Interface , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[3]  Dorothy V. M. Bishop,et al.  Journal of Neuroscience Methods , 2015 .

[4]  Stefan Haufe,et al.  EEG potentials predict upcoming emergency brakings during simulated driving , 2011, Journal of neural engineering.

[5]  Peter J. Huber,et al.  Robust Statistics , 2005, Wiley Series in Probability and Statistics.

[6]  Motoaki Kawanabe,et al.  Robust common spatial patterns by minimum divergence covariance estimator , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[7]  Klaus-Robert Müller,et al.  Predicting BCI Subject Performance Using Probabilistic Spatio-Temporal Filters , 2014, PloS one.

[8]  David J. Olive Why the Rousseeuw Yohai Paradigm is One of the Largest and Longest Running Scientific Hoaxes in History , 2012 .

[9]  R. Ward,et al.  EMG and EOG artifacts in brain computer interface systems: A survey , 2007, Clinical Neurophysiology.

[10]  Masashi Sugiyama,et al.  Averaging covariance matrices for EEG signal classification based on the CSP: An empirical study , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[11]  Jonathan R. Wolpaw,et al.  Brain–Computer InterfacesPrinciples and Practice , 2012 .

[12]  Motoaki Kawanabe,et al.  Invariant Common Spatial Patterns: Alleviating Nonstationarities in Brain-Computer Interfacing , 2007, NIPS.

[13]  S. Amari Information geometry in optimization, machine learning and statistical inference , 2010 .

[14]  Cuntai Guan,et al.  Optimizing the Channel Selection and Classification Accuracy in EEG-Based BCI , 2011, IEEE Transactions on Biomedical Engineering.

[15]  Motoaki Kawanabe,et al.  Robust Spatial Filtering with Beta Divergence , 2013, NIPS.

[16]  R. Ward,et al.  Robust Common Spatial Patterns for EEG signal preprocessing , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  T. Sejnowski,et al.  Removing electroencephalographic artifacts by blind source separation. , 2000, Psychophysiology.

[18]  J RousseeuwPeter,et al.  A fast algorithm for the minimum covariance determinant estimator , 1999 .

[19]  Sebastian Bosse,et al.  Toward a Direct Measure of Video Quality Perception Using EEG , 2012, IEEE Transactions on Image Processing.

[20]  Klaus-Robert Müller,et al.  A regularized discriminative framework for EEG analysis with application to brain–computer interface , 2010, NeuroImage.

[21]  Haiping Lu,et al.  Regularized Common Spatial Pattern With Aggregation for EEG Classification in Small-Sample Setting , 2010, IEEE Transactions on Biomedical Engineering.

[22]  Wojciech Samek,et al.  Transferring Subspaces Between Subjects in Brain--Computer Interfacing , 2012, IEEE Transactions on Biomedical Engineering.

[23]  Christian Jutten,et al.  Multiclass Brain–Computer Interface Classification by Riemannian Geometry , 2012, IEEE Transactions on Biomedical Engineering.

[24]  Rajesh P. N. Rao,et al.  Towards adaptive classification for BCI , 2006, Journal of neural engineering.

[25]  M. Kawanabe,et al.  Improving BCI Performance by Modified Common Spatial Patterns with Robustly Averaged Covariance Matrices , 2009 .

[26]  Wojciech Samek,et al.  Multiscale temporal neural dynamics predict performance in a complex sensorimotor task , 2016, NeuroImage.

[27]  Takafumi Kanamori,et al.  Information Geometry of U-Boost and Bregman Divergence , 2004, Neural Computation.

[28]  M. C. Jones,et al.  Robust and efficient estimation by minimising a density power divergence , 1998 .

[29]  Shun-ichi Amari,et al.  Methods of information geometry , 2000 .

[30]  Cuntai Guan,et al.  Optimizing Spatial Filters by Minimizing Within-Class Dissimilarities in Electroencephalogram-Based Brain–Computer Interface , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[31]  Toshihisa Tanaka,et al.  Robust Averaging of Covariance Matrices by Riemannian Geometry for Motor-Imagery Brain–Computer Interfacing , 2016 .

[32]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[33]  Andrzej Cichocki,et al.  Families of Alpha- Beta- and Gamma- Divergences: Flexible and Robust Measures of Similarities , 2010, Entropy.

[34]  R. Beran Minimum Hellinger distance estimates for parametric models , 1977 .

[35]  Wojciech Samek,et al.  Investigating effects of different artefact types on motor imagery BCI , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[36]  Wojciech Samek,et al.  Methods for interpreting and understanding deep neural networks , 2017, Digit. Signal Process..

[37]  Russell V. Lenth,et al.  Some Practical Guidelines for Effective Sample Size Determination , 2001 .

[38]  M. Congedo,et al.  The Riemannian Potato: an automatic and adaptive artifact detection method for online experiments using Riemannian geometry , 2013 .

[39]  Klaus-Robert Müller,et al.  Introduction to machine learning for brain imaging , 2011, NeuroImage.

[40]  Christian Jutten,et al.  Common Spatial Pattern revisited by Riemannian geometry , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.

[41]  Stefan Haufe,et al.  The Berlin Brain-Computer Interface: Progress Beyond Communication and Control , 2016, Front. Neurosci..

[42]  Klaus-Robert Müller,et al.  Learning From More Than One Data Source: Data Fusion Techniques for Sensorimotor Rhythm-Based Brain–Computer Interfaces , 2015, Proceedings of the IEEE.

[43]  Scott Makeig,et al.  MoBILAB: an open source toolbox for analysis and visualization of mobile brain/body imaging data , 2014, Front. Hum. Neurosci..

[44]  José del R. Millán,et al.  An Introduction to Brain-Computer Interfacing , 2007 .

[45]  Klaus-Robert Müller,et al.  Interpretable deep neural networks for single-trial EEG classification , 2016, Journal of Neuroscience Methods.

[46]  Motoaki Kawanabe,et al.  Divergence-Based Framework for Common Spatial Patterns Algorithms , 2014, IEEE Reviews in Biomedical Engineering.

[47]  Stefan Haufe,et al.  Multivariate Machine Learning Methods for Fusing Multimodal Functional Neuroimaging Data , 2015, Proceedings of the IEEE.

[48]  R Colombo,et al.  Delayed verbal reactions are specifically impaired in patients with schizophrenia. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[49]  Yuanqing Li,et al.  A Semi-supervised SVM Learning Algorithm for Joint Feature Extraction and Classification in Brain Computer Interfaces , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[50]  Stephanie Brandl,et al.  Brain–computer interfacing under distraction: an evaluation study , 2016, Journal of neural engineering.

[51]  Shinto Eguchi,et al.  Spontaneous Clustering via Minimum Gamma-Divergence , 2014, Neural Computation.

[52]  Na Lu,et al.  A Deep Learning Scheme for Motor Imagery Classification based on Restricted Boltzmann Machines , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[53]  Cuntai Guan,et al.  Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms , 2011, IEEE Transactions on Biomedical Engineering.

[54]  Wonzoo Chung,et al.  Common spatial patterns based on generalized norms , 2013, 2013 International Winter Workshop on Brain-Computer Interface (BCI).

[55]  F. Yger,et al.  Riemannian Approaches in Brain-Computer Interfaces: A Review , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[56]  Bruce G. Lindsay,et al.  The iteratively reweighted estimating equation in minimum distance problems , 2004, Comput. Stat. Data Anal..

[57]  K. Müller,et al.  Finding stationary subspaces in multivariate time series. , 2009, Physical review letters.

[58]  P. Rousseeuw,et al.  Minimum volume ellipsoid , 2009 .

[59]  Ugur Halici,et al.  A novel deep learning approach for classification of EEG motor imagery signals , 2017, Journal of neural engineering.

[60]  Begoña Garcia-Zapirain,et al.  EEG artifact removal—state-of-the-art and guidelines , 2015, Journal of neural engineering.

[61]  Ahmed H. Tewfik,et al.  Sparse common spatial patterns in brain computer interface applications , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[62]  C. Villani Optimal Transport: Old and New , 2008 .

[63]  Motoaki Kawanabe,et al.  Stationary common spatial patterns for brain–computer interfacing , 2012, Journal of neural engineering.

[64]  S. Debener,et al.  Towards a truly mobile auditory brain-computer interface: exploring the P300 to take away. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[65]  K. Müller,et al.  Psychological predictors of SMR-BCI performance , 2012, Biological Psychology.

[66]  Alexander Binder,et al.  On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation , 2015, PloS one.

[67]  M.M. Moore,et al.  Real-world applications for brain-computer interface technology , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[68]  Klaus-Robert Müller,et al.  Explorative data analysis for changes in neural activity , 2013, Journal of neural engineering.

[69]  Masashi Sugiyama,et al.  Importance-weighted covariance estimation for robust common spatial pattern , 2014, Pattern Recognit. Lett..

[70]  Klaus-Robert Müller,et al.  Machine-Learning-Based Coadaptive Calibration for Brain-Computer Interfaces , 2011, Neural Computation.

[71]  Heidrun Wabnitz,et al.  M3BA: A Mobile, Modular, Multimodal Biosignal Acquisition Architecture for Miniaturized EEG-NIRS-Based Hybrid BCI and Monitoring , 2017, IEEE Transactions on Biomedical Engineering.

[72]  P. Rousseeuw,et al.  A fast algorithm for the minimum covariance determinant estimator , 1999 .

[73]  Bernhard Schölkopf,et al.  Support vector channel selection in BCI , 2004, IEEE Transactions on Biomedical Engineering.

[74]  J. Wishart THE GENERALISED PRODUCT MOMENT DISTRIBUTION IN SAMPLES FROM A NORMAL MULTIVARIATE POPULATION , 1928 .

[75]  M. Tangermann,et al.  Automatic Classification of Artifactual ICA-Components for Artifact Removal in EEG Signals , 2011, Behavioral and Brain Functions.

[76]  A. Basu,et al.  Statistical Inference: The Minimum Distance Approach , 2011 .

[77]  Matthew A. Wilson,et al.  Neural Representation of Spatial Topology in the Rodent Hippocampus , 2013, Neural Computation.

[78]  F. La Foresta,et al.  Automatic Artifact Rejection From Multichannel Scalp EEG by Wavelet ICA , 2012, IEEE Sensors Journal.

[79]  J. Wolpaw,et al.  Brain-Computer Interfaces: Principles and Practice , 2012 .

[80]  Klaus-Robert Muller,et al.  Finding stationary brain sources in EEG data , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[81]  Richard J. Davidson,et al.  Validation of ICA-based myogenic artifact correction for scalp and source-localized EEG , 2010, NeuroImage.

[82]  Klaus-Robert Müller,et al.  Generalizing Analytic Shrinkage for Arbitrary Covariance Structures , 2013, NIPS.

[83]  Alexander A. Fingelkurts,et al.  Nonstationary nature of the brain activity as revealed by EEG/MEG: Methodological, practical and conceptual challenges , 2005, Signal Process..

[84]  Stephanie Brandl,et al.  Bringing BCI into everyday life: Motor imagery in a pseudo realistic environment , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[85]  Klaus-Robert Müller,et al.  Analyzing neuroimaging data with subclasses: A shrinkage approach , 2016, NeuroImage.

[86]  Klaus-Robert Müller,et al.  Neurophysiological predictor of SMR-based BCI performance , 2010, NeuroImage.

[87]  G. Pfurtscheller,et al.  The BCI competition III: validating alternative approaches to actual BCI problems , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[88]  A. Mognon,et al.  ADJUST: An automatic EEG artifact detector based on the joint use of spatial and temporal features. , 2011, Psychophysiology.

[89]  F. Zwiers,et al.  The interpretation and estimation of effective sample size , 1984 .

[90]  Haiping Lu,et al.  Regularized common spatial patterns with generic learning for EEG signal classification , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[91]  Tamer Ölmez,et al.  A Neural Network-Based Optimal Spatial Filter Design Method for Motor Imagery Classification , 2015 .

[92]  Qin Tang,et al.  L1-Norm-Based Common Spatial Patterns , 2012, IEEE Transactions on Biomedical Engineering.

[93]  Emery N. Brown,et al.  A probabilistic framework for learning robust common spatial patterns , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[94]  S. Eguchi,et al.  Robust parameter estimation with a small bias against heavy contamination , 2008 .

[95]  Klaus-Robert Müller,et al.  Improving BCI performance by task-related trial pruning , 2009, Neural Networks.

[96]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[97]  Masashi Sugiyama,et al.  Geometry-aware stationary subspace analysis , 2016, ACML.

[98]  Klaus-Robert Müller,et al.  On Optimal Channel Configurations for SMR-based Brain–Computer Interfaces , 2010, Brain Topography.

[99]  Tom Eichele,et al.  Semi-automatic identification of independent components representing EEG artifact , 2009, Clinical Neurophysiology.

[100]  D. Donoho,et al.  The "Automatic" Robustness of Minimum Distance Functionals , 1988 .

[101]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[102]  Seungjin Choi,et al.  Composite Common Spatial Pattern for Subject-to-Subject Transfer , 2009, IEEE Signal Processing Letters.

[103]  W. Samek,et al.  Group-wise Stationary Subspace Analysis-A novel method for studying non-stationarities , 2011 .

[104]  Motoaki Kawanabe,et al.  Robust common spatial filters with a maxmin approach , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[105]  Michitaka Hirose,et al.  Towards ambulatory brain-computer interfaces: a pilot study with P300 signals , 2009, Advances in Computer Entertainment Technology.