A Tutorial on EEG Signal Processing Techniques for Mental State Recognition in Brain-Computer Interfaces

This chapter presents an introductory overview and a tutorial of signal-processing techniques that can be used to recognize mental states from electroencephalographic (EEG) signals in brain–computer interfaces. More particularly, this chapter presents how to extract relevant and robust spectral, spatial, and temporal information from noisy EEG signals (e.g., band-power features, spatial filters such as common spatial patterns or xDAWN, etc.), as well as a few classification algorithms (e.g., linear discriminant analysis) used to classify this information into a class of mental state. It also briefly touches on alternative, but currently less used approaches. The overall objective of this chapter is to provide the reader with practical knowledge about how to analyze EEG signals as well as to stress the key points to understand when performing such an analysis.

[1]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[2]  Alain Rakotomamonjy,et al.  BCI Competition III: Dataset II- Ensemble of SVMs for BCI P300 Speller , 2008, IEEE Transactions on Biomedical Engineering.

[3]  Eduardo Miranda,et al.  Brain-Computer Music Interfacing (BCMI): From Basic Research to the Real World of Special Needs , 2011 .

[4]  Chiew Tong Lau,et al.  A New Discriminative Common Spatial Pattern Method for Motor Imagery Brain–Computer Interfaces , 2009, IEEE Transactions on Biomedical Engineering.

[5]  Klaus-Robert Müller,et al.  On Optimal Channel Configurations for SMR-based Brain–Computer Interfaces , 2010, Brain Topography.

[6]  Mark A. Hall,et al.  Correlation-based Feature Selection for Discrete and Numeric Class Machine Learning , 1999, ICML.

[7]  Browne,et al.  Cross-Validation Methods. , 2000, Journal of mathematical psychology.

[8]  Touradj Ebrahimi,et al.  Spatial filters for the classification of event-related potentials , 2006, ESANN.

[9]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Rabab K Ward,et al.  A survey of signal processing algorithms in brain–computer interfaces based on electrical brain signals , 2007, Journal of neural engineering.

[11]  Richard M. Leahy,et al.  Electromagnetic brain mapping , 2001, IEEE Signal Process. Mag..

[12]  Anatole Lécuyer,et al.  Exploring Large Virtual Environments by Thoughts Using a BrainComputer Interface Based on Motor Imagery and High-Level Commands , 2010, PRESENCE: Teleoperators and Virtual Environments.

[13]  P. Comon,et al.  Ica: a potential tool for bci systems , 2008, IEEE Signal Processing Magazine.

[14]  Stefano Ramat,et al.  Optimizing spatial filter pairs for EEG classification based on phase-synchronization , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  K. Jellinger.  Toward Brain-Computer Interfacing , 2009 .

[16]  C. Jutten,et al.  Topographical Dynamics of Brain Connections for the Design of Asynchronous Brain-Computer Interfaces , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  Josef Kittler,et al.  Floating search methods for feature selection with nonmonotonic criterion functions , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[18]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[19]  M Congedo,et al.  Classification of movement intention by spatially filtered electromagnetic inverse solutions , 2006, Physics in medicine and biology.

[20]  Selina Wriessnegger,et al.  Regularised CSP for Sensor Selection in BCI , 2006 .

[21]  Keinosuke Fukunaga,et al.  Statistical Pattern Recognition , 1993, Handbook of Pattern Recognition and Computer Vision.

[22]  D.J. McFarland,et al.  Sensorimotor rhythm-based brain-computer interface (BCI): feature selection by regression improves performance , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  Brendan Z. Allison,et al.  P300 brain computer interface: current challenges and emerging trends , 2012, Front. Neuroeng..

[24]  B. Kamousi,et al.  Classification of motor imagery tasks for brain-computer interface applications by means of two equivalent dipoles analysis , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  Fusheng Yang,et al.  BCI competition 2003-data set IIb: enhancing P300 wave detection using ICA-based subspace projections for BCI applications , 2004, IEEE Transactions on Biomedical Engineering.

[26]  Christa Neuper,et al.  Hidden Markov models for online classification of single trial EEG data , 2001, Pattern Recognit. Lett..

[27]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  R. Palaniappan,et al.  Classification of biological signals using linear and nonlinear features , 2010, Physiological measurement.

[29]  Guillaume Gibert,et al.  OpenViBE: An Open-Source Software Platform to Design, Test, and Use BrainComputer Interfaces in Real and Virtual Environments , 2010, PRESENCE: Teleoperators and Virtual Environments.

[30]  K. Aihara,et al.  An Iterative Algorithm for Spatio-Temporal Filter Optimization , 2006 .

[31]  J. Wade Davis,et al.  Statistical Pattern Recognition , 2003, Technometrics.

[32]  Misha Pavel,et al.  Channel Selection and Feature Projection for Cognitive Load Estimation Using Ambulatory EEG , 2007, Comput. Intell. Neurosci..

[33]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[34]  Jerome H. Friedman,et al.  On Bias, Variance, 0/1—Loss, and the Curse-of-Dimensionality , 2004, Data Mining and Knowledge Discovery.

[35]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[36]  Cuntai Guan,et al.  Spatially Regularized Common Spatial Patterns for EEG Classification , 2010, 2010 20th International Conference on Pattern Recognition.

[37]  Anil K. Jain,et al.  Feature Selection: Evaluation, Application, and Small Sample Performance , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Benoit M. Macq,et al.  Single-Trial EEG Source Reconstruction for Brain–Computer Interface , 2008, IEEE Transactions on Biomedical Engineering.

[39]  Klaus-Robert Müller,et al.  Spatio-spectral filters for improving the classification of single trial EEG , 2005, IEEE Transactions on Biomedical Engineering.

[40]  Kristin P. Bennett,et al.  Support vector machines: hype or hallelujah? , 2000, SKDD.

[41]  Anatole Lécuyer,et al.  Comparative study of band-power extraction techniques for Motor Imagery classification , 2011, 2011 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB).

[42]  Anil K. Jain,et al.  Small Sample Size Effects in Statistical Pattern Recognition: Recommendations for Practitioners , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  Guillaume Gibert,et al.  xDAWN Algorithm to Enhance Evoked Potentials: Application to Brain–Computer Interface , 2009, IEEE Transactions on Biomedical Engineering.

[44]  R. Ward,et al.  EMG and EOG artifacts in brain computer interface systems: A survey , 2007, Clinical Neurophysiology.

[45]  C.W. Anderson,et al.  Comparison of linear, nonlinear, and feature selection methods for EEG signal classification , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[46]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[47]  Bernhard Schölkopf,et al.  Robust EEG Channel Selection across Subjects for Brain-Computer Interfaces , 2005, EURASIP J. Adv. Signal Process..

[48]  Klaus-Robert Müller,et al.  Combined Optimization of Spatial and Temporal Filters for Improving Brain-Computer Interfacing , 2006, IEEE Transactions on Biomedical Engineering.

[49]  Michael Tangermann,et al.  Classification of Artifactual ICA Components , 2009 .

[50]  M J Stokes,et al.  EEG-based communication: a pattern recognition approach. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[51]  Cuntai Guan,et al.  Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms , 2011, IEEE Transactions on Biomedical Engineering.

[52]  Clemens Brunner,et al.  Comparison of Feature Extraction Methods for Brain-Computer Interfaces , 2011 .

[53]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[54]  Clemens Brunner,et al.  Spatial filtering and selection of optimized components in four class motor imagery EEG data using independent components analysis , 2007, Pattern Recognit. Lett..

[55]  Fabien Lotte,et al.  A new feature and associated optimal spatial filter for EEG signal classification: Waveform Length , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[56]  Klaus-Robert Müller,et al.  Boosting bit rates in noninvasive EEG single-trial classifications by feature combination and multiclass paradigms , 2004, IEEE Transactions on Biomedical Engineering.

[57]  Cuntai Guan,et al.  Optimizing the Channel Selection and Classification Accuracy in EEG-Based BCI , 2011, IEEE Transactions on Biomedical Engineering.

[58]  Bernhard Schölkopf,et al.  Support vector channel selection in BCI , 2004, IEEE Transactions on Biomedical Engineering.

[59]  J. Martinerie,et al.  The brainweb: Phase synchronization and large-scale integration , 2001, Nature Reviews Neuroscience.

[60]  Moritz Grosse-Wentrup,et al.  Beamforming in Noninvasive Brain–Computer Interfaces , 2009, IEEE Transactions on Biomedical Engineering.

[61]  Cuntai Guan,et al.  Learning from other subjects helps reducing Brain-Computer Interface calibration time , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[62]  A. Cichocki,et al.  Steady-state visually evoked potentials: Focus on essential paradigms and future perspectives , 2010, Progress in Neurobiology.

[63]  José del R. Millán,et al.  Towards Brain-Computer Interfacing , 2007 .

[64]  J R Wolpaw,et al.  Spatial filter selection for EEG-based communication. , 1997, Electroencephalography and clinical neurophysiology.

[65]  G.E. Birch,et al.  A general framework for brain-computer interface design , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[66]  Moritz Grosse-Wentrup,et al.  Preprint Accepted for Publication in the Ieee Transactions on Biomedical Engineering Beamforming in Non-invasive Brain-computer Interfaces Abstract—spatial Filtering Constitutes an Integral Part of Build- Ing Eeg-based Brain-computer Interfaces (bcis). Algorithms Frequently Used for Spatial Filterin , 2008 .

[67]  Anatole Lécuyer,et al.  Exploring two novel features for EEG-based brain-computer interfaces: Multifractal cumulants and predictive complexity , 2010, Neurocomputing.

[68]  Moritz Grosse-Wentrup,et al.  Understanding Brain Connectivity Patterns during Motor Imagery for Brain-Computer Interfacing , 2008, NIPS.

[69]  Line Garnero,et al.  Improving quantification of functional networks with EEG inverse problem: Evidence from a decoding point of view , 2011, NeuroImage.

[70]  Moritz Grosse-Wentrup,et al.  Multiclass Common Spatial Patterns and Information Theoretic Feature Extraction , 2008, IEEE Transactions on Biomedical Engineering.

[71]  Dean J Krusienski,et al.  A comparison of classification techniques for the P300 Speller , 2006, Journal of neural engineering.

[72]  Nicole Krämer,et al.  Time Domain Parameters as a feature for EEG-based Brain-Computer Interfaces , 2009, Neural Networks.

[73]  M. Buss,et al.  EEG Source Localization for Brain-Computer-Interfaces , 2005, Conference Proceedings. 2nd International IEEE EMBS Conference on Neural Engineering, 2005..

[74]  Anatole Lécuyer,et al.  Classifying EEG for brain computer interfaces using Gaussian processes , 2008, Pattern Recognit. Lett..

[75]  Jukka Heikkonen,et al.  A local neural classifier for the recognition of EEG patterns associated to mental tasks , 2002, IEEE Trans. Neural Networks.

[76]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[77]  Anatole Lécuyer,et al.  FuRIA: An Inverse Solution Based Feature Extraction Algorithm Using Fuzzy Set Theory for Brain–Computer Interfaces , 2009, IEEE Transactions on Signal Processing.

[78]  C. Neuper,et al.  The effect of distinct mental strategies on classification performance for brain-computer interfaces. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[79]  Boris Reuderink,et al.  Robustness of the Common Spatial Patterns algorithm in the BCI-pipeline , 2008 .

[80]  M. Murray,et al.  EEG source imaging , 2004, Clinical Neurophysiology.

[81]  Motoaki Kawanabe,et al.  Invariant Common Spatial Patterns: Alleviating Nonstationarities in Brain-Computer Interfacing , 2007, NIPS.

[82]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern Algorithm on BCI Competition IV Datasets 2a and 2b , 2012, Front. Neurosci..

[83]  Clemens Brunner,et al.  BioSig - an open source software library for BCI research , 2007 .

[84]  Lei Ding,et al.  Motor imagery classification by means of source analysis for brain–computer interface applications , 2004, Journal of neural engineering.

[85]  Klaus-Robert Müller,et al.  Neurophysiological predictor of SMR-based BCI performance , 2010, NeuroImage.

[86]  T.M. McGinnity,et al.  Comparative Analysis of Spectral Approaches to Feature Extraction for EEG-Based Motor Imagery Classification , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[87]  K.-R. Muller,et al.  BCI meeting 2005-workshop on BCI signal processing: feature extraction and translation , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[88]  Olivier Ledoit,et al.  A well-conditioned estimator for large-dimensional covariance matrices , 2004 .

[89]  Stefan Haufe,et al.  On the interpretation of weight vectors of linear models in multivariate neuroimaging , 2014, NeuroImage.

[90]  Dean J. Krusienski,et al.  Value of amplitude, phase, and coherence features for a sensorimotor rhythm-based brain–computer interface , 2012, Brain Research Bulletin.

[91]  Mohammad Hassan Moradi,et al.  A new approach in the BCI research based on fractal dimension as feature and Adaboost as classifier , 2004, Journal of neural engineering.

[92]  Cuntai Guan,et al.  An Efficient P300-based Brain-Computer Interface with Minimal Calibration Time , 2009, NIPS 2009.

[93]  Michitaka Hirose,et al.  Towards ambulatory brain-computer interfaces: a pilot study with P300 signals , 2009, Advances in Computer Entertainment Technology.

[94]  John A. Leese,et al.  The determination of cloud pattern motions from geosynchronous satellite image data , 1970, Pattern Recognit..

[95]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[96]  Motoaki Kawanabe,et al.  Stationary common spatial patterns for brain–computer interfacing , 2012, Journal of neural engineering.