Complex common spatial patterns on time-frequency decomposed EEG for brain-computer interface

Abstract Motor imagery brain-computer interface (MI-BCI) has many promising applications but there are problems such as poor classification accuracy and robustness which need to be addressed. We propose a novel approach called time-frequency common spatial patterns (TFCSP) to enhance the robustness and accuracy of the electroencephalogram (EEG) signal classification. The proposed approach decomposes the EEG signal into time stages and frequency components to find the most robust and discriminative features. Common spatial patterns (CSP) are extracted from every decomposed time-frequency cell and unreliable features are removed while remaining features are weighted and regularized for the classification. Comparison on three publicly available datasets from BCI competition III and IV shows that the proposed TFCSP outperforms state-of-the-art methods. This demonstrates that adopting subject reaction time paradigm is useful to enhance the classification performance. It also shows that the complex CSP in the frequency domain significantly effective than the commonly used bandpass-filters in time domain. Finally, this work proves that weighting and regularizing CSP features are better techniques than selecting the leading CSP features because the former alleviates information loss.

[1]  Xudong Jiang,et al.  Eigenfeature Regularization and Extraction in Face Recognition , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Sepideh Hajipour Sardouie,et al.  Extended common spatial and temporal pattern (ECSTP): A semi-blind approach to extract features in ERP detection , 2019, Pattern Recognit..

[3]  Xudong Jiang,et al.  Feature Weighting and Regularization of Common Spatial Patterns in EEG-Based Motor Imagery BCI , 2018, IEEE Signal Processing Letters.

[4]  Konstantinos N. Plataniotis,et al.  Separable Common Spatio-Spectral Patterns for Motor Imagery BCI Systems , 2016, IEEE Transactions on Biomedical Engineering.

[5]  Wonzoo Chung,et al.  Frequency-Optimized Local Region Common Spatial Pattern Approach for Motor Imagery Classification , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[7]  Howida A. Shedeed,et al.  A CSP\AM-BA-SVM Approach for Motor Imagery BCI System , 2018, IEEE Access.

[8]  Alok Sharma,et al.  An improved discriminative filter bank selection approach for motor imagery EEG signal classification using mutual information , 2017, BMC Bioinformatics.

[9]  Shang-Lin Wu,et al.  Fuzzy Integral With Particle Swarm Optimization for a Motor-Imagery-Based Brain–Computer Interface , 2017, IEEE Transactions on Fuzzy Systems.

[10]  Jianjun Meng,et al.  Simultaneously Optimizing Spatial Spectral Features Based on Mutual Information for EEG Classification , 2015, IEEE Transactions on Biomedical Engineering.

[11]  Victoria Peterson,et al.  A penalized time-frequency band feature selection and classification procedure for improved motor intention decoding in multichannel EEG , 2019, Journal of neural engineering.

[12]  Ping Xue,et al.  Sub-band Common Spatial Pattern (SBCSP) for Brain-Computer Interface , 2007, 2007 3rd International IEEE/EMBS Conference on Neural Engineering.

[13]  Isabelle Bloch,et al.  Subject-specific time-frequency selection for multi-class motor imagery-based BCIs using few Laplacian EEG channels , 2017, Biomed. Signal Process. Control..

[14]  Xingyu Wang,et al.  Sparse Bayesian Learning for Obtaining Sparsity of EEG Frequency Bands Based Feature Vectors in Motor Imagery Classification , 2017, Int. J. Neural Syst..

[15]  J J Vidal,et al.  Toward direct brain-computer communication. , 1973, Annual review of biophysics and bioengineering.

[16]  H. Jasper,et al.  Electrocorticograms in man: Effect of voluntary movement upon the electrical activity of the precentral gyrus , 1949 .

[17]  Cuntai Guan,et al.  Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms , 2011, IEEE Transactions on Biomedical Engineering.

[18]  Xingyu Wang,et al.  Temporally Constrained Sparse Group Spatial Patterns for Motor Imagery BCI , 2019, IEEE Transactions on Cybernetics.

[19]  Chin-Teng Lin,et al.  Multimodal Fuzzy Fusion for Enhancing the Motor-Imagery-Based Brain Computer Interface , 2019, IEEE Computational Intelligence Magazine.

[20]  Xingyu Wang,et al.  Optimizing spatial patterns with sparse filter bands for motor-imagery based brain–computer interface , 2015, Journal of Neuroscience Methods.

[21]  Wei Wu,et al.  A hierarchical Bayesian approach for learning sparse spatio-temporal decompositions of multichannel EEG , 2011, NeuroImage.

[22]  Xingyu Wang,et al.  Temporal frequency joint sparse optimization and fuzzy fusion for motor imagery-based brain-computer interfaces , 2020, Journal of Neuroscience Methods.

[23]  Cuntai Guan,et al.  Multi-class filter bank common spatial pattern for four-class motor imagery BCI , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[24]  Wei Wu,et al.  Probabilistic Common Spatial Patterns for Multichannel EEG Analysis , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Le Song,et al.  Classifying EEG for Brain-Computer Interface: Learning Optimal Filters for Dynamical System Features , 2006, ICML.

[26]  Yu Zhang,et al.  Sparse Group Representation Model for Motor Imagery EEG Classification , 2019, IEEE Journal of Biomedical and Health Informatics.

[27]  Yuanqing Li,et al.  Classification of symmetric positive definite matrices based on bilinear isometric Riemannian embedding , 2019, Pattern Recognit..

[28]  Cuntai Guan,et al.  Mutual information-based selection of optimal spatial-temporal patterns for single-trial EEG-based BCIs , 2012, Pattern Recognit..

[29]  Jinglu Hu,et al.  A novel frequency band selection method for Common Spatial Pattern in Motor Imagery based Brain Computer Interface , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[30]  Christian Jutten,et al.  Common Spatial Pattern revisited by Riemannian geometry , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.

[31]  Klaus-Robert Müller,et al.  Spatio-spectral filters for improving the classification of single trial EEG , 2005, IEEE Transactions on Biomedical Engineering.

[32]  Cuntai Guan,et al.  Composite Filter Bank Common Spatial Pattern for motor imagery-based Brain-Computer Interface , 2011, 2011 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB).

[33]  Niels Birbaumer,et al.  fMRI Brain-Computer Interface: A Tool for Neuroscientific Research and Treatment , 2007, Comput. Intell. Neurosci..

[34]  Alok Sharma,et al.  CSP-TSM: Optimizing the performance of Riemannian tangent space mapping using common spatial pattern for MI-BCI , 2017, Comput. Biol. Medicine.

[35]  David Lee,et al.  Filter Bank Regularized Common Spatial Pattern Ensemble for Small Sample Motor Imagery Classification , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  Heung-Il Suk,et al.  A Novel Bayesian Framework for Discriminative Feature Extraction in Brain-Computer Interfaces , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[38]  Wei Wu,et al.  Classifying Single-Trial EEG During Motor Imagery by Iterative Spatio-Spectral Patterns Learning (ISSPL) , 2008, IEEE Transactions on Biomedical Engineering.

[39]  F. Yger,et al.  Riemannian Approaches in Brain-Computer Interfaces: A Review , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[40]  Toshihisa Tanaka,et al.  Simultaneous Design of FIR Filter Banks and Spatial Patterns for EEG Signal Classification , 2013, IEEE Transactions on Biomedical Engineering.

[41]  Jianjun Meng,et al.  Optimizing spatial spectral patterns jointly with channel configuration for brain-computer interface , 2013, Neurocomputing.

[42]  Cuntai Guan,et al.  Optimum Spatio-Spectral Filtering Network for Brain–Computer Interface , 2011, IEEE Transactions on Neural Networks.

[43]  Zhongming Liu,et al.  An enhanced time-frequency-spatial approach for motor imagery classification , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[44]  Chiew Tong Lau,et al.  Discriminative FilterBank selection and EEG information fusion for Brain Computer Interface , 2009, 2009 IEEE International Symposium on Circuits and Systems.