Small Sample Motor Imagery Classification Using Regularized Riemannian Features

Motor imagery-based electroencephalogram brain–computer interface (BCI) performance suffers from huge variations within and across subjects. This is due to different spatial and temporal characteristics among the subjects. To address these variabilities, a large number of labeled subject specific training trials are collected to calibrate systems for new subjects. This results in long calibration time that limits the BCI usage in practice. One major challenge in the development of brain computer interface is to reduce calibration time or completely eliminate it. The existing approaches rise up to this challenge by incorporating inter-subject and intra-subject variations through covariance matrices from other subject’s training trials. Current approaches use covariance matrices but do not consider the geometry of the covariance matrices, which lies in the space of symmetric positive definite matrices. This inevitably limits their performance. We focus on reducing calibration time by introducing a Riemannian approach. However, in Riemannian approach the performance degrades in small sample scenario as the dimensionality of covariance matrices is large in comparison to the number of trials. To overcome this limitation, we proposed a new framework that transforms covariance matrices into a lower dimension through spatial filter regularized by data from other subjects. The efficacy of the proposed approach was validated on the small sample scenario dataset IVa from BCI competition III. The proposed approach has achieved 87.21% mean accuracy and 0.74 mean kappa on dataset IVa. The proposed method outperforms the conventional method and other existing studies on dataset IVa. To ensure the robustness of the proposed method we evaluated on dataset IIIa from BCI competition III and dataset IIa from BCI competition IV. The proposed method has achieved mean accuracy 90.93% and 80.98% on dataset IIIa and dataset IIa, respectively.

[1]  Tatsuhiko Tsunoda,et al.  A Deep Learning Approach for Motor Imagery EEG Signal Classification , 2016, 2016 3rd Asia-Pacific World Congress on Computer Science and Engineering (APWC on CSE).

[2]  Haiping Lu,et al.  Regularized Common Spatial Pattern With Aggregation for EEG Classification in Small-Sample Setting , 2010, IEEE Transactions on Biomedical Engineering.

[3]  Hans W. Guesgen,et al.  Reduce Calibration Time in Motor Imagery Using Spatially Regularized Symmetric Positives-Definite Matrices Based Classification , 2019, Sensors.

[4]  Christian Jutten,et al.  Multiclass Brain–Computer Interface Classification by Riemannian Geometry , 2012, IEEE Transactions on Biomedical Engineering.

[5]  Dongrui Wu,et al.  Transfer Learning for Brain–Computer Interfaces: A Euclidean Space Data Alignment Approach , 2018, IEEE Transactions on Biomedical Engineering.

[6]  Saeed Shiry Ghidary,et al.  Dimensionality reduction based on distance preservation to local mean for symmetric positive definite matrices and its application in brain–computer interfaces , 2016, Journal of neural engineering.

[7]  Cuntai Guan,et al.  Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms , 2011, IEEE Transactions on Biomedical Engineering.

[8]  G. Pfurtscheller,et al.  EEG-based discrimination between imagination of right and left hand movement. , 1997, Electroencephalography and clinical neurophysiology.

[9]  Girijesh Prasad,et al.  Adaptive learning with covariate shift-detection for motor imagery-based brain–computer interface , 2015, Soft Computing.

[10]  Bernhard Schölkopf,et al.  Transfer Learning in Brain-Computer Interfaces , 2015, IEEE Computational Intelligence Magazine.

[11]  Fakhreddine Ghaffari,et al.  An embedded implementation based on adaptive filter bank for brain–computer interface systems , 2018, Journal of Neuroscience Methods.

[12]  Christian Jutten,et al.  Classification of covariance matrices using a Riemannian-based kernel for BCI applications , 2013, Neurocomputing.

[13]  Laurens van der Maaten,et al.  Accelerating t-SNE using tree-based algorithms , 2014, J. Mach. Learn. Res..

[14]  Hui Wang,et al.  A multi-class EEG-based BCI classification using multivariate empirical mode decomposition based filtering and Riemannian geometry , 2018, Expert Syst. Appl..

[15]  Dongrui Wu,et al.  Transfer Learning Enhanced Common Spatial Pattern Filtering for Brain Computer Interfaces (BCIs): Overview and a New Approach , 2017, ICONIP.

[16]  Howida A. Shedeed,et al.  A CSP\AM-BA-SVM Approach for Motor Imagery BCI System , 2018, IEEE Access.

[17]  Manal M. Tantawi,et al.  Reducing Execution Time for Real-Time Motor Imagery Based BCI Systems , 2016, AISI.

[18]  Mehrtash Tafazzoli Harandi,et al.  From Manifold to Manifold: Geometry-Aware Dimensionality Reduction for SPD Matrices , 2014, ECCV.

[19]  Yan Wu,et al.  Convolutional deep belief networks for feature extraction of EEG signal , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[20]  Cuntai Guan,et al.  Spatially Regularized Common Spatial Patterns for EEG Classification , 2010, 2010 20th International Conference on Pattern Recognition.

[21]  Seungjin Choi,et al.  Composite Common Spatial Pattern for Subject-to-Subject Transfer , 2009, IEEE Signal Processing Letters.

[22]  Jing Luo,et al.  Spatio-temporal discrepancy feature for classification of motor imageries , 2019, Biomed. Signal Process. Control..

[23]  Aimin Jiang,et al.  LSTM-Based EEG Classification in Motor Imagery Tasks , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Fabien Lotte,et al.  Signal Processing Approaches to Minimize or Suppress Calibration Time in Oscillatory Activity-Based Brain–Computer Interfaces , 2015, Proceedings of the IEEE.

[25]  Thinh Nguyen,et al.  Sparse Representation-Based Extreme Learning Machine for Motor Imagery EEG Classification , 2018, Comput. Intell. Neurosci..

[26]  Masashi Sugiyama,et al.  Geometry-aware principal component analysis for symmetric positive definite matrices , 2017, Machine Learning.

[27]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[28]  David Lee,et al.  Filter Bank Regularized Common Spatial Pattern Ensemble for Small Sample Motor Imagery Classification , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[29]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[30]  Cuntai Guan,et al.  Spatially sparsed Common Spatial Pattern to improve BCI performance , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[31]  Wonzoo Chung,et al.  BCI classification using locally generated CSP features , 2018, 2018 6th International Conference on Brain-Computer Interface (BCI).

[32]  Xingyu Wang,et al.  Temporally Constrained Sparse Group Spatial Patterns for Motor Imagery BCI , 2019, IEEE Transactions on Cybernetics.

[33]  Dezhi Zheng,et al.  Transfer Kernel Common Spatial Patterns for Motor Imagery Brain-Computer Interface Classification , 2018, Comput. Math. Methods Medicine.

[34]  Christian Jutten,et al.  Riemannian Geometry Applied to BCI Classification , 2010, LVA/ICA.

[35]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[36]  Hans W. Guesgen,et al.  Architectural Review of Co-Adaptive Brain Computer Interface , 2017, 2017 4th Asia-Pacific World Congress on Computer Science and Engineering (APWC on CSE).

[37]  Maher Moakher,et al.  Means of Hermitian positive-definite matrices based on the log-determinant α-divergence function , 2012 .

[38]  Sang-Hoon Park,et al.  Small Sample Setting and Frequency Band Selection Problem Solving Using Subband Regularized Common Spatial Pattern , 2017, IEEE Sensors Journal.

[39]  Alok Sharma,et al.  An improved discriminative filter bank selection approach for motor imagery EEG signal classification using mutual information , 2017, BMC Bioinformatics.

[40]  G. Pfurtscheller,et al.  The BCI competition III: validating alternative approaches to actual BCI problems , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  Panagiotis K. Artemiadis,et al.  EEG feature descriptors and discriminant analysis under Riemannian Manifold perspective , 2018, Neurocomputing.