Transfer Learning of BCI Using CUR Algorithm

The brain computer interface (BCI) are used in many applications including medical, environment, education, economy, and social fields. In order to have a high performing BCI classification, the training set must contain variations of high quality subjects which are discriminative. Variations will also drive transferability of training data for generalization purposes. However, if the test subject is unique from the training set variations, BCI performance may suffer. Previously, this problem was solved by introducing transfer learning in the context of spatial filtering on small training set by creating high quality variations within training subjects. In this study however, it was discovered that transfer learning can also be used to compress the training data into an optimal compact size while improving training data performance. The transfer learning framework proposed was on motor imagery BCI-EEG using CUR matrix decomposition algorithm which decomposes data into two components; C and UR which is each subject’s EEG signal and common matrix derived from historical EEG data, respectively. The method is considered transfer learning process because it utilizes historical data as common matrix for the classification purposes. This framework is implemented in the BCI system along with Common Spatial Pattern (CSP) as features extractor and Extreme Learning Machine (ELM) as classifier and this combination exhibits an increase of accuracy to up to 26% with 83% training database compression.

[1]  Moritz Grosse-Wentrup,et al.  Multisubject Learning for Common Spatial Patterns in Motor-Imagery BCI , 2011, Comput. Intell. Neurosci..

[2]  Klaus-Robert Müller,et al.  The non-invasive Berlin Brain–Computer Interface: Fast acquisition of effective performance in untrained subjects , 2007, NeuroImage.

[3]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[4]  Haiping Lu,et al.  Regularized common spatial patterns with generic learning for EEG signal classification , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  H. Zhang,et al.  A tensor-based scheme for stroke patients’ motor imagery EEG analysis in BCI-FES rehabilitation training , 2014, Journal of Neuroscience Methods.

[6]  Daniel P. Ferris,et al.  High-density EEG and independent component analysis mixture models distinguish knee contractions from ankle contractions , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[7]  Ayman Atia,et al.  Brain computer interfacing: Applications and challenges , 2015 .

[8]  Seungjin Choi,et al.  Bayesian common spatial patterns for multi-subject EEG classification , 2014, Neural Networks.

[9]  Xiongwen Zhao,et al.  Dimension Reduction of Channel Correlation Matrix Using CUR-Decomposition Technique for 3-D Massive Antenna System , 2018, IEEE Access.

[10]  Motoaki Kawanabe,et al.  Invariant Common Spatial Patterns: Alleviating Nonstationarities in Brain-Computer Interfacing , 2007, NIPS.

[11]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[12]  Klaus-Robert Müller,et al.  Learning From More Than One Data Source: Data Fusion Techniques for Sensorimotor Rhythm-Based Brain–Computer Interfaces , 2015, Proceedings of the IEEE.

[13]  Motoaki Kawanabe,et al.  Brain-computer interfacing in discriminative and stationary subspaces , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[14]  Bernhard Schölkopf,et al.  Transfer Learning in Brain-Computer Interfaces , 2015, IEEE Computational Intelligence Magazine.

[15]  Konstantinos N. Plataniotis,et al.  Separable Common Spatio-Spectral Patterns for Motor Imagery BCI Systems , 2016, IEEE Transactions on Biomedical Engineering.

[16]  Motoaki Kawanabe,et al.  Divergence-Based Framework for Common Spatial Patterns Algorithms , 2014, IEEE Reviews in Biomedical Engineering.

[17]  Mannes Poel,et al.  Classifying motor imagery in presence of speech , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[18]  Cuntai Guan,et al.  Mutual information-based selection of optimal spatial-temporal patterns for single-trial EEG-based BCIs , 2012, Pattern Recognit..

[19]  M. Ramasubba Reddy,et al.  Multi-channel EEG compression based on matrix and tensor decompositions , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[20]  Yang Liu,et al.  High Dimensionality Reduction Using CUR Matrix Decomposition and Auto-encoder for Web Image Classification , 2010, PCM.

[21]  Klaus-Robert Muller,et al.  Finding stationary brain sources in EEG data , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[22]  J. Wolpaw Brain-computer interfaces. , 2013, Handbook of clinical neurology.

[23]  Christian Jutten,et al.  Multiclass Brain–Computer Interface Classification by Riemannian Geometry , 2012, IEEE Transactions on Biomedical Engineering.

[24]  Moritz Grosse-Wentrup,et al.  Multiclass Common Spatial Patterns and Information Theoretic Feature Extraction , 2008, IEEE Transactions on Biomedical Engineering.

[25]  Klaus-Robert Müller,et al.  ℓ1-penalized linear mixed-effects models for high dimensional data with application to BCI , 2011, NeuroImage.

[26]  J. E. Chong-Quero,et al.  BCI: A historical analysis and technology comparison , 2011, 2011 Pan American Health Care Exchanges.

[27]  Klaus-Robert Müller,et al.  Towards Zero Training for Brain-Computer Interfacing , 2008, PloS one.

[28]  Jian Zhang,et al.  Deep Extreme Learning Machine and Its Application in EEG Classification , 2015 .

[29]  Darren J. Leamy,et al.  An exploration of EEG features during recovery following stroke – implications for BCI-mediated neurorehabilitation therapy , 2014, Journal of NeuroEngineering and Rehabilitation.

[30]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[31]  Moritz Grosse-Wentrup,et al.  Multitask Learning for Brain-Computer Interfaces , 2010, AISTATS.

[32]  Petros Drineas,et al.  CUR matrix decompositions for improved data analysis , 2009, Proceedings of the National Academy of Sciences.

[33]  Cuntai Guan,et al.  Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms , 2011, IEEE Transactions on Biomedical Engineering.

[34]  Motoaki Kawanabe,et al.  Stationary common spatial patterns for brain–computer interfacing , 2012, Journal of neural engineering.

[35]  Klaus-Robert Müller,et al.  Common Spatial Pattern Patches: Online evaluation on BCI-naive users , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[36]  Narasimhan Sundararajan,et al.  Classification of Mental Tasks from Eeg Signals Using Extreme Learning Machine , 2006, Int. J. Neural Syst..

[37]  Cuntai Guan,et al.  Bayesian Learning for Spatial Filtering in an EEG-Based Brain–Computer Interface , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[38]  Prabhat,et al.  Identifying important ions and positions in mass spectrometry imaging data using CUR matrix decompositions. , 2015, Analytical chemistry.

[39]  Muhammad Tayyab Asif,et al.  CUR decomposition for compression and compressed sensing of large-scale traffic data , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[40]  Seungjin Choi,et al.  CUR+NMF for learning spectral features from large data matrix , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[41]  Rubiyah Yusof,et al.  The Design of Spatial Selection Using CUR Decomposition to Improve Common Spatial Pattern for Multi-trial EEG Classification , 2017, AsiaSim 2017.

[42]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[43]  Klaus-Robert Müller,et al.  Predicting BCI Subject Performance Using Probabilistic Spatio-Temporal Filters , 2014, PloS one.

[44]  Cuntai Guan,et al.  Spatially Regularized Common Spatial Patterns for EEG Classification , 2010, 2010 20th International Conference on Pattern Recognition.

[45]  Alexander Cerquera,et al.  Non-linear EEG analyses predict non-response to rTMS treatment in major depressive disorder , 2014, Clinical Neurophysiology.

[46]  Mohd Ibrahim Shapiai,et al.  Feature scaling for EEG human concentration using particle swarm optimization , 2016, 2016 8th International Conference on Information Technology and Electrical Engineering (ICITEE).

[47]  Bruce J. Gluckman,et al.  Low cost electroencephalographic acquisition amplifier to serve as teaching and research tool , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[48]  Yasuharu Koike,et al.  Application of Covariate Shift Adaptation Techniques in Brain–Computer Interfaces , 2010, IEEE Transactions on Biomedical Engineering.