Frequency Recognition in SSVEP-Based BCI using Multiset Canonical Correlation Analysis

Canonical correlation analysis (CCA) has been one of the most popular methods for frequency recognition in steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs). Despite its efficiency, a potential problem is that using pre-constructed sine-cosine waves as the required reference signals in the CCA method often does not result in the optimal recognition accuracy due to their lack of features from the real electro-encephalo-gram (EEG) data. To address this problem, this study proposes a novel method based on multiset canonical correlation analysis (MsetCCA) to optimize the reference signals used in the CCA method for SSVEP frequency recognition. The MsetCCA method learns multiple linear transforms that implement joint spatial filtering to maximize the overall correlation among canonical variates, and hence extracts SSVEP common features from multiple sets of EEG data recorded at the same stimulus frequency. The optimized reference signals are formed by combination of the common features and completely based on training data. Experimental study with EEG data from 10 healthy subjects demonstrates that the MsetCCA method improves the recognition accuracy of SSVEP frequency in comparison with the CCA method and other two competing methods (multiway CCA (MwayCCA) and phase constrained CCA (PCCA)), especially for a small number of channels and a short time window length. The superiority indicates that the proposed MsetCCA method is a new promising candidate for frequency recognition in SSVEP-based BCIs.

[1]  Emanuel Donchin,et al.  A P 300-based brain – computer interface : Initial tests by ALS patients Eric , 2006 .

[2]  Hojjat Adeli,et al.  New diagnostic EEG markers of the Alzheimer’s disease using visibility graph , 2010, Journal of Neural Transmission.

[3]  Xiaorong Gao,et al.  Design and implementation of a brain-computer interface with high transfer rates , 2002, IEEE Transactions on Biomedical Engineering.

[4]  H. Adeli,et al.  Intrahemispheric, interhemispheric, and distal EEG coherence in Alzheimer’s disease , 2011, Clinical Neurophysiology.

[5]  D. Yao,et al.  Multiple Frequencies Sequential Coding for SSVEP-Based Brain-Computer Interface , 2012, PloS one.

[6]  T. Picton,et al.  Human auditory steady-state responses to amplitude-modulated tones: phase and latency measurements , 2000, Hearing Research.

[7]  Hojjat Adeli,et al.  A new supervised learning algorithm for multiple spiking neural networks with application in epilepsy and seizure detection , 2009, Neural Networks.

[8]  Yuanqing Li,et al.  An EEG-Based BCI System for 2-D Cursor Control by Combining Mu/Beta Rhythm and P300 Potential , 2010, IEEE Transactions on Biomedical Engineering.

[9]  H. Adeli,et al.  Brain-computer interface technologies: from signal to action , 2013, Reviews in the neurosciences.

[10]  Andrzej Cichocki,et al.  Nonnegative Tensor Factorization for Continuous EEG Classification , 2007, Int. J. Neural Syst..

[11]  J. Wolpaw,et al.  Towards an independent brain–computer interface using steady state visual evoked potentials , 2008, Clinical Neurophysiology.

[12]  Yuanqing Li,et al.  An Extended EM Algorithm for Joint Feature Extraction and Classification in Brain-Computer Interfaces , 2006, Neural Computation.

[13]  Hojjat Adeli,et al.  Wavelet-Synchronization Methodology: A New Approach for EEG-Based Diagnosis of ADHD , 2010, Clinical EEG and neuroscience.

[14]  Hojjat Adeli,et al.  Probabilistic neural networks for diagnosis of Alzheimer's disease using conventional and wavelet coherence , 2011, Journal of Neuroscience Methods.

[15]  Hojjat Adeli,et al.  Fractality and a Wavelet-Chaos-Neural Network Methodology for EEG-Based Diagnosis of Autistic Spectrum Disorder , 2010, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[16]  Hojjat Adeli,et al.  Functional community analysis of brain: A new approach for EEG-based investigation of the brain pathology , 2011, NeuroImage.

[17]  Heikki Lyytinen,et al.  Benefits of Multi-Domain Feature of mismatch Negativity Extracted by Non-Negative Tensor Factorization from EEG Collected by Low-Density Array , 2012, Int. J. Neural Syst..

[18]  Gernot R. Müller-Putz,et al.  Control of an Electrical Prosthesis With an SSVEP-Based BCI , 2008, IEEE Transactions on Biomedical Engineering.

[19]  Shangkai Gao,et al.  A practical VEP-based brain-computer interface. , 2006, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[20]  J. Kettenring,et al.  Canonical Analysis of Several Sets of Variables , 2022 .

[21]  张宇,et al.  脑控: 基于脑——机接口的人机融合控制 , 2014 .

[22]  Xiaorong Gao,et al.  Enhancing the classification accuracy of steady-state visual evoked potential-based brain–computer interfaces using phase constrained canonical correlation analysis , 2011, Journal of neural engineering.

[23]  Vince D. Calhoun,et al.  Group Study of Simulated Driving fMRI Data by Multiset Canonical Correlation Analysis , 2009, NeuroImage.

[24]  Xiaorong Gao,et al.  A BCI-based environmental controller for the motion-disabled , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  H. Adeli,et al.  Graph Theoretical Analysis of Organization of Functional Brain Networks in ADHD , 2012, Clinical EEG and neuroscience.

[26]  Yu Zhang,et al.  Brain Control: Human-computer Integration Control Based on Brain-computer Interface Approach , 2013 .

[27]  Wei Wu,et al.  Frequency Recognition Based on Canonical Correlation Analysis for SSVEP-Based BCIs , 2006, IEEE Transactions on Biomedical Engineering.

[28]  Yijun Wang,et al.  Lead selection for SSVEP-based brain-computer interface , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[29]  Hojjat Adeli,et al.  Fuzzy Synchronization Likelihood with Application to Attention-Deficit/Hyperactivity Disorder , 2011, Clinical EEG and neuroscience.

[30]  H. Adeli,et al.  of Depressive Women and Men Spatiotemporal Analysis of Relative Convergence of EEGs Reveals Differences Between Brain Dynamics , 2013 .

[31]  Tapani Ristaniemi,et al.  Multi-Domain Feature Extraction for Small Event-Related potentials through Nonnegative Multi-Way Array Decomposition from Low Dense Array EEG , 2013, Int. J. Neural Syst..

[32]  Yuanqing Li,et al.  A self-training semi-supervised SVM algorithm and its application in an EEG-based brain computer interface speller system , 2008, Pattern Recognit. Lett..

[33]  Jie Li,et al.  Design of assistive Wheelchair System directly Steered by Human Thoughts , 2013, Int. J. Neural Syst..

[34]  Xiaorong Gao,et al.  An online multi-channel SSVEP-based brain–computer interface using a canonical correlation analysis method , 2009, Journal of neural engineering.

[35]  Andrzej Cichocki,et al.  L1-Regularized Multiway Canonical Correlation Analysis for SSVEP-Based BCI , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  Andrzej Cichocki,et al.  Common and Individual Features Analysis: Beyond Canonical Correlation Analysis , 2012, ArXiv.

[37]  Tapani Ristaniemi,et al.  Single-Trial Based Independent Component Analysis on mismatch Negativity in Children , 2010, Int. J. Neural Syst..

[38]  Malek Adjouadi,et al.  A New Parametric Feature Descriptor for the Classification of Epileptic and Control EEG Records in Pediatric Population , 2012, Int. J. Neural Syst..

[39]  Marc M. Van Hulle,et al.  Multichannel Decoding for Phase-Coded SSVEP Brain-Computer Interface , 2012, Int. J. Neural Syst..

[40]  Feng Li,et al.  Discrimination Between Control and Idle States in Asynchronous SSVEP-Based Brain Switches: A Pseudo-Key-Based Approach , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  Ignacio Santamaría,et al.  A learning algorithm for adaptive canonical correlation analysis of several data sets , 2007, Neural Networks.

[42]  Xingyu Wang,et al.  Multiway Canonical Correlation Analysis for Frequency Components Recognition in SSVEP-Based BCIs , 2011, ICONIP.

[43]  Yuanqing Li,et al.  Joint feature re-extraction and classification using an iterative semi-supervised support vector machine algorithm , 2008, Machine Learning.

[44]  M. Hulle,et al.  Functional connectivity analysis of fMRI data based on regularized multiset canonical correlation analysis , 2011, Journal of Neuroscience Methods.

[45]  Gernot R. Müller-Putz,et al.  A Single-Switch BCI Based on Passive and imagined movements: toward Restoring Communication in Minimally Conscious patients , 2013, Int. J. Neural Syst..

[46]  H. Adeli,et al.  A spatio-temporal wavelet-chaos methodology for EEG-based diagnosis of Alzheimer's disease , 2008, Neuroscience Letters.

[47]  Ivan Volosyak,et al.  An SSVEP-Based Brain–Computer Interface for the Control of Functional Electrical Stimulation , 2010, IEEE Transactions on Biomedical Engineering.

[48]  Xingyu Wang,et al.  Spatial-Temporal Discriminant Analysis for ERP-Based Brain-Computer Interface , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[49]  Dezhong Yao,et al.  Frequency detection with stability coefficient for steady-state visual evoked potential (SSVEP)-based BCIs. , 2008, Journal of neural engineering.

[50]  Vince D. Calhoun,et al.  Joint Blind Source Separation by Multiset Canonical Correlation Analysis , 2009, IEEE Transactions on Signal Processing.

[51]  H. Hotelling.  Relations Between Two Sets of Variates , 1936 .

[52]  Francisco J. Pelayo,et al.  An auditory Brain-Computer Interface with Accuracy Prediction , 2012, Int. J. Neural Syst..

[53]  Xingyu Wang,et al.  Aggregation of Sparse Linear Discriminant analyses for Event-Related potential Classification in Brain-Computer Interface , 2014, Int. J. Neural Syst..

[54]  Allan Aasbjerg Nielsen,et al.  Multiset canonical correlations analysis and multispectral, truly multitemporal remote sensing data , 2002, IEEE Trans. Image Process..

[55]  Reinhold Scherer,et al.  Steady-state visual evoked potential (SSVEP)-based communication: impact of harmonic frequency components , 2005, Journal of neural engineering.

[56]  A. Cichocki,et al.  A novel BCI based on ERP components sensitive to configural processing of human faces , 2012, Journal of neural engineering.

[57]  U. Rajendra Acharya,et al.  Application of Empirical Mode Decomposition (EMD) for Automated Detection of epilepsy using EEG signals , 2012, Int. J. Neural Syst..

[58]  Yu-Te Wang,et al.  A cell-phone-based brain–computer interface for communication in daily life , 2010, AICI.

[59]  Vince D. Calhoun,et al.  Multi-set canonical correlation analysis for the fusion of concurrent single trial ERP and functional MRI , 2010, NeuroImage.

[60]  Wei-Yen Hsu,et al.  Continuous EEG Signal Analysis for Asynchronous BCI Application , 2011, Int. J. Neural Syst..

[61]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[62]  Ivan Volosyak,et al.  Multiple Channel Detection of Steady-State Visual Evoked Potentials for Brain-Computer Interfaces , 2007, IEEE Transactions on Biomedical Engineering.

[63]  E. Donchin,et al.  A P300-based brain–computer interface: Initial tests by ALS patients , 2006, Clinical Neurophysiology.

[64]  Po-Lei Lee,et al.  Frequency recognition in an SSVEP-based brain computer interface using empirical mode decomposition and refined generalized zero-crossing , 2011, Journal of Neuroscience Methods.

[65]  AdeliHojjat,et al.  A new supervised learning algorithm for multiple spiking neural networks with application in epilepsy and seizure detection , 2009 .