Optimizing Filter-bank Canonical Correlation Analysis for fast response SSVEP Brain-Computer Interface (BCI)

Steady-State Visual Evoked Potential (SSVEP) BCI brings high accuracy and consistent performance across subjects at the expense of a long stimulus presentation time window. Several recent methods exploited subject-specific features to improve SSVEP recognition performance in a short time window less than 1s. Although the calibration process is tedious and causes inconvenience, small calibration data with short duration resulting in higher performance gains are worth considering. So we propose a method by optimizing Filter-Bank Canonical Correlation Analysis (FBCCA) with subjects’ calibrated templates, subject-specific weights and multiple reference types. The proposed method, subject-calibration extended FBCCA (SCEF) leverages independent and distinct discrimination characteristics of multiple references with subject-specific weight-adjusted features to improve SSVEP recognition performance. We tested the proposed method with different parameters compared with FBCCA baseline and state-of-the-art calibration methods on forty targets SSVEP dataset using 0.2s to 4s time windows. Our evaluation results show SCEF with three reference templates and subject-specific weighted features perform significantly better than all FBCCA variants in 0.2 s to 1 s time window (p < 0.001). SCEF performs marginally, not statistically significant, better than existing methods about 2.69 ± 2.32% mean accuracy across time windows. Including multiple templates and subject-specific weight increases 15.73 ± 5.34% and 8.06± 2.06% in mean accuracy resulting the overall performance improvements in short time window. The proposed optimization only requires prior calibration data to create subject-specific templates and weights instead of learning features from calibration data every time. This enables not requiring to repeat the calibration step in every SSVEP session for the same subject while still maintaining accuracy similar to state-of-the-art calibration methods.

[1]  Toshihisa Tanaka,et al.  Two-Stage Frequency Recognition Method Based on Correlated Component Analysis for SSVEP-Based BCI , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[2]  Paul Sajda,et al.  Compact convolutional neural networks for classification of asynchronous steady-state visual evoked potentials , 2018, Journal of neural engineering.

[3]  Cuntai Guan,et al.  A Study of SSVEP Responses in Case of Overt and Covert Visual Attention with Different View Angles , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[4]  Wei Wu,et al.  Frequency recognition based on canonical correlation analysis for SSVEP-based BCIs , 2007, IEEE Transactions on Biomedical Engineering.

[5]  José del R. Millán,et al.  BNCI Horizon 2020: Towards a Roadmap for the BCI Community , 2015 .

[6]  R Zerafa,et al.  To train or not to train? A survey on training of feature extraction methods for SSVEP-based BCIs , 2018, Journal of neural engineering.

[7]  Xiaogang Chen,et al.  Filter bank canonical correlation analysis for implementing a high-speed SSVEP-based brain–computer interface , 2015, Journal of neural engineering.

[8]  Basabdatta Sen Bhattacharya,et al.  Nonlinear Origin of SSVEP Spectra—A Combined Experimental and Modeling Study , 2016, Front. Comput. Neurosci..

[9]  Yu Zhang,et al.  Hierarchical feature fusion framework for frequency recognition in SSVEP-based BCIs , 2018, Neural Networks.

[10]  Cuntai Guan,et al.  Improving the Performance of SSVEP BCI with Short Response Time by Temporal Alignments Enhanced CCA , 2019, 2019 9th International IEEE/EMBS Conference on Neural Engineering (NER).

[11]  Xiaorong Gao,et al.  A high-ITR SSVEP-based BCI speller , 2014 .

[12]  Justin M. Ales,et al.  The steady-state visual evoked potential in vision research: A review. , 2015, Journal of vision.

[13]  Yijun Wang,et al.  Enhancing Detection of SSVEPs for a High-Speed Brain Speller Using Task-Related Component Analysis , 2018, IEEE Transactions on Biomedical Engineering.

[14]  Cuntai Guan,et al.  A BCI speller based on SSVEP using high frequency stimuli design , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[15]  Hiroki Sato,et al.  Task-related component analysis for functional neuroimaging and application to near-infrared spectroscopy data , 2013, NeuroImage.

[16]  Xiaogang Chen,et al.  A Benchmark Dataset for SSVEP-Based Brain–Computer Interfaces , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  T. Jung,et al.  Detecting Glaucoma With a Portable Brain-Computer Interface for Objective Assessment of Visual Function Loss , 2017, JAMA ophthalmology.

[18]  Benjamin Wittevrongel,et al.  Frequency- and Phase Encoded SSVEP Using Spatiotemporal Beamforming , 2016, PloS one.

[19]  Yu-Te Wang,et al.  A Comparison Study of Canonical Correlation Analysis Based Methods for Detecting Steady-State Visual Evoked Potentials , 2015, PloS one.

[20]  Feng Wan,et al.  Learning across multi-stimulus enhances target recognition methods in SSVEP-based BCIs , 2020, Journal of neural engineering.

[21]  Peng Yuan,et al.  Enhancing performances of SSVEP-based brain–computer interfaces via exploiting inter-subject information , 2015, Journal of neural engineering.

[22]  Andreas Keil,et al.  Steady-state visual evoked potentials as a research tool in social affective neuroscience. , 2016, Psychophysiology.

[23]  Cuntai Guan,et al.  Spectrum and Phase Adaptive CCA for SSVEP-based Brain Computer Interface , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[24]  G R Kiran Kumar,et al.  Filter bank extensions for subject non-specific SSVEP based BCIs , 2019, 2019 9th International IEEE/EMBS Conference on Neural Engineering (NER).

[25]  John Williamson,et al.  EEG dataset and OpenBMI toolbox for three BCI paradigms: an investigation into BCI illiteracy , 2019, GigaScience.

[26]  Tzyy-Ping Jung,et al.  Cross-Subject Transfer Learning Improves the Practicality of Real-World Applications of Brain-Computer Interfaces , 2019, 2019 9th International IEEE/EMBS Conference on Neural Engineering (NER).

[27]  Ahmed M. Azab,et al.  A review on transfer learning approaches in brain–computer interface , 2018 .

[28]  Yijun Wang,et al.  Control of a 7-DOF Robotic Arm System With an SSVEP-Based BCI , 2018, Int. J. Neural Syst..