Incorporation of dynamic stopping strategy into the high-speed SSVEP-based BCIs

OBJECTIVE Electroencephalography (EEG) is a non-linear and non-stationary process, as a result, its features are unstable and often vary in quality across trials, which poses significant challenges to brain-computer interfaces (BCIs). One remedy to this problem is to adaptively collect sufficient EEG evidence using dynamic stopping (DS) strategies. The high-speed steady-state visual evoked potential (SSVEP)-based BCI has experienced tremendous progress in recent years. This study aims to further improve the high-speed SSVEP-based BCI by incorporating the DS strategy. APPROACH This study involves the development of two different DS strategies for a high-speed SSVEP-based BCI, which were based on the Bayes estimation and the discriminant analysis, respectively. To evaluate their performance, they were compared with the conventional fixed stopping (FS) strategy using simulated online tests on both our collected data and a public dataset. Two most effective SSVEP recognition methods were used for comparison, including the extended canonical correlation analysis (CCA) and the ensemble task-related component analysis (TRCA). MAIN RESULTS The DS strategies achieved significantly higher information transfer rates (ITRs) than the FS strategy for both datasets, improving 9.78% for the Bayes-based DS and 6.7% for the discriminant-based DS. Specifically, the discriminant-based DS strategy using ensemble TRCA performed the best for our collected data, reaching an average ITR of 353.3  ±  67.1 bits min-1 with a peak of 460 bits min-1. The Bayes-based DS strategy using ensemble TRCA had the highest ITR for the public dataset, reaching an average of 230.2  ±  65.8 bits min-1 with a peak of 304.1 bits min-1. SIGNIFICANCE This study demonstrates that the proposed dynamic stopping strategies can further improve the performance of a SSVEP-based BCI, and hold promise for practical applications.

[1]  Xiaogang Chen,et al.  Filter bank canonical correlation analysis for implementing a high-speed SSVEP-based brain–computer interface , 2015, Journal of neural engineering.

[2]  Feng Li,et al.  A Hybrid Brain-Computer Interface-Based Mail Client , 2013, Comput. Math. Methods Medicine.

[3]  Xingyu Wang,et al.  A P300 Brain-Computer Interface Based on a Modification of the Mismatch Negativity Paradigm , 2015, Int. J. Neural Syst..

[4]  Erwei Yin,et al.  Adding Real-Time Bayesian Ranks to Error-Related Potential Scores Improves Error Detection and Auto-Correction in a P300 Speller , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  Yijun Wang,et al.  Enhancing Detection of SSVEPs for a High-Speed Brain Speller Using Task-Related Component Analysis , 2018, IEEE Transactions on Biomedical Engineering.

[6]  Cuntai Guan,et al.  Asynchronous P300-Based Brain--Computer Interfaces: A Computational Approach With Statistical Models , 2008, IEEE Transactions on Biomedical Engineering.

[7]  B O Mainsah,et al.  Increasing BCI communication rates with dynamic stopping towards more practical use: an ALS study , 2015, Journal of neural engineering.

[8]  D. Yao,et al.  Multiple Frequencies Sequential Coding for SSVEP-Based Brain-Computer Interface , 2012, PloS one.

[9]  Xiaorong Gao,et al.  A high-ITR SSVEP-based BCI speller , 2014 .

[10]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[11]  Tzyy-Ping Jung,et al.  A High-Speed Brain Speller using steady-State Visual evoked potentials , 2014, Int. J. Neural Syst..

[12]  Peng Yuan,et al.  A study of the existing problems of estimating the information transfer rate in online brain–computer interfaces , 2013, Journal of neural engineering.

[13]  Xingyu Wang,et al.  Frequency Recognition in SSVEP-Based BCI using Multiset Canonical Correlation Analysis , 2013, Int. J. Neural Syst..

[14]  G.F. Inbar,et al.  An improved P300-based brain-computer interface , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  Yang Yu,et al.  A Dynamically Optimized SSVEP Brain–Computer Interface (BCI) Speller , 2015, IEEE Transactions on Biomedical Engineering.

[16]  Yijun Wang,et al.  Enhancing detection of steady-state visual evoked potentials using individual training data , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  J. Wolpaw,et al.  A novel P300-based brain–computer interface stimulus presentation paradigm: Moving beyond rows and columns , 2010, Clinical Neurophysiology.

[18]  K. A. Colwell,et al.  Bayesian Approach to Dynamically Controlling Data Collection in P300 Spellers , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Yijun Wang,et al.  Visual and Auditory Brain–Computer Interfaces , 2014, IEEE Transactions on Biomedical Engineering.

[20]  Benjamin Blankertz,et al.  Two-dimensional auditory p300 speller with predictive text system , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[21]  Stefan Haufe,et al.  Optimizing event-related potential based brain-computer interfaces: a systematic evaluation of dynamic stopping methods. , 2013, Journal of neural engineering.

[22]  G Pfurtscheller,et al.  Toward a hybrid brain–computer interface based on imagined movement and visual attention , 2010, Journal of neural engineering.

[23]  Dong Ming,et al.  A hybrid BCI speller paradigm combining P300 potential and the SSVEP blocking feature , 2013, Journal of neural engineering.

[24]  Tzyy-Ping Jung,et al.  High-speed spelling with a noninvasive brain–computer interface , 2015, Proceedings of the National Academy of Sciences.

[25]  Tzyy-Ping Jung,et al.  Fast detection of covert visuospatial attention using hybrid N2pc and SSVEP features. , 2016, Journal of neural engineering.

[26]  G Townsend,et al.  Pushing the P300-based brain-computer interface beyond 100 bpm: extending performance guided constraints into the temporal domain. , 2016, Journal of neural engineering.

[27]  Yu-Te Wang,et al.  A Comparison Study of Canonical Correlation Analysis Based Methods for Detecting Steady-State Visual Evoked Potentials , 2015, PloS one.

[28]  Fanglin Chen,et al.  A novel hybrid BCI speller based on the incorporation of SSVEP into the P300 paradigm , 2013, Journal of neural engineering.

[29]  Xingyu Wang,et al.  Aggregation of Sparse Linear Discriminant analyses for Event-Related potential Classification in Brain-Computer Interface , 2014, Int. J. Neural Syst..

[30]  A. Cichocki,et al.  Steady-state visually evoked potentials: Focus on essential paradigms and future perspectives , 2010, Progress in Neurobiology.

[31]  Jérémie Mattout,et al.  Improving BCI performance through co-adaptation: applications to the P300-speller. , 2015, Annals of physical and rehabilitation medicine.

[32]  A. Lenhardt,et al.  An Adaptive P300-Based Online Brain–Computer Interface , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  Klaus-Robert Müller,et al.  Integrating dynamic stopping, transfer learning and language models in an adaptive zero-training ERP speller , 2014, Journal of neural engineering.

[34]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[35]  Yan Wang,et al.  Visual stimulus design for high-rate SSVEP BCI , 2010 .

[36]  Rami Saab,et al.  A Hybrid Brain–Computer Interface Based on the Fusion of P300 and SSVEP Scores , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[37]  Xiaorong Gao,et al.  An online multi-channel SSVEP-based brain–computer interface using a canonical correlation analysis method , 2009, Journal of neural engineering.

[38]  Xiaogang Chen,et al.  A Benchmark Dataset for SSVEP-Based Brain–Computer Interfaces , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[39]  Xiaorong Gao,et al.  Frequency and Phase Mixed Coding in SSVEP-Based Brain--Computer Interface , 2011, IEEE Transactions on Biomedical Engineering.

[40]  Michael Tangermann,et al.  Listen, You are Writing! Speeding up Online Spelling with a Dynamic Auditory BCI , 2011, Front. Neurosci..

[41]  Yangsong Zhang,et al.  Multivariate synchronization index for frequency recognition of SSVEP-based brain–computer interface , 2014, Journal of Neuroscience Methods.

[42]  Yu Zhang,et al.  Generic Channels Selection in Motor Imagery-Based BCI , 2016 .

[43]  Xingyu Wang,et al.  An ERP-Based BCI using an oddball Paradigm with Different Faces and Reduced errors in Critical Functions , 2014, Int. J. Neural Syst..

[44]  Chang-Hwan Im,et al.  A new dual-frequency stimulation method to increase the number of visual stimuli for multi-class SSVEP-based brain–computer interface (BCI) , 2013, Brain Research.

[45]  Rami Saab,et al.  An Auditory-Tactile Visual Saccade-Independent P300 Brain-Computer Interface , 2016, Int. J. Neural Syst..