A Dynamic Window Recognition Algorithm for SSVEP-Based Brain-Computer Interfaces Using a Spatio-Temporal Equalizer

The past decade has witnessed rapid development in the field of brain-computer interfaces (BCIs). While the performance is no longer the biggest bottleneck in the BCI application, the tedious training process and the poor ease-of-use have become the most significant challenges. In this study, a spatio-temporal equalization dynamic window (STE-DW) recognition algorithm is proposed for steady-state visual evoked potential (SSVEP)-based BCIs. The algorithm can adaptively control the stimulus time while maintaining the recognition accuracy, which significantly improves the information transfer rate (ITR) and enhances the adaptability of the system to different subjects. Specifically, a spatio-temporal equalization algorithm is used to reduce the adverse effects of spatial and temporal correlation of background noise. Based on the theory of multiple hypotheses testing, a stimulus termination criterion is used to adaptively control the dynamic window. The offline analysis which used a benchmark dataset and an offline dataset collected from 16 subjects demonstrated that the STE-DW algorithm is superior to the filter bank canonical correlation analysis (FBCCA), canonical variates with autoregressive spectral analysis (CVARS), canonical correlation analysis (CCA) and CCA reducing variation (CCA-RV) algorithms in terms of accuracy and ITR. The results show that in the benchmark dataset, the STE-DW algorithm achieved an average ITR of 134 bits/min, which exceeds the FBCCA, CVARS, CCA and CCA-RV. In off-line experiments, the STE-DW algorithm also achieved an average ITR of 116 bits/min. In addition, the online experiment also showed that the STE-DW algorithm can effectively expand the number of applicable users of the SSVEP-based BCI system. We suggest that the STE-DW algorithm can be used as a reliable identification algorithm for training-free SSVEP-based BCIs, because of the good balance between ease of use, recognition accuracy, ITR and user applicability.

[1]  Justin M. Ales,et al.  The steady-state visual evoked potential in vision research: A review. , 2015, Journal of vision.

[2]  Y. Inouye,et al.  A system-theoretic foundation for blind equalization of an FIR MIMO channel system , 2002 .

[3]  B. Allison,et al.  BCI Demographics: How Many (and What Kinds of) People Can Use an SSVEP BCI? , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[5]  J. Buford,et al.  Wavelet methodology to improve single unit isolation in primary motor cortex cells , 2015, Journal of Neuroscience Methods.

[6]  R. Quiroga,et al.  Stationarity of the EEG series , 1995 .

[7]  J. Buford,et al.  Brain–Computer Interface after Nervous System Injury , 2014, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[8]  Yang Yu,et al.  A Dynamically Optimized SSVEP Brain–Computer Interface (BCI) Speller , 2015, IEEE Transactions on Biomedical Engineering.

[9]  J. Wolpaw,et al.  A novel P300-based brain–computer interface stimulus presentation paradigm: Moving beyond rows and columns , 2010, Clinical Neurophysiology.

[10]  Juan C. Jiménez,et al.  Modeling the electroencephalogram by means of spatial spline smoothing and temporal autoregression , 1995, Biological Cybernetics.

[11]  Angelika Peer,et al.  Advancing the detection of steady-state visual evoked potentials in brain–computer interfaces , 2016, Journal of neural engineering.

[12]  Yijun Wang,et al.  Visual and Auditory Brain–Computer Interfaces , 2014, IEEE Transactions on Biomedical Engineering.

[13]  Arne Robben,et al.  Sampled sinusoidal stimulation profile and multichannel fuzzy logic classification for monitor-based phase-coded SSVEP brain–computer interfacing , 2013, Journal of neural engineering.

[14]  Donatella Spinelli,et al.  Electrophysiological evidence for an early attentional mechanism in visual processing in humans , 1999, Vision Research.

[15]  Tzyy-Ping Jung,et al.  High-speed spelling with a noninvasive brain–computer interface , 2015, Proceedings of the National Academy of Sciences.

[16]  Qi Wu,et al.  Using Fractal and Local Binary Pattern Features for Classification of ECOG Motor Imagery Tasks Obtained from the Right Brain Hemisphere , 2016, Int. J. Neural Syst..

[17]  Feng Wan,et al.  Adaptive time-window length based on online performance measurement in SSVEP-based BCIs , 2015, Neurocomputing.

[18]  Venugopal V. Veeravalli,et al.  A sequential procedure for multihypothesis testing , 1994, IEEE Trans. Inf. Theory.

[19]  Xiaorong Gao,et al.  A high-ITR SSVEP-based BCI speller , 2014 .

[20]  Wei Wu,et al.  Bayesian estimation of ERP components from multicondition and multichannel EEG , 2014, NeuroImage.

[21]  H. Adeli,et al.  A spatio-temporal wavelet-chaos methodology for EEG-based diagnosis of Alzheimer's disease , 2008, Neuroscience Letters.

[22]  Wei Wu,et al.  An Idle-State Detection Algorithm for SSVEP-Based Brain-Computer Interfaces Using a Maximum Evoked Response Spatial Filter , 2015, Int. J. Neural Syst..

[23]  Shangkai Gao,et al.  A practical VEP-based brain-computer interface. , 2006, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[24]  Yangsong Zhang,et al.  Multivariate synchronization index for frequency recognition of SSVEP-based brain–computer interface , 2014, Journal of Neuroscience Methods.

[25]  C.W. Anderson,et al.  Multivariate autoregressive models for classification of spontaneous electroencephalographic signals during mental tasks , 1998, IEEE Transactions on Biomedical Engineering.

[26]  Wei Wu,et al.  RSTFC: A Novel Algorithm for Spatio-Temporal Filtering and Classification of Single-Trial EEG , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Long Chen,et al.  Incorporation of Inter-Subject Information to Improve the Accuracy of Subject-Specific P300 Classifiers , 2016, Int. J. Neural Syst..

[28]  J. Movshon,et al.  The analysis of visual motion: a comparison of neuronal and psychophysical performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  Yijun Wang,et al.  Enhancing Detection of SSVEPs for a High-Speed Brain Speller Using Task-Related Component Analysis , 2018, IEEE Transactions on Biomedical Engineering.

[30]  Marc M. Van Hulle,et al.  Representation of steady-state visual evoked potentials elicited by luminance flicker in human occipital cortex: An electrocorticography study , 2018, NeuroImage.

[31]  Rami Saab,et al.  An Auditory-Tactile Visual Saccade-Independent P300 Brain-Computer Interface , 2016, Int. J. Neural Syst..

[32]  Xiaorong Gao,et al.  An online multi-channel SSVEP-based brain–computer interface using a canonical correlation analysis method , 2009, Journal of neural engineering.

[33]  Xiaogang Chen,et al.  A Benchmark Dataset for SSVEP-Based Brain–Computer Interfaces , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[34]  Nitish V. Thakor,et al.  EEG Classification with a Sequential Decision-Making Method in Motor Imagery BCI , 2017, Int. J. Neural Syst..

[35]  Wei Li,et al.  Increasing N200 Potentials Via Visual Stimulus Depicting Humanoid Robot Behavior , 2016, Int. J. Neural Syst..

[36]  Dingguo Zhang,et al.  Quantifying Different Tactile Sensations Evoked by Cutaneous Electrical Stimulation Using Electroencephalography Features , 2016, Int. J. Neural Syst..

[37]  Xiaogang Chen,et al.  Filter bank canonical correlation analysis for implementing a high-speed SSVEP-based brain–computer interface , 2015, Journal of neural engineering.

[38]  Hagai Attias,et al.  A Spatiotemporal Framework for Estimating Trial-to-Trial Amplitude Variation in Event-Related MEG/EEG , 2009, IEEE Transactions on Biomedical Engineering.

[39]  H. Adeli,et al.  Brain-computer interface technologies: from signal to action , 2013, Reviews in the neurosciences.

[40]  Ivan Volosyak,et al.  Multiple Channel Detection of Steady-State Visual Evoked Potentials for Brain-Computer Interfaces , 2007, IEEE Transactions on Biomedical Engineering.

[41]  Xiaorong Gao,et al.  A BCI-based environmental controller for the motion-disabled. , 2003, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[42]  Chin-Teng Lin,et al.  EEG Alpha and Gamma Modulators Mediate Motion Sickness-Related Spectral Responses , 2016, Int. J. Neural Syst..

[43]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[44]  N. Birbaumer,et al.  Brain-computer communication: self-regulation of slow cortical potentials for verbal communication. , 2001, Archives of physical medicine and rehabilitation.

[45]  Biyu J. He.  Scale-free brain activity: past, present, and future , 2014, Trends in Cognitive Sciences.

[46]  Gernot R. Müller-Putz,et al.  A Single-Switch BCI Based on Passive and imagined movements: toward Restoring Communication in Minimally Conscious patients , 2013, Int. J. Neural Syst..

[47]  G Castellanos-Dominguez,et al.  Reconstruction of Neural Activity from EEG Data Using Dynamic Spatiotemporal Constraints , 2016, Int. J. Neural Syst..

[48]  Luca Turella,et al.  Independent Component Decomposition of Human Somatosensory Evoked Potentials Recorded by Micro-Electrocorticography , 2017, Int. J. Neural Syst..

[49]  Tzyy-Ping Jung,et al.  A High-Speed Brain Speller using steady-State Visual evoked potentials , 2014, Int. J. Neural Syst..

[50]  Peng Yuan,et al.  A study of the existing problems of estimating the information transfer rate in online brain–computer interfaces , 2013, Journal of neural engineering.

[51]  Benjamin Wittevrongel,et al.  Frequency- and Phase Encoded SSVEP Using Spatiotemporal Beamforming , 2016, PloS one.

[52]  J. Buford,et al.  Combined corticospinal and reticulospinal effects on upper limb muscles , 2014, Neuroscience Letters.

[53]  Tom Chau,et al.  Online EEG Classification of Covert Speech for Brain-Computer Interfacing , 2017, Int. J. Neural Syst..