Hierarchical online SSVEP spelling achieved with spatiotemporal beamforming

Steady-State Visual Evoked Potentials (SSVEP) are widely adopted in brain-computer interface (BCI) applications. To increase the number of selectable targets, joint frequency- and phase-coding is sometimes used but it has only been tested in offline settings. In this study, we report on an online, hierarchical SSVEP spelling application that relies on joint frequency-phase coded targets, and, in addition, propose a new decoding scheme based on spatiotemporal beamforming combined with time-domain EEG analysis. Experiments on 17 healthy subjects confirm that with our new decoding scheme, accurate spelling can be performed in an online setting, even when using short stimulation lengths (1 sec) and closely separated stimulation frequencies (1 Hz).

[1]  C Neuper,et al.  A comparison of three brain–computer interfaces based on event-related desynchronization, steady state visual evoked potentials, or a hybrid approach using both signals , 2011, Journal of neural engineering.

[2]  B. Blankertz,et al.  (C)overt attention and visual speller design in an ERP-based brain-computer interface , 2010, Behavioral and Brain Functions.

[3]  T. J. Sullivan,et al.  A user-friendly SSVEP-based brain–computer interface using a time-domain classifier , 2010, Journal of neural engineering.

[4]  Tzyy-Ping Jung,et al.  A High-Speed Brain Speller using steady-State Visual evoked potentials , 2014, Int. J. Neural Syst..

[5]  Marc M. Van Hulle,et al.  Faster P300 Classifier Training Using Spatiotemporal Beamforming , 2016, Int. J. Neural Syst..

[6]  Arne Robben,et al.  Sampled sinusoidal stimulation profile and multichannel fuzzy logic classification for monitor-based phase-coded SSVEP brain–computer interfacing , 2013, Journal of neural engineering.

[7]  Tzyy-Ping Jung,et al.  Hybrid frequency and phase coding for a high-speed SSVEP-based BCI speller , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  Benjamin Wittevrongel,et al.  Frequency- and Phase Encoded SSVEP Using Spatiotemporal Beamforming , 2016, PloS one.

[9]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[10]  Brendan Z. Allison,et al.  How Many People Could Use an SSVEP BCI? , 2012, Front. Neurosci..

[11]  Arne Robben,et al.  Decoding SSVEP Responses using Time Domain Classification , 2018, IJCCI.

[12]  Steven Laureys,et al.  A Comparison of Two Spelling Brain-Computer Interfaces Based on Visual P3 and SSVEP in Locked-In Syndrome , 2013, PloS one.

[13]  Marc M. Van Hulle,et al.  Language Model Applications to Spelling with Brain-Computer Interfaces , 2014, Sensors.

[14]  Marc M. Van Hulle,et al.  Single-Trial ERP Component Analysis Using a Spatiotemporal LCMV Beamformer , 2016, IEEE Transactions on Biomedical Engineering.

[15]  Brendan Z. Allison,et al.  Could Anyone Use a BCI? , 2010, Brain-Computer Interfaces.

[16]  Ivan Volosyak,et al.  SSVEP-based Bremen–BCI interface—boosting information transfer rates , 2011, Journal of neural engineering.

[17]  Steven A. Hillyard,et al.  Steady-State VEP and Attentional Visual Processing , 2003 .

[18]  Xiaogang Chen,et al.  Filter bank canonical correlation analysis for implementing a high-speed SSVEP-based brain–computer interface , 2015, Journal of neural engineering.

[19]  John Williamson,et al.  User-centered design in brain-computer interfaces - A case study , 2013, Artif. Intell. Medicine.

[20]  N. Birbaumer,et al.  Predictability of Brain-Computer Communication , 2004 .

[21]  Sung-Phil Kim,et al.  A hierarchical stimulus presentation paradigm for a P300‐based Hangul speller , 2011, Int. J. Imaging Syst. Technol..

[22]  Donatella Spinelli,et al.  Electrophysiological evidence for an early attentional mechanism in visual processing in humans , 1999, Vision Research.

[23]  B. Allison,et al.  BCI Demographics: How Many (and What Kinds of) People Can Use an SSVEP BCI? , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Xiaorong Gao,et al.  Frequency and Phase Mixed Coding in SSVEP-Based Brain--Computer Interface , 2011, IEEE Transactions on Biomedical Engineering.