A multi-target brain-computer interface based on code modulated visual evoked potentials

The number of selectable targets is one of the main factors that affect the performance of a brain-computer interface (BCI). Most existing code modulated visual evoked potential (c-VEP) based BCIs use a single pseudorandom binary sequence and its circularly shifting sequences to modulate different stimulus targets, making the number of selectable targets limited by the length of modulation codes. This paper proposes a novel paradigm for c-VEP BCIs, which divides the stimulus targets into four target groups and each group of targets are modulated by a unique pseudorandom binary code and its circularly shifting codes. Based on the paradigm, a four-group c-VEP BCI with a total of 64 stimulus targets was developed and eight subjects were recruited to participate in the BCI experiment. Based on the experimental data, the characteristics of the c-VEP BCI were explored by the analyses of auto- and cross-correlation, frequency spectrum, signal to noise ratio and correlation coefficient. On the basis, single-trial data with the length of one stimulus cycle were classified and the attended target was recognized. The averaged classification accuracy across subjects was 88.36% and the corresponding information transfer rate was as high as 184.6 bit/min. These results suggested that the c-VEP BCI paradigm is both feasible and effective, and provides a new solution for BCI study to substantially increase the number of available targets.

[1]  Tzyy-Ping Jung,et al.  High-speed spelling with a noninvasive brain–computer interface , 2015, Proceedings of the National Academy of Sciences.

[2]  G. Pfurtscheller,et al.  Self-Paced Operation of an SSVEP-Based Orthosis With and Without an Imagery-Based “Brain Switch:” A Feasibility Study Towards a Hybrid BCI , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  F. Campbell,et al.  Electrophysiological evidence for the existence of orientation and size detectors in the human visual system , 1970, The Journal of physiology.

[4]  Erich E. Sutter,et al.  The brain response interface: communication through visually-induced electrical brain responses , 1992 .

[5]  Yan Wang,et al.  Visual stimulus design for high-rate SSVEP BCI , 2010 .

[6]  Siwei Feng,et al.  Stimulus Specificity of Brain-Computer Interfaces Based on Code Modulation Visual Evoked Potentials , 2016, PloS one.

[7]  Deniz Erdogmus,et al.  Decoding of multichannel EEG activity from the visual cortex in response to pseudorandom binary sequences of visual stimuli , 2011, Int. J. Imaging Syst. Technol..

[8]  Helge Ritter,et al.  Using a cVEP-Based Brain-Computer Interface to Control a Virtual Agent , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[9]  Peter Desain,et al.  Broad-Band Visually Evoked Potentials: Re(con)volution in Brain-Computer Interfacing , 2015, PloS one.

[10]  Anil K. Jain,et al.  Deformable template models: A review , 1998, Signal Process..

[11]  N Birbaumer,et al.  A binary spelling interface with random errors. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[12]  Benjamin Wittevrongel,et al.  Code-modulated visual evoked potentials using fast stimulus presentation and spatiotemporal beamformer decoding , 2017, Scientific Reports.

[13]  Yeung Sam Hung,et al.  An automated and fast approach to detect single-trial visual evoked potentials with application to brain–computer interface , 2014, Clinical Neurophysiology.

[14]  Xiaorong Gao,et al.  Frequency and Phase Mixed Coding in SSVEP-Based Brain--Computer Interface , 2011, IEEE Transactions on Biomedical Engineering.

[15]  Yijun Wang,et al.  A Novel c-VEP BCI Paradigm for Increasing the Number of Stimulus Targets Based on Grouping Modulation With Different Codes , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  Yijun Wang,et al.  A high-speed BCI based on code modulation VEP , 2011, Journal of neural engineering.

[17]  Yijun Wang,et al.  VEP-based brain-computer interfaces: time, frequency, and code modulations [Research Frontier] , 2009, IEEE Computational Intelligence Magazine.

[18]  Xiaorong Gao,et al.  An online multi-channel SSVEP-based brain–computer interface using a canonical correlation analysis method , 2009, Journal of neural engineering.

[19]  Brahim Belhaouari Samir,et al.  Fast Template Matching Method Based on Optimized Metrics for Face Localization , 2012 .

[20]  Marcel J. E. Golay,et al.  Complementary series , 1961, IRE Trans. Inf. Theory.

[21]  S. Coyle,et al.  Brain–computer interfaces: a review , 2003 .

[22]  G. Pfurtscheller,et al.  The BCI competition III: validating alternative approaches to actual BCI problems , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  Jacques Wolfmann,et al.  Almost perfect autocorrelation sequences , 1992, IEEE Trans. Inf. Theory.

[24]  Tzyy-Ping Jung,et al.  A Brain–Computer Interface Based on Miniature-Event-Related Potentials Induced by Very Small Lateral Visual Stimuli , 2018, IEEE Transactions on Biomedical Engineering.

[25]  Wolfgang Rosenstiel,et al.  Online Adaptation of a c-VEP Brain-Computer Interface(BCI) Based on Error-Related Potentials and Unsupervised Learning , 2012, PloS one.

[26]  Peijun Du,et al.  Semi-supervised dimensionality reduction using orthogonal projection divergence-based clustering for hyperspectral imagery , 2012 .

[27]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[28]  G. Pfurtscheller,et al.  An SSVEP BCI to Control a Hand Orthosis for Persons With Tetraplegia , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[29]  Rehab Bahauldeen Ashary.  Brain Computer Interface for Communication and Control , 2008 .

[30]  H. Knutsson,et al.  Detection of neural activity in functional MRI using canonical correlation analysis , 2001, Magnetic resonance in medicine.

[31]  Dean J Krusienski,et al.  Spatial decoupling of targets and flashing stimuli for visual brain-computer interfaces. , 2015, Journal of neural engineering.

[32]  Gian Domenico Iannetti,et al.  A novel approach to predict subjective pain perception from single-trial laser-evoked potentials , 2013, NeuroImage.

[33]  Yijun Wang,et al.  Visual and Auditory Brain–Computer Interfaces , 2014, IEEE Transactions on Biomedical Engineering.

[34]  Wei Wu,et al.  Frequency recognition based on canonical correlation analysis for SSVEP-based BCIs , 2007, IEEE Transactions on Biomedical Engineering.

[35]  Bin He,et al.  Exploring Cognitive Flexibility With a Noninvasive BCI Using Simultaneous Steady-State Visual Evoked Potentials and Sensorimotor Rhythms , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  Ross Cunnington,et al.  Stimulus specificity of a steady-state visual-evoked potential-based brain–computer interface , 2012, Journal of neural engineering.

[37]  Bin He,et al.  Noninvasive Electroencephalogram Based Control of a Robotic Arm for Reach and Grasp Tasks , 2016, Scientific Reports.

[38]  Dong Ming,et al.  Incorporation of dynamic stopping strategy into the high-speed SSVEP-based BCIs , 2018, Journal of neural engineering.

[39]  D. Yao,et al.  Multiple Frequencies Sequential Coding for SSVEP-Based Brain-Computer Interface , 2012, PloS one.