An electrocorticographic BCI using code-based VEP for control in video applications: a single-subject study

A brain-computer-interface (BCI) allows the user to control a device or software with brain activity. Many BCIs rely on visual stimuli with constant stimulation cycles that elicit steady-state visual evoked potentials (SSVEP) in the electroencephalogram (EEG). This EEG response can be generated with a LED or a computer screen flashing at a constant frequency, and similar EEG activity can be elicited with pseudo-random stimulation sequences on a screen (code-based BCI). Using electrocorticography (ECoG) instead of EEG promises higher spatial and temporal resolution and leads to more dominant evoked potentials due to visual stimulation. This work is focused on BCIs based on visual evoked potentials (VEP) and its capability as a continuous control interface for augmentation of video applications. One 35 year old female subject with implanted subdural grids participated in the study. The task was to select one out of four visual targets, while each was flickering with a code sequence. After a calibration run including 200 code sequences, a linear classifier was used during an evaluation run to identify the selected visual target based on the generated code-based VEPs over 20 trials. Multiple ECoG buffer lengths were tested and the subject reached a mean online classification accuracy of 99.21% for a window length of 3.15 s. Finally, the subject performed an unsupervised free run in combination with visual feedback of the current selection. Additionally, an algorithm was implemented that allowed to suppress false positive selections and this allowed the subject to start and stop the BCI at any time. The code-based BCI system attained very high online accuracy, which makes this approach very promising for control applications where a continuous control signal is needed.

[1]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[2]  Dieter Schmalstieg,et al.  An Application Framework for Controlling an Avatar in a Desktop-Based Virtual Environment via a Software SSVEP BrainComputer Interface , 2010, PRESENCE: Teleoperators and Virtual Environments.

[3]  Wolfgang Rosenstiel,et al.  Online Adaptation of a c-VEP Brain-Computer Interface(BCI) Based on Error-Related Potentials and Unsupervised Learning , 2012, PloS one.

[4]  N. Zierler.  Linear Recurring Sequences , 1959 .

[5]  H. Yokoi,et al.  Electrocorticographic control of a prosthetic arm in paralyzed patients , 2012, Annals of neurology.

[6]  Brendan Z. Allison,et al.  How Many People Could Use an SSVEP BCI? , 2012, Front. Neurosci..

[7]  Erich E. Sutter,et al.  The brain response interface: communication through visually-induced electrical brain responses , 1992 .

[8]  E. Sellers,et al.  How many people are able to control a P300-based brain–computer interface (BCI)? , 2009, Neuroscience Letters.

[9]  Stefan Haufe,et al.  The Berlin Brain–Computer Interface: Non-Medical Uses of BCI Technology , 2010, Front. Neurosci..

[10]  G. Pfurtscheller,et al.  Critical Decision-Speed and Information Transfer in the “Graz Brain–Computer Interface” , 2003, Applied psychophysiology and biofeedback.

[11]  Yijun Wang,et al.  A high-speed BCI based on code modulation VEP , 2011, Journal of neural engineering.

[12]  Yijun Wang,et al.  VEP-based brain-computer interfaces: time, frequency, and code modulations [Research Frontier] , 2009, IEEE Computational Intelligence Magazine.

[13]  J. Wolpaw,et al.  A P300 event-related potential brain–computer interface (BCI): The effects of matrix size and inter stimulus interval on performance , 2006, Biological Psychology.

[14]  John R. Smith,et al.  Steady-State VEP-Based Brain-Computer Interface Control in an Immersive 3D Gaming Environment , 2005, EURASIP J. Adv. Signal Process..

[15]  Wolfgang Grodd,et al.  Principles of a brain-computer interface (BCI) based on real-time functional magnetic resonance imaging (fMRI) , 2004, IEEE Transactions on Biomedical Engineering.

[16]  Christoph Guger,et al.  A BCI using VEP for continuous control of a mobile robot , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[17]  Karla Felix Navarro,et al.  A Comprehensive Survey of Brain Interface Technology Designs , 2007, Annals of Biomedical Engineering.

[18]  Rajesh P. N. Rao,et al.  Cortical activity during motor execution, motor imagery, and imagery-based online feedback , 2010, Proceedings of the National Academy of Sciences.

[19]  G. Pfurtscheller,et al.  How many people are able to operate an EEG-based brain-computer interface (BCI)? , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Andrzej Cichocki,et al.  Fully Online Multicommand Brain-Computer Interface with Visual Neurofeedback Using SSVEP Paradigm , 2007, Comput. Intell. Neurosci..

[21]  Gerwin Schalk,et al.  Rapid Communication with a “P300” Matrix Speller Using Electrocorticographic Signals (ECoG) , 2010, Front. Neurosci..

[22]  Ivan Volosyak,et al.  SSVEP-based Bremen–BCI interface—boosting information transfer rates , 2011, Journal of neural engineering.

[23]  B.Z. Allison,et al.  ERPs evoked by different matrix sizes: implications for a brain computer interface (BCI) system , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Shirley Coyle,et al.  On the suitability of near-infrared (NIR) systems for next-generation brain-computer interfaces. , 2004, Physiological measurement.

[25]  Robin C. Ashmore,et al.  An Electrocorticographic Brain Interface in an Individual with Tetraplegia , 2013, PloS one.

[26]  G. Pfurtscheller,et al.  Designing optimal spatial filters for single-trial EEG classification in a movement task , 1999, Clinical Neurophysiology.

[27]  G Pfurtscheller,et al.  Real-time EEG analysis with subject-specific spatial patterns for a brain-computer interface (BCI). , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[28]  Yijun Wang,et al.  Brain-Computer Interfaces Based on Visual Evoked Potentials , 2008, IEEE Engineering in Medicine and Biology Magazine.

[29]  Gert Pfurtscheller,et al.  Distinction Sensitive Learning Vector Quantization (DSLVQ) application as a classifier based feature selection method for a Brain Computer Interface , 1995 .

[30]  Rajesh P. N. Rao,et al.  Correction for Miller et al., Cortical activity during motor execution, motor imagery, and imagery-based online feedback , 2010, Proceedings of the National Academy of Sciences.

[31]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[32]  Hu Chuan-Gan,et al.  On The Shift Register Sequences , 2004 .

[33]  Gerwin Schalk,et al.  A brain–computer interface using electrocorticographic signals in humans , 2004, Journal of neural engineering.

[34]  J. A. Wilson,et al.  Two-dimensional movement control using electrocorticographic signals in humans , 2008, Journal of neural engineering.

[35]  Abderrahmane Kheddar,et al.  Steering a robot with a brain-computer interface: Impact of video feedback on BCI performance , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.