A high performance hybrid SSVEP based BCI speller system

Abstract The existing EEG based keyboard/speller systems have a tradeoff between the target detection time and classification accuracy. This study focuses on increasing the accuracy and probability of target classification rates in the SSVEP based speller system. We proposed two different types of hybrid SSVEP system by combining SSVEP with vision based eye gaze tracker (VET) and electro-oculogram (EOG). Thirty six targets were randomly chosen for this study and their corresponding visual stimulus was presented with unique frequencies. The visual stimuli were segregated into three groups and each group were arranged into different regions (left/middle/right) of the keyboard/speller layout for improving the probability of target detection rate. The VET/ EOG data were utilized to identify the regions that belong to the selected target. The region/group determination decreases the issue of misclassification of SSVEP frequencies. The averaged spelling accuracies of SSVEP-VET and SSVEP-EOG system for all the subjects is 91.2% and 91.39% respectively. Later, a visual feedback was added to the SSVEP-EOG system (SSVEP-EOG-VF) for improving the target detection rate. In this case, an average classification accuracy of 98.33% was obtained with the information transfer rate (ITR) of 69.21 bits/min for all the subjects. An accuracy of 100% was obtained for five subjects with the ITR of 74.1 bits/min in this system.

[1]  Xiaorong Gao,et al.  Frequency and Phase Mixed Coding in SSVEP-Based Brain--Computer Interface , 2011, IEEE Transactions on Biomedical Engineering.

[2]  M Ramasubba Reddy,et al.  A novel multiple frequency stimulation method for steady state VEP based brain computer interfaces , 2006, Physiological measurement.

[3]  G. Pfurtscheller,et al.  EEG-based neuroprosthesis control: A step towards clinical practice , 2005, Neuroscience Letters.

[4]  Chang-Hwan Im,et al.  evelopment of a hybrid mental spelling system combining SVEP-based brain – computer interface and webcam-based eye racking , 2015 .

[5]  Yuanqing Li,et al.  A Single-Channel EOG-Based Speller , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  A. Engel,et al.  An independent brain–computer interface using covert non-spatial visual selective attention , 2010, Journal of neural engineering.

[7]  G Pfurtscheller,et al.  EEG-based communication: improved accuracy by response verification. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[8]  Yuanqing Li,et al.  A Hybrid BCI System Combining P300 and SSVEP and Its Application to Wheelchair Control , 2013, IEEE Transactions on Biomedical Engineering.

[9]  Fanglin Chen,et al.  A novel hybrid BCI speller based on the incorporation of SSVEP into the P300 paradigm , 2013, Journal of neural engineering.

[10]  Fanglin Chen,et al.  A Speedy Hybrid BCI Spelling Approach Combining P300 and SSVEP , 2014, IEEE Transactions on Biomedical Engineering.

[11]  Yangsong Zhang,et al.  Robust frequency recognition for SSVEP-based BCI with temporally local multivariate synchronization index , 2016, Cognitive Neurodynamics.

[12]  John Williamson,et al.  A High Performance Spelling System based on EEG-EOG Signals With Visual Feedback , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  A. Cichocki,et al.  Optimization of SSVEP brain responses with application to eight-command Brain–Computer Interface , 2010, Neuroscience Letters.

[14]  Yangsong Zhang,et al.  Multivariate synchronization index for frequency recognition of SSVEP-based brain–computer interface , 2014, Journal of Neuroscience Methods.

[15]  Xiaorong Gao,et al.  A high-ITR SSVEP-based BCI speller , 2014 .

[16]  Yangsong Zhang,et al.  The extension of multivariate synchronization index method for SSVEP-based BCI , 2017, Neurocomputing.

[17]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[18]  Xingyu Wang,et al.  A new hybrid BCI paradigm based on P300 and SSVEP , 2015, Journal of Neuroscience Methods.

[19]  Arne Robben,et al.  Sampled sinusoidal stimulation profile and multichannel fuzzy logic classification for monitor-based phase-coded SSVEP brain–computer interfacing , 2013, Journal of neural engineering.

[20]  Tzyy-Ping Jung,et al.  High-speed spelling with a noninvasive brain–computer interface , 2015, Proceedings of the National Academy of Sciences.

[21]  Xia Wang,et al.  A SSVEP Stimuli Encoding Method Using Trinary Frequency-Shift Keying Encoded SSVEP (TFSK-SSVEP) , 2017, Frontiers in human neuroscience.

[22]  Chang-Hwan Im,et al.  A new dual-frequency stimulation method to increase the number of visual stimuli for multi-class SSVEP-based brain–computer interface (BCI) , 2013, Brain Research.

[23]  B.Z. Allison,et al.  ERPs evoked by different matrix sizes: implications for a brain computer interface (BCI) system , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Babiloni Fabio Brain Computer Interfaces for communication and control , 1900 .

[25]  Kwang Suk Park,et al.  Eliciting dual-frequency SSVEP using a hybrid SSVEP-P300 BCI , 2016, Journal of Neuroscience Methods.