Eliciting dual-frequency SSVEP using a hybrid SSVEP-P300 BCI

BACKGROUND Steady-state visual-evoked potential (SSVEP)-based brain-computer interfaces (BCIs) generate weak SSVEP with a monitor and cannot use harmonic frequencies, whereas P300-based BCIs need multiple stimulation sequences. These issues can decrease the information transfer rate (ITR). NEW METHOD In this paper, we introduce a novel hybrid SSVEP-P300 speller that generates dual-frequency SSVEP, allowing it to overcome the abovementioned limitations and improve the performance. The hybrid speller consists of nine panels flickering at different frequencies. Each panel contains four different characters that appear in a random sequence. The flickering panel and the periodically updating character evoke the dual-frequency SSVEP, while the oddball stimulus of the target character evokes the P300. A canonical correlation analysis (CCA) and a step-wise linear discriminant analysis (SWLDA) classified SSVEP and P300, respectively. Ten subjects participated in offline and online experiments, in which accuracy and ITR were compared with those of conventional SSVEP and P300 spellers. RESULTS The offline analysis revealed not only the P300 potential but also SSVEP with peaks at sub-harmonic frequencies, demonstrating that the proposed speller elicited dual-frequency SSVEP. This dual-frequency stimulation improved SSVEP recognition, increased the number of targets by employing harmonic frequencies, reduced the stimulation time for P300, and consequently improved ITR as compared to the conventional spellers. COMPARISON WITH EXISTING METHODS The new method reduces the stimulation time and allows harmonic frequencies to be employed for different stimuli. CONCLUSIONS The results indicate that this study provides a promising approach to make the BCI speller more reliable and efficient.

[1]  Yang Yu,et al.  A Dynamically Optimized SSVEP Brain–Computer Interface (BCI) Speller , 2015, IEEE Transactions on Biomedical Engineering.

[2]  A. Kübler,et al.  Motivation modulates the P300 amplitude during brain–computer interface use , 2010, Clinical Neurophysiology.

[3]  E. W. Sellers,et al.  Toward enhanced P300 speller performance , 2008, Journal of Neuroscience Methods.

[4]  J. Wolpaw,et al.  Brain-computer communication: unlocking the locked in. , 2001, Psychological bulletin.

[5]  Peng Yuan,et al.  A study of the existing problems of estimating the information transfer rate in online brain–computer interfaces , 2013, Journal of neural engineering.

[6]  Yuanqing Li,et al.  A Hybrid BCI System Combining P300 and SSVEP and Its Application to Wheelchair Control , 2013, IEEE Transactions on Biomedical Engineering.

[7]  Xiaorong Gao,et al.  An online multi-channel SSVEP-based brain–computer interface using a canonical correlation analysis method , 2009, Journal of neural engineering.

[8]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[9]  Kwang Suk Park,et al.  An amplitude-modulated visual stimulation for reducing eye fatigue in SSVEP-based brain–computer interfaces , 2014, Clinical Neurophysiology.

[10]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[11]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[12]  Shangkai Gao,et al.  A practical VEP-based brain-computer interface. , 2006, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[13]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[14]  A Z Snyder,et al.  Steady-state vibration evoked potentials: descriptions of technique and characterization of responses. , 1992, Electroencephalography and clinical neurophysiology.

[15]  J. Polich Neuropsychology of P300 , 2011 .

[16]  M Ramasubba Reddy,et al.  A novel multiple frequency stimulation method for steady state VEP based brain computer interfaces , 2006, Physiological measurement.

[17]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[18]  C. Herrmann Human EEG responses to 1–100 Hz flicker: resonance phenomena in visual cortex and their potential correlation to cognitive phenomena , 2001, Experimental Brain Research.

[19]  Fanglin Chen,et al.  A Speedy Hybrid BCI Spelling Approach Combining P300 and SSVEP , 2014, IEEE Transactions on Biomedical Engineering.

[20]  Ole Jensen,et al.  Oxford handbook of event-related potential components. , 2011 .

[21]  A. Cichocki,et al.  Steady-state visually evoked potentials: Focus on essential paradigms and future perspectives , 2010, Progress in Neurobiology.

[22]  J. Millán,et al.  Detection of self-paced reaching movement intention from EEG signals , 2012, Front. Neuroeng..

[23]  Ivan Volosyak,et al.  Optimal visual stimuli on LCD screens for SSVEP based brain-computer interfaces , 2009, 2009 4th International IEEE/EMBS Conference on Neural Engineering.

[24]  M. Hallett,et al.  Classifying EEG signals preceding right hand, left hand, tongue, and right foot movements and motor imageries , 2008, Clinical Neurophysiology.

[25]  Dong Ming,et al.  A hybrid BCI speller paradigm combining P300 potential and the SSVEP blocking feature , 2013, Journal of neural engineering.

[26]  Fanglin Chen,et al.  A novel hybrid BCI speller based on the incorporation of SSVEP into the P300 paradigm , 2013, Journal of neural engineering.

[27]  Po-Lei Lee,et al.  Dual-frequency steady-state visual evoked potential for brain computer interface , 2010, Neuroscience Letters.

[28]  Xiaorong Gao,et al.  A high-ITR SSVEP-based BCI speller , 2014 .

[29]  Long Chen,et al.  A visual parallel-BCI speller based on the time–frequency coding strategy , 2014, Journal of neural engineering.

[30]  Chang S. Nam,et al.  Effects of Luminosity Contrast and Stimulus Duration on User Performance and Preference in a P300-Based Brain–Computer Interface , 2014, Int. J. Hum. Comput. Interact..

[31]  Dezhong Yao,et al.  Stimulator selection in SSVEP-based BCI. , 2008, Medical engineering & physics.

[32]  Chang-Hwan Im,et al.  A new dual-frequency stimulation method to increase the number of visual stimuli for multi-class SSVEP-based brain–computer interface (BCI) , 2013, Brain Research.

[33]  Kwang Suk Park,et al.  Frequency recognition methods for dual-frequency SSVEP based brain-computer interface , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[34]  J. Wolpaw,et al.  A P300 event-related potential brain–computer interface (BCI): The effects of matrix size and inter stimulus interval on performance , 2006, Biological Psychology.