An idle state-detecting method based on transient visual evoked potentials for an asynchronous ERP-based BCI

BACKGROUND An asynchronous brain-computer interface (BCI) allows subject to freely switch between the working state and the idle state, improving the subject's comfort. However, using only the event-related potential (ERP) to detect these two states is difficult because of the small amplitude of the ERP. METHOD Our previous study found that an odd-ball paradigm could evoke transient visual evoked potentials (TSVEPs) simultaneously with ERPs. This study adopts the TSVEP and the ERP to detect the idle state in the design of an asynchronous TSVEP-ERP-based BCI (T-E BCI). The T-E BCI extracts time and frequency features from brain signals and uses a novel probability-based fisher linear discriminant analysis (P-FLDA) to combine the classification results of the ERP and the TSVEP. RESULT Ten subjects performed visual speller and video watching experiments, and their brain signals were measured under the working and idle states. The main results show that the T-E BCI achieves a higher accuracy than the ERP-based BCI when judging the subject's intentions and the two states. The P-FLDA performs better than the FLDA in combining the classification results. CONCLUSIONS The study demonstrates that adding the TSVEP can substantially reduce the number of wrongly detected trials. The T-E BCI provides a new way of designing an asynchronous BCI without adding any additional visual stimuli, which makes the BCI more practical.

[1]  Feng Li,et al.  Discrimination Between Control and Idle States in Asynchronous SSVEP-Based Brain Switches: A Pseudo-Key-Based Approach , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[2]  Feng Duan,et al.  An Event-Related Potential-Based Adaptive Model for Telepresence Control of Humanoid Robot Motion in an Environment Cluttered With Obstacles , 2017, IEEE Transactions on Industrial Electronics.

[3]  Álvaro Fernández-Rodríguez,et al.  Evaluation of emotional and neutral pictures as flashing stimuli using a P300 brain–computer interface speller , 2019, Journal of neural engineering.

[4]  Feng Duan,et al.  Design of a Multimodal EEG-based Hybrid BCI System with Visual Servo Module , 2015, IEEE Transactions on Autonomous Mental Development.

[5]  J. Wolpaw,et al.  Clinical Applications of Brain-Computer Interfaces: Current State and Future Prospects , 2009, IEEE Reviews in Biomedical Engineering.

[6]  E. W. Sellers,et al.  Toward enhanced P300 speller performance , 2008, Journal of Neuroscience Methods.

[7]  G.E. Birch,et al.  Brain interface research for asynchronous control applications , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  Mohammad Bagher Shamsollahi,et al.  A novel dual and triple shifted RSVP paradigm for P300 speller , 2019, Journal of Neuroscience Methods.

[9]  Yuanqing Li,et al.  A Hybrid BCI System Combining P300 and SSVEP and Its Application to Wheelchair Control , 2013, IEEE Transactions on Biomedical Engineering.

[10]  W Speier,et al.  Integrating language models into classifiers for BCI communication: a review , 2016, Journal of neural engineering.

[11]  Tzyy-Ping Jung,et al.  A Brain–Computer Interface Based on Miniature-Event-Related Potentials Induced by Very Small Lateral Visual Stimuli , 2018, IEEE Transactions on Biomedical Engineering.

[12]  Swati Vaid,et al.  EEG Signal Analysis for BCI Interface: A Review , 2015, 2015 Fifth International Conference on Advanced Computing & Communication Technologies.

[13]  Andrzej Cichocki,et al.  Whether generic model works for rapid ERP-based BCI calibration , 2013, Journal of Neuroscience Methods.

[14]  Zhihua Wang,et al.  Self-Paced Operation of a Wheelchair Based on a Hybrid Brain-Computer Interface Combining Motor Imagery and P300 Potential , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  Ying Sun,et al.  Asynchronous P300 BCI: SSVEP-based control state detection , 2010, 2010 18th European Signal Processing Conference.

[16]  Jie Li,et al.  A hybrid brain computer interface system based on the neurophysiological protocol and brain-actuated switch for wheelchair control , 2014, Journal of Neuroscience Methods.

[17]  Tian Feng-chun Study of recognition algorithm based on transient visual evoked potential , 2012 .

[18]  Teodiano Freire Bastos Filho,et al.  Evaluating the Influence of Chromatic and Luminance Stimuli on SSVEPs from Behind-the-Ears and Occipital Areas , 2018, Sensors.

[19]  W. A. Sarnacki,et al.  Brain–computer interface (BCI) operation: optimizing information transfer rates , 2003, Biological Psychology.

[20]  Li Xin,et al.  A Virtual Chinese Keyboard BCI System Based on P300 Potentials , 2009 .

[21]  Andrzej Cichocki,et al.  The Study of Generic Model Set for Reducing Calibration Time in P300-Based Brain–Computer Interface , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Yijun Wang,et al.  Discriminative Canonical Pattern Matching for Single-Trial Classification of ERP Components , 2019, IEEE Transactions on Biomedical Engineering.

[23]  Jinjia Wang,et al.  [Research of controlling of smart home system based on P300 brain-computer interface]. , 2014, Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi.

[24]  Wu Bao-ming Realization of Real-Time Brain-Computer Interface System Based on Transient Visual Evoked Potential , 2010 .

[25]  Anirban Chowdhury,et al.  An EEG-EMG correlation-based brain-computer interface for hand orthosis supported neuro-rehabilitation , 2019, Journal of Neuroscience Methods.

[26]  Xin Pan,et al.  An Intention-Driven Semi-autonomous Intelligent Robotic System for Drinking , 2017, Front. Neurorobot..

[27]  Tao Geng,et al.  A 3-class Asynchronous BCI Controlling A Simulated Mobile Robot , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[28]  Urbano Nunes,et al.  Toward a reliable gaze-independent hybrid BCI combining visual and natural auditory stimuli , 2016, Journal of Neuroscience Methods.

[29]  Mahdi Shabany,et al.  Efficient Hardware Implementation of Real-Time Low-Power Movement Intention Detector System Using FFT and Adaptive Wavelet Transform , 2017, IEEE Transactions on Biomedical Circuits and Systems.

[30]  Peng Xu,et al.  The extraction of motion-onset VEP BCI features based on deep learning and compressed sensing , 2017, Journal of Neuroscience Methods.

[31]  Quan Liu,et al.  Multi-Channel SSVEP Pattern Recognition Based on MUSIC , 2014 .

[32]  David Zhang,et al.  Face recognition using FLDA with single training image per person , 2008, Appl. Math. Comput..

[33]  Sungho Jo,et al.  A novel hybrid auditory BCI paradigm combining ASSR and P300 , 2017, Journal of Neuroscience Methods.

[34]  Guizhi Xu,et al.  Transient visual evoked potential -based method of detecting idle brain state in the event-related potential-based brain-computer interface , 2019, 2019 Chinese Automation Congress (CAC).

[35]  Brice Rebsamen,et al.  A brain controlled wheelchair to navigate in familiar environments. , 2010, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.