An optimized facial stimuli paradigm for hybrid SSVEP+P300 brain computer interface

Abstract In this paper, hybrid BCI that merges Event Related Potentials (P300) and Steady State visual Evoked Potentials (SSVEP) simultaneously is proposed to enhance the performance of Four-choice command system. Here we integrate human facial structure in external visual stimulus to evoke stronger cortical responses in hybrid SSVEP+P300 BCI & compare it with non-face stimuli. We also addressed question of feasibility of eliciting one potential by face & other by non-face stimuli. To evoke SSVEP & P300 responses, paradigms with non-face stimuli, neutral face stimuli, and facial expression changes stimuli are proposed. We also projected additional paradigm where SSVEP is elicited by non-face and P300 by flashing different facial expressions. Results proved the last paradigm evoke stronger cortical potentials and thereby improve system accuracy and ITR than other paradigms. Author discussed external stimulus parameters that might affect simultaneous evocation of multiple brain potentials and their deterioration effect on individual potentials.

[1]  Xingyu Wang,et al.  A new hybrid BCI paradigm based on P300 and SSVEP , 2015, Journal of Neuroscience Methods.

[2]  Jaime Gómez Gil,et al.  Brain Computer Interfaces, a Review , 2012, Sensors.

[3]  D. Tanner,et al.  A strong wink between verbal and emoji-based irony: How the brain processes ironic emojis during language comprehension , 2018, PloS one.

[4]  Eric W. Sellers,et al.  P300 brain-computer interface: comparing faces to size matched non-face stimuli , 2018 .

[5]  Piotr Milanowski,et al.  Towards an Optimization of Stimulus Parameters for Brain-Computer Interfaces Based on Steady State Visual Evoked Potentials , 2014, PloS one.

[6]  Bruno Rossion,et al.  A steady-state visual evoked potential approach to individual face perception: Effect of inversion, contrast-reversal and temporal dynamics , 2012, NeuroImage.

[7]  Andrzej Cichocki,et al.  Emotional faces boost up steady-state visual responsesforbrain–computer interface , 2011, Neuroreport.

[8]  Wenwei Yu,et al.  Influence of Stimulus Color on Steady State Visual Evoked Potentials , 2016, IAS.

[9]  Teodiano Bastos,et al.  Comparison of the influence of stimuli color on Steady-State Visual Evoked Potentials , 2015 .

[10]  Brendan Z. Allison,et al.  A four-choice hybrid P300/SSVEP BCI for improved accuracy , 2014 .

[11]  G. Kovács,et al.  The face evoked steady-state visual potentials are sensitive to the orientation, viewpoint, expression and configuration of the stimuli. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[12]  A. Kübler,et al.  Flashing characters with famous faces improves ERP-based brain–computer interface performance , 2011, Journal of neural engineering.

[13]  Rajesh Singla.  HYBRID BRAIN–COMPUTER INTERFACE PARADIGM — A STUDY , 2018 .

[14]  Yili Liu,et al.  A speed and direction-based cursor control system with P300 and SSVEP , 2014, Biomed. Signal Process. Control..

[15]  Felipe Alberto Capati,et al.  Hybrid SSVEP/P300 BCI Keyboard - Controlled by Visual Evoked Potential , 2016, BIOSIGNALS.

[16]  Fanglin Chen,et al.  A Speedy Hybrid BCI Spelling Approach Combining P300 and SSVEP , 2014, IEEE Transactions on Biomedical Engineering.

[17]  Ying Sun,et al.  Asynchronous P300 BCI: SSVEP-based control state detection , 2010, 2010 18th European Signal Processing Conference.

[18]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[19]  Andreas Keil,et al.  Face-Evoked Steady-State Visual Potentials: Effects of Presentation Rate and Face Inversion , 2012, Front. Hum. Neurosci..

[20]  A. Cichocki,et al.  An optimized ERP brain–computer interface based on facial expression changes , 2014, Journal of neural engineering.

[21]  A. Cichocki,et al.  The Changing Face of P300 BCIs: A Comparison of Stimulus Changes in a P300 BCI Involving Faces, Emotion, and Movement , 2012, PloS one.

[22]  B. Rossion,et al.  Robust sensitivity to facial identity in the right human occipito-temporal cortex as revealed by steady-state visual-evoked potentials. , 2011, Journal of vision.

[23]  Yuanqing Li,et al.  A Hybrid BCI System Combining P300 and SSVEP and Its Application to Wheelchair Control , 2013, IEEE Transactions on Biomedical Engineering.

[24]  Aboul Ella Hassanien,et al.  Brain Computer Interface: A Review , 2015, Brain-Computer Interfaces.