The Validity of Steady-State Visual Evoked Potentials as Attention Tags and Input Signals: A Critical Perspective of Frequency Allocation and Number of Stimuli

Steady-state visual evoked potential (SSVEP) is a periodic response to a repetitive visual stimulus at a specific frequency. Currently, SSVEP is widely treated as an attention tag in cognitive activities and is used as an input signal for brain–computer interfaces (BCIs). However, whether SSVEP can be used as a reliable indicator has been a controversial issue. We focused on the independence of SSVEP from frequency allocation and number of stimuli. First, a cue–target paradigm was adopted to examine the interaction between SSVEPs evoked by two stimuli with different frequency allocations under different attention conditions. Second, we explored whether signal strength and the performance of SSVEP-based BCIs were affected by the number of stimuli. The results revealed that no significant interaction of SSVEP responses appeared between attended and unattended stimuli under various frequency allocations, regardless of their appearance in the fundamental or second-order harmonic. The amplitude of SSVEP suffered no significant gain or loss under different numbers of stimuli, but the performance of SSVEP-based BCIs varied along with duration of stimuli; that is, the recognition rate was not affected by the number of stimuli when the duration of stimuli was long enough, while the information transfer rate (ITR) presented the opposite trend. It can be concluded that SSVEP is a reliable tool for marking and monitoring multiple stimuli simultaneously in cognitive studies, but much caution should be taken when choosing a suitable duration and the number of stimuli, in order to achieve optimal utility of BCIs in the future.

[1]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[2]  Susan J Leat,et al.  The technique, validity and clinical use of the sweep VEP , 2008, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[3]  Xu Han,et al.  A novel system of SSVEP-based human–robot coordination , 2018, Journal of neural engineering.

[4]  Justin M. Ales,et al.  The steady-state visual evoked potential in vision research: A review. , 2015, Journal of vision.

[5]  Jean-François Delvenne,et al.  Splitting attention across the two visual fields in visual short-term memory , 2012, Cognition.

[6]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[7]  Gennadiy Gurariy,et al.  The steady-state visual evoked potential reveals neural correlates of the items encoded into visual working memory , 2014, Neuropsychologia.

[8]  Ramesh Srinivasan,et al.  MEG phase follows conscious perception during binocular rivalry induced by visual stream segregation. , 2006, Cerebral cortex.

[9]  Chang-Hwan Im,et al.  A new dual-frequency stimulation method to increase the number of visual stimuli for multi-class SSVEP-based brain–computer interface (BCI) , 2013, Brain Research.

[10]  Naotsugu Tsuchiya,et al.  From intermodulation components to visual perception and cognition-a review , 2019, NeuroImage.

[11]  Faraz Farzin,et al.  Piecing it together: infants' neural responses to face and object structure. , 2012, Journal of vision.

[12]  Alexander M. Dreyer,et al.  Tradeoff between User Experience and BCI Classification Accuracy with Frequency Modulated Steady-State Visual Evoked Potentials , 2017, Front. Hum. Neurosci..

[13]  Xiaorong Gao,et al.  An online multi-channel SSVEP-based brain–computer interface using a canonical correlation analysis method , 2009, Journal of neural engineering.

[14]  Talia L. Retter,et al.  Visual adaptation provides objective electrophysiological evidence of facial identity discrimination , 2016, Cortex.

[15]  Kazumichi Matsumiya,et al.  Time Courses of Attentional Modulation in Neural Amplification and Synchronization Measured with Steady-state Visual-evoked Potentials , 2012, Journal of Cognitive Neuroscience.

[16]  C. Herrmann Human EEG responses to 1–100 Hz flicker: resonance phenomena in visual cortex and their potential correlation to cognitive phenomena , 2001, Experimental Brain Research.

[17]  Michael X. Cohen,et al.  Individual Alpha Peak Frequency Predicts 10 Hz Flicker Effects on Selective Attention , 2017, The Journal of Neuroscience.

[18]  Andreas Keil,et al.  Steady-state visual evoked potentials as a research tool in social affective neuroscience. , 2016, Psychophysiology.

[19]  James J S Norton,et al.  The elicitation of steady-state visual evoked potentials during sleep. , 2017, Psychophysiology.

[20]  A. Cichocki,et al.  Steady-state visually evoked potentials: Focus on essential paradigms and future perspectives , 2010, Progress in Neurobiology.

[21]  Andreas Keil,et al.  What does the dot-probe task measure? A reverse correlation analysis of electrocortical activity. , 2018, Psychophysiology.

[22]  Tzyy-Ping Jung,et al.  High-speed spelling with a noninvasive brain–computer interface , 2015, Proceedings of the National Academy of Sciences.

[23]  A. Norcia,et al.  Dissociation of part‐based and integrated neural responses to faces by means of electroencephalographic frequency tagging , 2014, The European journal of neuroscience.

[24]  R. Srinivasan,et al.  Nonlinear SSVEP responses are sensitive to the perceptual binding of visual hemifields during conventional ‘eye’ rivalry and interocular ‘percept’ rivalry , 2009, Brain Research.

[25]  D. Regan Steady-state evoked potentials. , 1977, Journal of the Optical Society of America.

[26]  Chang-Hwan Im,et al.  Development of an SSVEP-based BCI spelling system adopting a QWERTY-style LED keyboard , 2012, Journal of Neuroscience Methods.

[27]  Jürgen Kurths,et al.  Modification of Brain Oscillations via Rhythmic Light Stimulation Provides Evidence for Entrainment but Not for Superposition of Event-Related Responses , 2016, Front. Hum. Neurosci..

[28]  Matthias M Müller,et al.  Attentional Bias to Briefly Presented Emotional Distractors Follows a Slow Time Course in Visual Cortex , 2011, The Journal of Neuroscience.

[29]  J. Gross,et al.  Steady-State Visual Evoked Potentials Can Be Explained by Temporal Superposition of Transient Event-Related Responses , 2011, PloS one.

[30]  Viola S. Störmer,et al.  Feature-Based Attention Elicits Surround Suppression in Feature Space , 2014, Current Biology.

[31]  S. Hillyard,et al.  Combining steady‐state visual evoked potentials and f MRI to localize brain activity during selective attention , 1997, Human brain mapping.

[32]  Piotr Stawicki,et al.  Exploring the possibilities and limitations of multitarget SSVEP-based BCI applications , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[33]  Alexander Kaplan,et al.  Adapting the P300-Based Brain–Computer Interface for Gaming: A Review , 2013, IEEE Transactions on Computational Intelligence and AI in Games.

[34]  Emily D Grossman,et al.  Feature-based attentional tuning during biological motion detection measured with SSVEP. , 2017, Journal of vision.

[35]  Chang-Hwan Im,et al.  An emergency call system for patients in locked-in state using an SSVEP-based brain switch. , 2017, Psychophysiology.

[36]  Niels Birbaumer,et al.  A 20-Questions-Based Binary Spelling Interface for Communication Systems , 2018, Brain sciences.

[37]  Wei Wu,et al.  Frequency recognition based on canonical correlation analysis for SSVEP-based BCIs , 2007, IEEE Transactions on Biomedical Engineering.

[38]  Tzyy-Ping Jung,et al.  A High-Speed Brain Speller using steady-State Visual evoked potentials , 2014, Int. J. Neural Syst..

[39]  Steven A. Hillyard,et al.  Global Facilitation of Attended Features Is Obligatory and Restricts Divided Attention , 2013, The Journal of Neuroscience.

[40]  Nihan Alp,et al.  EEG frequency tagging dissociates between neural processing of motion synchrony and human quality of multiple point-light dancers , 2017, Scientific Reports.

[41]  Piotr Stawicki,et al.  Suitable Number of Visual Stimuli for SSVEP-Based BCI Spelling Applications , 2017, IWANN.

[42]  Matthias M. Müller,et al.  The neural signature of extracting emotional content from rapid visual streams at multiple presentation rates: A cross-laboratory study. , 2018, Psychophysiology.

[43]  Bruno Rossion,et al.  At a Single Glance: Fast Periodic Visual Stimulation Uncovers the Spatio-Temporal Dynamics of Brief Facial Expression Changes in the Human Brain , 2016, Cerebral cortex.

[44]  Nika Adamian,et al.  Top–Down Attention Is Limited Within but Not Between Feature Dimensions , 2019, Journal of Cognitive Neuroscience.

[45]  David S. Leland,et al.  Overt and Covert Attention in Infants Revealed Using Steady-State Visually Evoked Potentials , 2017, Developmental psychology.

[46]  Yao Dezhong THE INTERACTION BETWEEN THE NEURAL-NETWORKS FOR DIFFERENT FREQUENCY STEADY-STATE VISUAL EVOKED POTENTIAL , 2007 .

[47]  Jonathan W. Peirce,et al.  PsychoPy—Psychophysics software in Python , 2007, Journal of Neuroscience Methods.