Single-trial classification of neural responses evoked in rapid serial visual presentation: Effects of stimulus onset asynchrony and stimulus repetition

Rapid serial visual presentation (RSVP) tasks, in which participants are presented with a continuous sequence of images in one location, have been used in combination with electroencephalography (EEG) in a variety of Brain-Machine Interface (BMI) applications. The RSVP task is advantageous because it can be performed at a high temporal rate. The rate of the RSVP sequence is controlled by the stimulus onset asynchrony (SOA) between subsequent stimuli. When used within the context of a BMI, an RSVP task with short SOA could increase the information throughput of the system while also allowing for stimulus repetitions. However, reducing the SOA also increases the perceptual degradation caused by presenting two stimuli in close succession, and it decreases the target-to-target interval (TTI), which can increase the cognitive demands of the task. These negative consequences of decreasing the SOA could affect on the EEG signal measured in the task and degrade the performance of the BMI. Here we systematically investigate the effects of SOA and stimulus repetition (r) on single-trial target detection in an RSVP task. Ten healthy volunteers participated in an RSVP task in four conditions that varied in SOA and repetitions (SOA=500 ms, r=1; SOA=250 ms, r=2; SOA=166 ms, r=3; and SOA=100 ms, r=5) while processing time across conditions was controlled. There were two key results: First, when controlling for the number of repetitions, single-trial performance increases when the SOA decreases. Second, when the repetitions were combined, the best performance (AUC=0.967) was obtained with the shortest SOA (100 ms). These results suggest that shortening the SOA in an RSVP task has the benefit of increasing the performance relative to longer SOAs, and it also allows a higher number of repetitions of the stimuli in a limited amount of time.

[1]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[2]  W. Prinzmetal,et al.  Voluntary and involuntary attention have different consequences: The effect of perceptual difficulty , 2009, Quarterly journal of experimental psychology.

[3]  Guillaume Gibert,et al.  xDAWN Algorithm to Enhance Evoked Potentials: Application to Brain–Computer Interface , 2009, IEEE Transactions on Biomedical Engineering.

[4]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[5]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[6]  C. Buss,et al.  Children's Brain Development Benefits from Longer Gestation , 2011, Front. Psychology.

[7]  J. Touryan,et al.  Real-Time Measurement of Face Recognition in Rapid Serial Visual Presentation , 2011, Front. Psychology.

[8]  O Bertrand,et al.  A robust sensor-selection method for P300 brain–computer interfaces , 2011, Journal of neural engineering.

[9]  Miguel P. Eckstein,et al.  Effects of performing two visual tasks on single-trial detection of event-related potentials , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  N. Bigdely-Shamlo,et al.  Brain Activity-Based Image Classification From Rapid Serial Visual Presentation , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  Miguel P. Eckstein,et al.  Single-Trial Classification of Event-Related Potentials in Rapid Serial Visual Presentation Tasks Using Supervised Spatial Filtering , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[12]  C. Gonsalvez,et al.  Target-to-target interval versus probability effects on P300 in one- and two-tone tasks. , 2003, Psychophysiology.

[13]  Ki-Young Jung,et al.  Influence of task difficulty on the features of event-related potential during visual oddball task , 2008, Neuroscience Letters.

[14]  Shih-Fu Chang,et al.  Closing the loop in cortically-coupled computer vision: a brain–computer interface for searching image databases , 2011, Journal of neural engineering.

[15]  P. Sajda,et al.  Spatiotemporal Linear Decoding of Brain State , 2008, IEEE Signal Processing Magazine.

[16]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[17]  L. Parra,et al.  Ieee Signal Processing Magazine, Accepted for Publication, August 2007 Spatio-temporal Linear Decoding of Brain State: Application to Performance Augmentation in High-throughput Tasks , 2022 .

[18]  H. Lüders,et al.  American Electroencephalographic Society Guidelines for Standard Electrode Position Nomenclature , 1991, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[19]  P. Sajda,et al.  EEG-Informed fMRI Reveals Spatiotemporal Characteristics of Perceptual Decision Making , 2007, The Journal of Neuroscience.

[20]  N. Birbaumer,et al.  fMRI Brain-Computer Interfaces , 2008, IEEE Signal Processing Magazine.

[21]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.