Visual target detection in a distracting background relies on neural encoding of both visual targets and background

The ability to detect visual targets in complex background varies across individuals and are affected by factors such as stimulus saliency and top-down attention. Here, we investigated how the saliency of visual background (naturalistic cartoon video vs. blank screen) and top-down attention (single vs. dual tasks) separately affect individual ability to detect visual targets. Behaviorally, we found that target detection accuracy decreased and reaction time elongated when the background was salient or during dual tasking. The EEG response to visual background was recorded using a novel stimulus tagging technique. This response was strongest in occipital electrodes and was sensitive to background saliency but not dual tasking. In contrast, the event-related potential (ERP) evoked by the visual target was strongest in central electrodes, and was affected by both background saliency and dual tasking. With a cartoon background, the EEG responses to visual targets, presented in the central visual field, and the EEG responses to peripheral visual background could both predict individual target detection performance. When these two responses were combined, better prediction was achieved. These results suggest that neural processing of visual targets and background jointly contribute to individual visual target detection performance.

[1]  M. D. Rugg,et al.  Modulation of visual event-related potentials by spatial and non-spatial visual selective attention , 1987, Neuropsychologia.

[2]  S. Hillyard,et al.  Selective attention to stimulus location modulates the steady-state visual evoked potential. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[3]  S. Kelly,et al.  A supramodal accumulation-to-bound signal that determines perceptual decisions in humans , 2012, Nature Neuroscience.

[4]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[5]  S. Yantis,et al.  Visual attention: control, representation, and time course. , 1997, Annual review of psychology.

[6]  J. Theeuwes Top-down search strategies cannot override attentional capture , 2004, Psychonomic bulletin & review.

[7]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[8]  M. Bradley,et al.  Large-scale neural correlates of affective picture processing. , 2002, Psychophysiology.

[9]  S. Hillyard,et al.  Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming. , 1991, Journal of experimental psychology. Human perception and performance.

[10]  N. Lavie,et al.  Failures to Ignore Entirely Irrelevant Distractors , 2008, Journal of experimental psychology. Applied.

[11]  Juliana Yordanova,et al.  On the relation of movement-related potentials to the go/no-go effect on P3 , 2006, Biological Psychology.

[12]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[13]  E. Knudsen Fundamental components of attention. , 2007, Annual review of neuroscience.

[14]  N. Lavie Attention, Distraction, and Cognitive Control Under Load , 2010 .

[15]  E. Miller,et al.  Top-Down Versus Bottom-Up Control of Attention in the Prefrontal and Posterior Parietal Cortices , 2007, Science.

[16]  S. A. Hillyard,et al.  Sustained division of the attentional spotlight , 2003, Nature.

[17]  E. Donchin,et al.  The influence of stimulus deviance and novelty on the P300 and novelty P3. , 2002, Psychophysiology.

[18]  Fang Fang,et al.  Selective spatial attention involves two alpha-band components associated with distinct spatiotemporal and functional characteristics , 2019, NeuroImage.

[19]  J L Gallant,et al.  Sparse coding and decorrelation in primary visual cortex during natural vision. , 2000, Science.

[20]  S. Kelly,et al.  The classic P300 encodes a build‐to‐threshold decision variable , 2015, The European journal of neuroscience.

[21]  S. Hillyard,et al.  Event-related brain potentials in the study of visual selective attention. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[22]  Steven A. Hillyard,et al.  Attention Facilitates Multiple Stimulus Features in Parallel in Human Visual Cortex , 2008, Current Biology.

[23]  Andreas Keil,et al.  Time course of competition for visual processing resources between emotional pictures and foreground task. , 2008, Cerebral cortex.

[24]  Fang Fang,et al.  Sequential sampling of visual objects during sustained attention , 2017, PLoS biology.

[25]  Thomas C. Sprague,et al.  Dissociable signatures of visual salience and behavioral relevance across attentional priority maps in human cortex , 2017, bioRxiv.

[26]  E. Van der Burg,et al.  The role of spatial and nonspatial information in visual selection. , 2007, Journal of experimental psychology. Human perception and performance.

[27]  E. Vogel,et al.  Human Variation in Overriding Attentional Capture , 2009, The Journal of Neuroscience.

[28]  C. Eriksen,et al.  Decision making and the P300 component of the cortical evoked response , 1974 .

[29]  E. Viding,et al.  Load theory of selective attention and cognitive control. , 2004, Journal of experimental psychology. General.

[30]  P. O. Bishop,et al.  Spatial vision. , 1971, Annual review of psychology.

[31]  Joseph B. Hopfinger,et al.  Interactions between endogenous and exogenous attention on cortical visual processing , 2006, NeuroImage.

[32]  M. Carrasco,et al.  The eccentricity effect: Target eccentricity affects performance on conjunction searches , 1995, Perception & psychophysics.

[33]  R. Barry,et al.  Movement-related potentials in the Go/NoGo task: The P3 reflects both cognitive and motor inhibition , 2008, Clinical Neurophysiology.

[34]  J. Theeuwes Exogenous and endogenous control of attention: The effect of visual onsets and offsets , 1991, Perception & psychophysics.

[35]  S. Yantis 3 Goal-Directed and Stimulus-Driven Determinants of Attentional Control , 2000 .

[36]  Susan L. Travis,et al.  Neural Responses to Target Features outside a Search Array Are Enhanced during Conjunction but Not Unique-Feature Search , 2014, The Journal of Neuroscience.

[37]  E. Donchin,et al.  Is the P300 component a manifestation of context updating? , 1988, Behavioral and Brain Sciences.

[38]  D. E. Irwin,et al.  Our Eyes do Not Always Go Where we Want Them to Go: Capture of the Eyes by New Objects , 1998 .

[39]  Li Fei-Fei,et al.  Neural mechanisms of rapid natural scene categorization in human visual cortex , 2009, Nature.

[40]  A. Kok Effects of degradation of visual stimuli on components of the event-related potential (ERP) in go/nogo reaction tasks , 1986, Biological Psychology.

[41]  P. Perona,et al.  Rapid natural scene categorization in the near absence of attention , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[42]  Yaoda Xu,et al.  Decoding the content of visual short-term memory under distraction in occipital and parietal areas , 2015, Nature Neuroscience.

[43]  R. Desimone,et al.  Selective attention gates visual processing in the extrastriate cortex. , 1985, Science.

[44]  Nai Ding,et al.  Perceptual integration rapidly activates dorsal visual pathway to guide local processing in early visual areas , 2017, PLoS biology.

[45]  E Donchin,et al.  A metric for thought: a comparison of P300 latency and reaction time. , 1981, Science.

[46]  J. Duncan,et al.  Competitive brain activity in visual attention , 1997, Current Opinion in Neurobiology.

[47]  N. Lavie Perceptual load as a necessary condition for selective attention. , 1995, Journal of experimental psychology. Human perception and performance.

[48]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[49]  M Carrasco,et al.  The interaction of objective and subjective organizations in a localization search task , 1995, Perception & psychophysics.

[50]  Søren K. Andersen,et al.  Effects of Feature-selective and Spatial Attention at Different Stages of Visual Processing , 2011, Journal of Cognitive Neuroscience.

[51]  J. Serences,et al.  Value-based attentional capture influences context-dependent decision-making. , 2015, Journal of neurophysiology.

[52]  J. Polich,et al.  P3a, perceptual distinctiveness, and stimulus modality. , 1998, Brain research. Cognitive brain research.

[53]  J. Serences,et al.  Two different mechanisms support selective attention at different phases of training , 2016, PLoS biology.

[54]  E. Courchesne,et al.  Stimulus novelty, task relevance and the visual evoked potential in man. , 1975, Electroencephalography and clinical neurophysiology.

[55]  John K. Tsotsos,et al.  Direct neurophysiological evidence for spatial suppression surrounding the focus of attention in vision. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[56]  D. Jeffreys,et al.  Source locations of pattern-specific components of human visual evoked potentials. I. Component of striate cortical origin , 2004, Experimental Brain Research.

[57]  Rolf Verleger,et al.  Is P3 a strategic or a tactical component? Relationships of P3 sub-components to response times in oddball tasks with go, no-go and choice responses , 2016, NeuroImage.

[58]  Jasna Martinovic,et al.  Bottom-Up Biases in Feature-Selective Attention , 2012, The Journal of Neuroscience.

[59]  A. Wilkins,et al.  Photic‐ and Pattern‐induced Seizures: A Review for the Epilepsy Foundation of America Working Group , 2005, Epilepsia.

[60]  D. Regan Some characteristics of average steady-state and transient responses evoked by modulated light. , 1966, Electroencephalography and clinical neurophysiology.

[61]  B. C. Motter Focal attention produces spatially selective processing in visual cortical areas V1, V2, and V4 in the presence of competing stimuli. , 1993, Journal of neurophysiology.

[62]  R. Desimone,et al.  High-Frequency, Long-Range Coupling Between Prefrontal and Visual Cortex During Attention , 2009, Science.

[63]  John T. Serences,et al.  Coexisting representations of sensory and mnemonic information in human visual cortex , 2019, Nature Neuroscience.

[64]  S. Hillyard,et al.  Electrical Signs of Selective Attention in the Human Brain , 1973, Science.

[65]  Alfonso Caramazza,et al.  Attention selection, distractor suppression and N2pc , 2009, Cortex.

[66]  S. Kelly,et al.  Internal and External Influences on the Rate of Sensory Evidence Accumulation in the Human Brain , 2013, The Journal of Neuroscience.

[67]  Carly J. Leonard,et al.  Hyperfocusing of Attention on Goal-Related Information in Schizophrenia: Evidence From Electrophysiology , 2017, Journal of abnormal psychology.

[68]  F. Kitterle Psychophysics of lateral tachistoscopic presentation , 1986, Brain and Cognition.

[69]  Guillaume A. Rousselet,et al.  Robust Correlation Analyses: False Positive and Power Validation Using a New Open Source Matlab Toolbox , 2012, Front. Psychology.

[70]  Andrew B. Leber,et al.  Coordination of Voluntary and Stimulus-Driven Attentional Control in Human Cortex , 2005, Psychological science.

[71]  S. Andersen,et al.  Behavioral performance follows the time course of neural facilitation and suppression during cued shifts of feature-selective attention , 2010, Proceedings of the National Academy of Sciences.

[72]  Barak A. Pearlmutter,et al.  The VESPA: A method for the rapid estimation of a visual evoked potential , 2006, NeuroImage.

[73]  M. Paradiso,et al.  Feature-specific effects of selective visual attention , 1995, Vision Research.

[74]  Viola S. Störmer,et al.  Cross-modal cueing of attention alters appearance and early cortical processing of visual stimuli , 2009, Proceedings of the National Academy of Sciences.

[75]  G. McCarthy,et al.  Augmenting mental chronometry: the P300 as a measure of stimulus evaluation time. , 1977, Science.

[76]  G. Boynton,et al.  Global feature-based attention for motion and color , 2003, Vision Research.

[77]  Edward F. Ester,et al.  Sensory Gain Outperforms Efficient Readout Mechanisms in Predicting Attention-Related Improvements in Behavior , 2014, The Journal of Neuroscience.

[78]  Antigona Martínez,et al.  Source analysis of event-related cortical activity during visuo-spatial attention. , 2003, Cerebral cortex.

[79]  E. Donchin,et al.  Auditory averaged evoked potentials in man during selective binaural listening. , 1970, Electroencephalography and clinical neurophysiology.

[80]  Hubert R. Dinse,et al.  Improvement and Impairment of Visually Guided Behavior through LTP- and LTD-like Exposure-Based Visual Learning , 2011, Current Biology.

[81]  Stefan Treue,et al.  Feature-based attention influences motion processing gain in macaque visual cortex , 1999, Nature.

[82]  David J. Prime,et al.  Inability to suppress salient distractors predicts low visual working memory capacity , 2016, Proceedings of the National Academy of Sciences.

[83]  Jeff Miller,et al.  Jackknife-based method for measuring LRP onset latency differences. , 1998, Psychophysiology.

[84]  E. Donchin,et al.  Optimizing the use of information: strategic control of activation of responses. , 1992, Journal of experimental psychology. General.

[85]  S. Hillyard,et al.  Allocation of visual attention to spatial locations: Tradeoff functions for event-related brain potentials and detection performance , 1990, Perception & psychophysics.

[86]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[87]  S A Hillyard,et al.  Feature-selective attention enhances color signals in early visual areas of the human brain , 2006, Proceedings of the National Academy of Sciences.

[88]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[89]  A. Keil,et al.  Neural Substrate of the Late Positive Potential in Emotional Processing , 2012, The Journal of Neuroscience.