Differential brain mechanisms for processing distracting information in task‐relevant and ‐irrelevant dimensions in visual search

A crucial function of our goal‐directed behavior is to select task‐relevant targets among distractor stimuli, some of which may share properties with the target and thus compete for attentional selection. Here, by applying functional magnetic resonance imaging (fMRI) to a visual search task in which a target was embedded in an array of distractors that were homogeneous or heterogeneous along the task‐relevant (orientation or form) and/or task‐irrelevant (color) dimensions, we demonstrate that for both (orientation) feature search and (form) conjunction search, the fusiform gyrus is involved in processing the task‐irrelevant color information, while the bilateral frontal eye fields (FEF), the cortex along the left intraparietal sulcus (IPS), and the left junction of intraparietal and transverse occipital sulci (IPTO) are involved in processing task‐relevant distracting information, especially for target‐absent trials. Moreover, in conjunction (but not in feature) search, activity in these frontoparietal regions is affected by stimulus heterogeneity along the task‐irrelevant dimension: heterogeneity of the task‐irrelevant information increases the activity in these regions only when the task‐relevant information is homogeneous, not when it is heterogeneous. These findings suggest that differential neural mechanisms are involved in processing task‐relevant and task‐irrelevant dimensions of the searched‐for objects. In addition, they show that the top‐down task set plays a dominant role in determining whether or not task‐irrelevant information can affect the processing of the task‐relevant dimension in the frontoparietal regions.

[1]  Michele T. Diaz,et al.  Age mediation of frontoparietal activation during visual feature search , 2014, NeuroImage.

[2]  Arno Villringer,et al.  Visual Feature and Conjunction Searches of Equal Difficulty Engage Only Partially Overlapping Frontoparietal Networks , 2002, NeuroImage.

[3]  Arno Villringer,et al.  Parietal activation during visual search in the absence of multiple distractors , 2003, Neuroreport.

[4]  M. Corbetta,et al.  Right TPJ deactivation during visual search: functional significance and support for a filter hypothesis. , 2007, Cerebral cortex.

[5]  Carmel Mevorach,et al.  Opposite biases in salience-based selection for the left and right posterior parietal cortex , 2006, Nature Neuroscience.

[6]  C W Eriksen,et al.  A source of error in attempts to distinguish coactivation from separate activation in the perception of redundant targets , 1988, Perception & psychophysics.

[7]  Nitesh Saxena,et al.  Task-Dependent Changes in Frontal-Parietal Activation and Connectivity During Visual Search , 2016, Brain Connect..

[8]  Zhaoping Li,et al.  Psychophysical Tests of the Hypothesis of a Bottom-Up Saliency Map in Primary Visual Cortex , 2007, PLoS Comput. Biol..

[9]  Dragan Rangelov,et al.  Visual search for feature singletons: multiple mechanisms produce sequence effects in visual search. , 2013, Journal of vision.

[10]  C. D. Frith,et al.  Brain Activations during Visual Search: Contributions of Search Efficiency versus Feature Binding , 2003, NeuroImage.

[11]  Martin Eimer,et al.  Top-down task sets for combined features: Behavioral and electrophysiological evidence for two stages in attentional object selection , 2013, Attention, perception & psychophysics.

[12]  Stefan Pollmann,et al.  Task relevance modulates the cortical representation of feature conjunctions in the target template , 2017, Scientific Reports.

[13]  John C Gore,et al.  The role of the parietal cortex in visual feature binding , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Y. Tsal,et al.  Perceptual load as a major determinant of the locus of selection in visual attention , 1994, Perception & psychophysics.

[15]  Vincent Walsh,et al.  Distinct neural substrates for visual search amongst spatial versus temporal distractors. , 2003, Brain research. Cognitive brain research.

[16]  R. Desimone,et al.  Selective attention gates visual processing in the extrastriate cortex. , 1985, Science.

[17]  A. Villringer,et al.  Involvement of the human frontal eye field and multiple parietal areas in covert visual selection during conjunction search , 2000, The European journal of neuroscience.

[18]  N. Kanwisher,et al.  Neuroimaging of cognitive functions in human parietal cortex , 2001, Current Opinion in Neurobiology.

[19]  Xiaolin Zhou,et al.  Processing multidimensional objects under different perceptual loads: The priority of bottom-up perceptual saliency , 2006, Brain Research.

[20]  M. Corbetta,et al.  Right Hemisphere Dominance during Spatial Selective Attention and Target Detection Occurs Outside the Dorsal Frontoparietal Network , 2010, The Journal of Neuroscience.

[21]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[22]  S. Fairhall,et al.  The brain network underlying serial visual search: comparing overt and covert spatial orienting, for activations and for effective connectivity. , 2009, Cerebral cortex.

[23]  S. Pollmann,et al.  Contextual cueing impairment in patients with age-related macular degeneration. , 2013, Journal of vision.

[24]  Jason B. Mattingley,et al.  Spatial working memory and spatial attention rely on common neural processes in the intraparietal sulcus , 2010, NeuroImage.

[25]  J. Duncan,et al.  Beyond the search surface: visual search and attentional engagement. , 1992, Journal of experimental psychology. Human perception and performance.

[26]  J. Duncan,et al.  Attention and reading: Wholes and parts in shape recognition: A tutorial review. , 1987 .

[27]  J. Assad,et al.  Neural coding of behavioral relevance in parietal cortex , 2003, Current Opinion in Neurobiology.

[28]  Karl J. Friston,et al.  Cognitive Conjunction: A New Approach to Brain Activation Experiments , 1997, NeuroImage.

[29]  M. Eimer,et al.  Category-based guidance of spatial attention during visual search for feature conjunctions. , 2016, Journal of experimental psychology. Human perception and performance.

[30]  M. Corbetta,et al.  Quantitative analysis of attention and detection signals during visual search. , 2003, Journal of neurophysiology.

[31]  Martin Eimer,et al.  The gradual emergence of spatially selective target processing in visual search: From feature-specific to object-based attentional control. , 2014, Journal of experimental psychology. Human perception and performance.

[32]  S. Yantis,et al.  Transient neural activity in human parietal cortex during spatial attention shifts , 2002, Nature Neuroscience.

[33]  Alison R. Lane,et al.  The involvement of posterior parietal cortex and frontal eye fields in spatially primed visual search , 2012, Brain Stimulation.

[34]  Jesper Andersson,et al.  Valid conjunction inference with the minimum statistic , 2005, NeuroImage.

[35]  H. Jones,et al.  Visual cortical mechanisms detecting focal orientation discontinuities , 1995, Nature.

[36]  Karl J. Friston,et al.  Conjunction revisited , 2005, NeuroImage.

[37]  J. C. Johnston,et al.  Involuntary covert orienting is contingent on attentional control settings. , 1992, Journal of experimental psychology. Human perception and performance.

[38]  Yaoda Xu,et al.  The Neural Fate of Task-Irrelevant Features in Object-Based Processing , 2010, The Journal of Neuroscience.

[39]  M. Chun,et al.  The dark side of visual attention , 2002, Current Opinion in Neurobiology.

[40]  George R. Mangun,et al.  Anterior Intraparietal Sulcus is Sensitive to Bottom–Up Attention Driven by Stimulus Salience , 2009, Journal of Cognitive Neuroscience.

[41]  J. Theeuwes Perceptual selectivity for color and form , 1992, Perception & psychophysics.

[42]  Jeremy M. Wolfe,et al.  Guided Search 4.0: Current Progress With a Model of Visual Search , 2007, Integrated Models of Cognitive Systems.

[43]  G. Orban,et al.  Attention Mechanisms in Visual SearchAn fMRI Study , 2000, Journal of Cognitive Neuroscience.

[44]  P. Cavanagh,et al.  Visual Search for Feature and Conjunction Targets with an Attention Deficit , 1993, Journal of Cognitive Neuroscience.

[45]  X. Hu,et al.  4 T-fMRI study of nonspatial shifting of selective attention: cerebellar and parietal contributions. , 1998, Journal of neurophysiology.

[46]  N. Lavie Distracted and confused?: Selective attention under load , 2005, Trends in Cognitive Sciences.

[47]  G. Mangun,et al.  Top-down Modulation of Neural Activity in Anticipatory Visual Attention: Control Mechanisms Revealed by Simultaneous EEG-fMRI. , 2014, Cerebral cortex.

[48]  K. Nakayama,et al.  Situating visual search , 2011, Vision Research.

[49]  Glyn W. Humphreys,et al.  A connectionist model of visual search for simple form conjunctions , 1993 .

[50]  S. Yantis,et al.  Cortical mechanisms of feature-based attentional control. , 2003, Cerebral cortex.

[51]  Stefan Pollmann,et al.  Cortical evidence for negative search templates , 2017 .

[52]  B. Gold,et al.  Common and Distinct Mechanisms of Cognitive Flexibility in Prefrontal Cortex , 2011, The Journal of Neuroscience.

[53]  J. Duncan,et al.  Visual search and stimulus similarity. , 1989, Psychological review.

[54]  Ping Wei,et al.  Searching for two feature singletons in the visual scene: the localized attentional interference effect , 2008, Experimental Brain Research.

[55]  A. Treisman Features and Objects: The Fourteenth Bartlett Memorial Lecture , 1988, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[56]  Hermann J. Müller,et al.  Neural basis of interaction between target presence and display homogeneity in visual search: An fMRI study , 2009, NeuroImage.

[57]  S. Kastner,et al.  Stimulus context modulates competition in human extrastriate cortex , 2005, Nature Neuroscience.

[58]  R W Remington,et al.  The structure of attentional control: contingent attentional capture by apparent motion, abrupt onset, and color. , 1994, Journal of experimental psychology. Human perception and performance.

[59]  Andrew B. Leber,et al.  Coordination of Voluntary and Stimulus-Driven Attentional Control in Human Cortex , 2005, Psychological science.

[60]  Richard N. A. Henson,et al.  The Effects of Interdistracter Similarity on Search Processes in Superior Parietal Cortex , 2002, NeuroImage.

[61]  G. R. Mangun,et al.  A Role for Top-Down Attentional Orienting during Interference between Global and Local Aspects of Hierarchical Stimuli , 2002, NeuroImage.

[62]  Martin Eimer,et al.  Involuntary Attentional Capture is Determined by Task Set: Evidence from Event-related Brain Potentials , 2008, Journal of Cognitive Neuroscience.

[63]  J. Theeuwes Cross-dimensional perceptual selectivity , 1991, Perception & psychophysics.

[64]  J. Wolfe,et al.  The role of categorization in visual search for orientation. , 1992, Journal of experimental psychology. Human perception and performance.

[65]  M. Husain,et al.  Involvement of prefrontal cortex in visual search , 2007, Experimental Brain Research.

[66]  Alison R. Lane,et al.  Functional Interaction between Right Parietal and Bilateral Frontal Cortices during Visual Search Tasks Revealed Using Functional Magnetic Imaging and Transcranial Direct Current Stimulation , 2014, PloS one.

[67]  N. P. Bichot,et al.  Effects of similarity and history on neural mechanisms of visual selection , 1999, Nature Neuroscience.

[68]  Robert Nullmeyer,et al.  Application of variable criterion theory to choice reaction time , 1977 .

[69]  S. Zeki,et al.  Three cortical stages of colour processing in the human brain. , 1998, Brain : a journal of neurology.

[70]  Leslie G. Ungerleider,et al.  Posterior parietal cortex and the filtering of distractors , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[71]  Hermann J. Müller,et al.  Neural correlates of binding features within- or cross-dimensions in visual conjunction search: An fMRI study , 2011, NeuroImage.

[72]  Ralph Weidner,et al.  Individual attentional selection capacities are reflected in interhemispheric connectivity of the parietal cortex , 2016, NeuroImage.

[73]  J. Gore,et al.  Neural Correlates of the Attentional Blink , 2000, Neuron.

[74]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited , 1995, NeuroImage.

[75]  G. Humphreys,et al.  Dissociating the neural mechanisms of memory-based guidance of visual selection , 2007, Proceedings of the National Academy of Sciences.

[76]  M. Corbetta,et al.  Superior Parietal Cortex Activation During Spatial Attention Shifts and Visual Feature Conjunction , 1995, Science.

[77]  S. Zeki,et al.  The architecture of the colour centre in the human visual brain: new results and a review * , 2000, The European journal of neuroscience.

[78]  Jeffrey D. Schall,et al.  Effect of target-distractor similarity on FEF visual selection in the absence of the target , 2003, Experimental Brain Research.

[79]  Glyn W. Humphreys,et al.  The Left Intraparietal Sulcus Modulates the Selection of Low Salient Stimuli , 2009, Journal of Cognitive Neuroscience.