Spatial sampling in human visual cortex is modulated by both spatial and feature-based attention

Spatial attention changes the sampling of visual space. Behavioral studies suggest that feature-based attention modulates this resampling to optimize the attended feature's sampling. We investigate this hypothesis by estimating spatial sampling in visual cortex while independently varying both feature-based and spatial attention. Our results show that spatial and feature-based attention interacted: resampling of visual space depended on both the attended location and feature (color vs. temporal frequency). This interaction occurred similarly throughout visual cortex, regardless of an area's overall feature preference. However, the interaction did depend on spatial sampling properties of voxels that prefer the attended feature. These findings are parsimoniously explained by variations in the precision of an attentional gain field. Our results demonstrate that the deployment of spatial attention is tailored to the spatial sampling properties of units that are sensitive to the attended feature.

[1]  J. Wolfe,et al.  Changing your mind: on the contributions of top-down and bottom-up guidance in visual search for feature singletons. , 2003, Journal of experimental psychology. Human perception and performance.

[2]  S. Dumoulin,et al.  The Relationship between Cortical Magnification Factor and Population Receptive Field Size in Human Visual Cortex: Constancies in Cortical Architecture , 2011, The Journal of Neuroscience.

[3]  Serge O. Dumoulin,et al.  Visual motion transforms visual space representations similarly throughout the human visual hierarchy , 2016, NeuroImage.

[4]  B. Wandell,et al.  Cortical Maps and White Matter Tracts following Long Period of Visual Deprivation and Retinal Image Restoration , 2010, Neuron.

[5]  R. Rosenholtz.  Capabilities and Limitations of Peripheral Vision. , 2016, Annual review of vision science.

[6]  D. L. Adams,et al.  A Precise Retinotopic Map of Primate Striate Cortex Generated from the Representation of Angioscotomas , 2003, The Journal of Neuroscience.

[7]  Michael Eickenberg,et al.  Data-driven HRF estimation for encoding and decoding models , 2014, NeuroImage.

[8]  Y. Saalmann,et al.  Functional and structural architecture of the human dorsal frontoparietal attention network , 2013, Proceedings of the National Academy of Sciences.

[9]  D. Heeger,et al.  Topographic maps of visual spatial attention in human parietal cortex. , 2005, Journal of neurophysiology.

[10]  Marisa Carrasco,et al.  Attention improves or impairs visual performance by enhancing spatial resolution , 1998, Nature.

[11]  J. Gallant,et al.  Time Course of Attention Reveals Different Mechanisms for Spatial and Feature-Based Attention in Area V4 , 2005, Neuron.

[12]  Alexander G. Huth,et al.  Attention During Natural Vision Warps Semantic Representation Across the Human Brain , 2013, Nature Neuroscience.

[13]  G. Boynton,et al.  Feature-Based Attentional Modulations in the Absence of Direct Visual Stimulation , 2007, Neuron.

[14]  David Alais,et al.  Finding Flicker: Critical Differences in Temporal Frequency Capture Attention , 2011, Front. Psychology.

[15]  Michael A. Silver,et al.  Hemisphere-Dependent Attentional Modulation of Human Parietal Visual Field Representations , 2015, The Journal of Neuroscience.

[16]  Søren K. Andersen,et al.  Effects of Feature-selective and Spatial Attention at Different Stages of Visual Processing , 2011, Journal of Cognitive Neuroscience.

[17]  Adam Gazzaley,et al.  Top-down modulation of visual feature processing: The role of the inferior frontal junction , 2010, NeuroImage.

[18]  S. Dumoulin,et al.  Modeling center-surround configurations in population receptive fields using fMRI. , 2012, Journal of vision.

[19]  Trichur Raman Vidyasagar,et al.  The responses of cells in macaque lateral geniculate nucleus to sinusoidal gratings. , 1983, The Journal of physiology.

[20]  G R Mangun,et al.  Combined expectancies: event-related potentials reveal the early benefits of spatial attention that are obscured by reaction time measures. , 2001, Journal of experimental psychology. Human perception and performance.

[21]  Clayton E Curtis,et al.  Prioritized Maps of Space in Human Frontoparietal Cortex , 2012, The Journal of Neuroscience.

[22]  Christoph W Korn,et al.  A solid frame for the window on cognition: Modeling event-related pupil responses. , 2016, Journal of vision.

[23]  A. Dale,et al.  The Retinotopy of Visual Spatial Attention , 1998, Neuron.

[24]  L. Busse,et al.  Attention to the Color of a Moving Stimulus Modulates Motion-Signal Processing in Macaque Area MT: Evidence for a Unified Attentional System , 2009, Front. Syst. Neurosci..

[25]  M. Posner,et al.  Attention and the detection of signals. , 1980, Journal of experimental psychology.

[26]  T. Knapen,et al.  How Visual Cortical Organization Is Altered by Ophthalmologic and Neurologic Disorders. , 2018, Annual review of vision science.

[27]  R. Desimone,et al.  Attention Increases Sensitivity of V4 Neurons , 2000, Neuron.

[28]  Brian A. Wandell,et al.  Population receptive field estimates in human visual cortex , 2008, NeuroImage.

[29]  J. Maunsell,et al.  Using Neuronal Populations to Study the Mechanisms Underlying Spatial and Feature Attention , 2011, Neuron.

[30]  Christian Windischberger,et al.  Eyetracker-based gaze correction for robust mapping of population receptive fields , 2016, NeuroImage.

[31]  Thomas C. Sprague,et al.  Spatial Tuning Shifts Increase the Discriminability and Fidelity of Population Codes in Visual Cortex , 2017, The Journal of Neuroscience.

[32]  Stefan Treue,et al.  Feature-based attention influences motion processing gain in macaque visual cortex , 1999, Nature.

[33]  Marisa Carrasco,et al.  Attentional enhancement of spatial resolution: linking behavioural and neurophysiological evidence , 2013, Nature Reviews Neuroscience.

[34]  Steven A. Hillyard,et al.  V1, V2, and V4 of Macaque Visual Cortex Neural Mechanisms of Spatial Selective Attention in Areas , 2013 .

[35]  T. Womelsdorf,et al.  Receptive Field Shift and Shrinkage in Macaque Middle Temporal Area through Attentional Gain Modulation , 2008, The Journal of Neuroscience.

[36]  Janneke F. M. Jehee,et al.  Attention Improves Encoding of Task-Relevant Features in the Human Visual Cortex , 2011, The Journal of Neuroscience.

[37]  B. Motter.  Neural correlates of attentive selection for color or luminance in extrastriate area V4 , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[38]  Kendrick N Kay,et al.  Bottom-up and top-down computations in word- and face-selective cortex , 2017, eLife.

[39]  Elaine J. Anderson,et al.  Perceptual load affects spatial tuning of neuronal populations in human early visual cortex , 2014, Current Biology.

[40]  Jonathan Westley Peirce,et al.  Neuroinformatics Original Research Article Generating Stimuli for Neuroscience Using Psychopy , 2022 .

[41]  M. Carrasco,et al.  On the flexibility of sustained attention and its effects on a texture segmentation task , 2008, Vision Research.

[42]  S. Luck,et al.  Feature-based attention modulates feedforward visual processing , 2009, Nature Neuroscience.

[43]  Robert Desimone,et al.  Feature-Based Attention in the Frontal Eye Field and Area V4 during Visual Search , 2011, Neuron.

[44]  Hans-Jochen Heinze,et al.  Object-based attention involves the sequential activation of feature-specific cortical modules , 2014, Nature Neuroscience.

[45]  S. Hillyard,et al.  Selective attention to color and location: An analysis with event-related brain potentials , 1984, Perception & psychophysics.

[46]  H. Müller,et al.  Searching for unknown feature targets on more than one dimension: Investigating a “dimension-weighting” account , 1996, Perception & psychophysics.

[47]  Jim M. Monti,et al.  Neural Integration of Top-Down Spatial and Feature-Based Information in Visual Search , 2008, The Journal of Neuroscience.

[48]  Serge O. Dumoulin,et al.  Radial asymmetries in population receptive field size and cortical magnification factor in early visual cortex , 2017 .

[49]  John H. R. Maunsell,et al.  Attention to both space and feature modulates neuronal responses in macaque area V4. , 2000, Journal of neurophysiology.

[50]  S. Luck,et al.  Attention to Features Precedes Attention to Locations in Visual Search: Evidence from Electromagnetic Brain Responses in Humans , 2004, The Journal of Neuroscience.

[51]  John H. R. Maunsell,et al.  Feature-based attention in visual cortex , 2006, Trends in Neurosciences.

[52]  M. Corbetta,et al.  Two attentional processes in the parietal lobe. , 2002, Cerebral cortex.

[53]  Kendrick N. Kay,et al.  Attention Reduces Spatial Uncertainty in Human Ventral Temporal Cortex , 2015, Current Biology.

[54]  David J. Freedman,et al.  Interaction between Spatial and Feature Attention in Posterior Parietal Cortex , 2016, Neuron.

[55]  Carly J. Leonard,et al.  Interactions between space-based and feature-based attention. , 2015, Journal of experimental psychology. Human perception and performance.

[56]  Stefan Treue,et al.  Combining spatial and feature-based attention within the receptive field of MT neurons , 2009, Vision Research.

[57]  Katherine E Burnett,et al.  Spatial attention can be biased towards an expected dimension , 2016, Quarterly journal of experimental psychology.

[58]  Lotfi B Merabet,et al.  Visual Topography of Human Intraparietal Sulcus , 2007, The Journal of Neuroscience.

[59]  Clayton E. Curtis,et al.  Visual field map clusters in human frontoparietal cortex , 2016 .

[60]  S. Hillyard,et al.  Spatio-temporal analysis of feature-based attention. , 2007, Cerebral cortex.

[61]  Alex R. Wade,et al.  Visual field maps and stimulus selectivity in human ventral occipital cortex , 2005, Nature Neuroscience.

[62]  Sabine Kastner,et al.  Visual attention as a multilevel selection process , 2004, Cognitive, affective & behavioral neuroscience.

[63]  N. P. Bichot,et al.  A Source for Feature-Based Attention in the Prefrontal Cortex , 2015, Neuron.

[64]  Alex L. White,et al.  Feature-based attention involuntarily and simultaneously improves visual performance across locations. , 2011, Journal of vision.

[65]  John H. R. Maunsell,et al.  Attentional modulation of visual motion processing in cortical areas MT and MST , 1996, Nature.

[66]  D. Heeger,et al.  Decoding and Reconstructing Color from Responses in Human Visual Cortex , 2009, The Journal of Neuroscience.

[67]  B. Wandell,et al.  Visual field maps, population receptive field sizes, and visual field coverage in the human MT+ complex. , 2009, Journal of neurophysiology.

[68]  M. Carrasco,et al.  The contribution of covert attention to the set-size and eccentricity effects in visual search. , 1998, Journal of experimental psychology. Human perception and performance.

[69]  M. Corbetta,et al.  A Common Network of Functional Areas for Attention and Eye Movements , 1998, Neuron.

[70]  Martin Rolfs,et al.  Stimulus competition mediates the joint effects of spatial and feature-based attention. , 2015, Journal of vision.

[71]  Russell A Poldrack,et al.  Precision Neuroscience: Dense Sampling of Individual Brains , 2017, Neuron.

[72]  T. Womelsdorf,et al.  Dynamic shifts of visual receptive fields in cortical area MT by spatial attention , 2006, Nature Neuroscience.

[73]  G. Boynton,et al.  Global effects of feature-based attention in human visual cortex , 2002, Nature Neuroscience.

[74]  Asher Cohen,et al.  Perceptual Dimensional Constraints in Response Selection Processes , 1997, Cognitive Psychology.

[75]  A. Opstal,et al.  Influence of eye position on activity in monkey superior colliculus. , 1995, Journal of neurophysiology.

[76]  The spotlight of attention illuminates failed feature-based expectancies. , 2012, Psychophysiology.

[77]  Essa Yacoub,et al.  Functional mapping of the magnocellular and parvocellular subdivisions of human LGN , 2014, NeuroImage.

[78]  Jan Theeuwes,et al.  Cognitive and Ocular Factors Jointly Determine Pupil Responses under Equiluminance , 2016, PloS one.

[79]  J. Gallant,et al.  Combined effects of spatial and feature-based attention on responses of V4 neurons , 2009, Vision Research.

[80]  A. Hendrickson,et al.  Human photoreceptor topography , 1990, The Journal of comparative neurology.

[81]  T Kumada,et al.  Feature-based control of attention: Evidence for two forms of dimension weighting , 2001, Perception & psychophysics.

[82]  N. P. Bichot,et al.  Spatial selection via feature-driven inhibition of distractor locations , 1998, Perception & psychophysics.

[83]  Karl J. Friston,et al.  The physiological basis of attentional modulation in extrastriate visual areas , 1999, Nature Neuroscience.

[84]  Junying Yuan,et al.  Selective gating of visual signals by microstimulation of frontal cortex , 2022 .

[85]  D. Heeger,et al.  The Normalization Model of Attention , 2009, Neuron.

[86]  D. Heeger,et al.  Categorical Clustering of the Neural Representation of Color , 2013, The Journal of Neuroscience.

[87]  John T. Serences,et al.  Attention modulates spatial priority maps in the human occipital, parietal and frontal cortices , 2013, Nature Neuroscience.

[88]  Ninon Burgos,et al.  New advances in the Clinica software platform for clinical neuroimaging studies , 2019 .

[89]  Alan Kingstone,et al.  Combining Expectancies , 1992 .

[90]  R. Desimone,et al.  High-Frequency, Long-Range Coupling Between Prefrontal and Visual Cortex During Attention , 2009, Science.

[91]  Edgar A. DeYoe,et al.  I know where you are secretly attending! The topography of human visual attention revealed with fMRI , 2009, Vision Research.

[92]  D. V. van Essen,et al.  Spatial Attention Effects in Macaque Area V4 , 1997, The Journal of Neuroscience.

[93]  R. Desimone,et al.  Attention Increases Sensitivity of V4 Neurons , 2000, Neuron.

[94]  Marisa Carrasco,et al.  Attention Modifies Spatial Resolution According to Task Demands , 2017, Psychological science.

[95]  Nancy Kanwisher,et al.  fMRI evidence for objects as the units of attentional selection , 1999, Nature.

[96]  A. Kreiter,et al.  Feature-based attention and the suppression of non-relevant object features , 2008, Vision Research.

[97]  M. Carrasco,et al.  Attention enhances contrast sensitivity at cued and impairs it at uncued locations , 2005, Vision Research.

[98]  S. Celebrini,et al.  Gaze direction controls response gain in primary visual-cortex neurons , 1999, Nature.

[99]  E. Van der Burg,et al.  The role of spatial and nonspatial information in visual selection. , 2007, Journal of experimental psychology. Human perception and performance.

[100]  M. Carrasco,et al.  The locus of attentional effects in texture segmentation , 2000, Nature Neuroscience.

[101]  G. Rizzolatti,et al.  Reorienting attention across the horizontal and vertical meridians: Evidence in favor of a premotor theory of attention , 1987, Neuropsychologia.

[102]  P. Schiller,et al.  Functional specificity of lateral geniculate nucleus laminae of the rhesus monkey. , 1978, Journal of neurophysiology.

[103]  Marlene C. Richter,et al.  Retinotopic Organization and Functional Subdivisions of the Human Lateral Geniculate Nucleus: A High-Resolution Functional Magnetic Resonance Imaging Study , 2004, The Journal of Neuroscience.

[104]  Nikos K. Logothetis,et al.  A new method for estimating population receptive field topography in visual cortex , 2013, NeuroImage.

[105]  Paul Azzopardi,et al.  Uneven mapping of magnocellular and parvocellular projections from the lateral geniculate nucleus to the striate cortex in the macaque monkey , 1999, Vision Research.

[106]  A. Savitzky,et al.  Smoothing and Differentiation of Data by Simplified Least Squares Procedures. , 1964 .

[107]  S A Hillyard,et al.  Feature-selective attention enhances color signals in early visual areas of the human brain , 2006, Proceedings of the National Academy of Sciences.

[108]  M. J. D. Powell,et al.  An efficient method for finding the minimum of a function of several variables without calculating derivatives , 1964, Comput. J..

[109]  C. Bundesen,et al.  Attentional weights in vision as products of spatial and nonspatial components , 2018, Psychonomic bulletin & review.

[110]  J. Wolfe,et al.  What attributes guide the deployment of visual attention and how do they do it? , 2004, Nature Reviews Neuroscience.

[111]  M Corbetta,et al.  Attentional modulation of neural processing of shape, color, and velocity in humans. , 1990, Science.

[112]  Richard A. Andersen,et al.  Separate body- and world-referenced representations of visual space in parietal cortex , 1998, Nature.

[113]  R. Desimone,et al.  Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex. , 1997, Journal of neurophysiology.

[114]  Daniel Baldauf,et al.  Neural mechanisms of object-based attention , 2014 .

[115]  Geoffrey M. Boynton,et al.  Efficient Design of Event-Related fMRI Experiments Using M-Sequences , 2002, NeuroImage.

[116]  Marlene Behrmann,et al.  Space-, object-, and feature-based attention interact to organize visual scenes , 2011, Attention, perception & psychophysics.

[117]  Rufin van Rullen,et al.  A Feedback Model of Attention Explains the Diverse Effects of Attention on Neural Firing Rates and Receptive Field Structure , 2016, PLoS Comput. Biol..

[118]  Edgar A DeYoe,et al.  The Attentional Field Revealed by Single-Voxel Modeling of fMRI Time Courses , 2015, The Journal of Neuroscience.

[119]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[120]  M. Paradiso,et al.  Feature-specific effects of selective visual attention , 1995, Vision Research.

[121]  B. Wandell,et al.  Specializations for Chromatic and Temporal Signals in Human Visual Cortex , 2005, Journal of Neuroscience.

[122]  J. Gallant,et al.  Attention to Stimulus Features Shifts Spectral Tuning of V4 Neurons during Natural Vision , 2008, Neuron.

[123]  G. Boynton,et al.  Global feature-based attention for motion and color , 2003, Vision Research.

[124]  B. Wandell,et al.  Mapping Hv4 and Ventral Occipital Cortex: the Venous Eclipse , 2022 .

[125]  Serge O. Dumoulin,et al.  Attraction of Position Preference by Spatial Attention throughout Human Visual Cortex , 2014, Neuron.