Optimal Deployment of Attentional Gain during Fine Discriminations

Most models assume that top-down attention enhances the gain of sensory neurons tuned to behaviorally relevant stimuli (on-target gain). However, theoretical work suggests that when targets and distracters are highly similar, attention should enhance the gain of neurons that are tuned away from the target, because these neurons better discriminate neighboring features (off-target gain). While it is established that off-target neurons support difficult fine discriminations, it is unclear if top-down attentional gain can be optimally applied to informative off-target sensory neurons or if gain is always applied to on-target neurons, regardless of task demands. To test the optimality of attentional gain in human visual cortex, we used functional magnetic resonance imaging and an encoding model to estimate the response profile across a set of hypothetical orientation-selective channels during a difficult discrimination task. The results suggest that top-down attention can adaptively modulate off-target neural populations, but only when the discriminanda are precisely specified in advance. Furthermore, logistic regression revealed that activation levels in off-target orientation channels predicted behavioral accuracy on a trial-by-trial basis. Overall, these data suggest that attention does not only increase the gain of sensory-evoked responses, but may bias population response profiles in an optimal manner that respects both the tuning properties of sensory neurons and the physical characteristics of the stimulus array.

[1]  P. Schiller,et al.  Quantitative studies of single-cell properties in monkey striate cortex. II. Orientation specificity and ocular dominance. , 1976, Journal of neurophysiology.

[2]  D. Regan,et al.  Postadaptation orientation discrimination. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[3]  R. Desimone,et al.  Selective attention gates visual processing in the extrastriate cortex. , 1985, Science.

[4]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  H Sompolinsky,et al.  Simple models for reading neuronal population codes. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Adrian T. Lee,et al.  fMRI of human visual cortex , 1994, Nature.

[7]  J W Belliveau,et al.  Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. , 1995, Science.

[8]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[9]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[10]  R. Desimone,et al.  Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex. , 1997, Journal of neurophysiology.

[11]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[12]  R. Desimone,et al.  Competitive Mechanisms Subserve Attention in Macaque Areas V2 and V4 , 1999, The Journal of Neuroscience.

[13]  Stefan Treue,et al.  Feature-based attention influences motion processing gain in macaque visual cortex , 1999, Nature.

[14]  Carrie J. McAdams,et al.  Effects of Attention on Orientation-Tuning Functions of Single Neurons in Macaque Cortical Area V4 , 1999, The Journal of Neuroscience.

[15]  Carrie J. McAdams,et al.  Effects of Attention on the Reliability of Individual Neurons in Monkey Visual Cortex , 1999, Neuron.

[16]  R. Desimone,et al.  The Role of Neural Mechanisms of Attention in Solving the Binding Problem , 1999, Neuron.

[17]  A M Dale,et al.  Optimal experimental design for event‐related fMRI , 1999, Human brain mapping.

[18]  J. Maunsell,et al.  Effects of Attention on the Processing of Motion in Macaque Middle Temporal and Medial Superior Temporal Visual Cortical Areas , 1999, The Journal of Neuroscience.

[19]  D. G. Albrecht,et al.  Spikes versus BOLD: what does neuroimaging tell us about neuronal activity? , 2000, Nature Neuroscience.

[20]  C Koch,et al.  Revisiting spatial vision: toward a unifying model. , 2000, Journal of the Optical Society of America. A, Optics, image science, and vision.

[21]  Preeti Verghese,et al.  The psychophysics of visual search , 2000, Vision Research.

[22]  Stefan Treue,et al.  Different populations of neurons contribute to the detection and discrimination of visual motion , 2001, Vision Research.

[23]  G. Orban,et al.  Practising orientation identification improves orientation coding in V1 neurons , 2001, Nature.

[24]  N. Logothetis,et al.  Neurophysiological investigation of the basis of the fMRI signal , 2001, Nature.

[25]  Peter E. Latham,et al.  The relevance of Fisher Information for theories of cortical computation and attention , 2001 .

[26]  Miguel P Eckstein,et al.  The footprints of visual attention in the Posner cueing paradigm revealed by classification images. , 2002, Journal of vision.

[27]  John H. R. Maunsell,et al.  Physiological correlates of perceptual learning in monkey V1 and V2. , 2002, Journal of neurophysiology.

[28]  D. Heeger,et al.  In this issue , 2002, Nature Reviews Drug Discovery.

[29]  Karen K. De Valois,et al.  Measuring the role of chromatic saturation and luminance contrast in color spreading using hue cancellation , 2002 .

[30]  R. Shapley,et al.  Suppression of neural responses to nonoptimal stimuli correlates with tuning selectivity in macaque V1. , 2002, Journal of neurophysiology.

[31]  R. Shapley,et al.  Orientation Selectivity in Macaque V1: Diversity and Laminar Dependence , 2002, The Journal of Neuroscience.

[32]  S. Treue,et al.  Feature-Based Attention Increases the Selectivity of Population Responses in Primate Visual Cortex , 2004, Current Biology.

[33]  Nikos K Logothetis,et al.  Interpreting the BOLD signal. , 2004, Annual review of physiology.

[34]  G. Boynton Attention and visual perception , 2005, Current Opinion in Neurobiology.

[35]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[36]  D. Bradley,et al.  Neural population code for fine perceptual decisions in area MT , 2005, Nature Neuroscience.

[37]  G. Rees,et al.  Predicting the orientation of invisible stimuli from activity in human primary visual cortex , 2005, Nature Neuroscience.

[38]  Moshe Gur,et al.  Cerebral Cortex doi:10.1093/cercor/bhi003 Orientation and Direction Selectivity of Neurons in V1 of Alert Monkeys: Functional Relationships and Laminar Distributions , 2022 .

[39]  Laurent Itti,et al.  Top-down attention selection is fine grained. , 2006, Journal of vision.

[40]  Anthony J. Movshon,et al.  Optimal representation of sensory information by neural populations , 2006, Nature Neuroscience.

[41]  John H. R. Maunsell,et al.  Feature-based attention in visual cortex , 2006, Trends in Neurosciences.

[42]  Wim Vanduffel,et al.  The Radial Bias: A Different Slant on Visual Orientation Sensitivity in Human and Nonhuman Primates , 2006, Neuron.

[43]  G. Orban,et al.  Learning to See the Difference Specifically Alters the Most Informative V4 Neurons , 2006, The Journal of Neuroscience.

[44]  Brian C J Moore,et al.  Basic auditory processes involved in the analysis of speech sounds , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[45]  R. Douglas,et al.  Recurrent neuronal circuits in the neocortex , 2007, Current Biology.

[46]  M. Ernst Learning to integrate arbitrary signals from vision and touch. , 2007, Journal of vision.

[47]  Edward Awh,et al.  Spatial attention, preview, and popout: which factors influence critical spacing in crowded displays? , 2007, Journal of vision.

[48]  J. Movshon,et al.  Integration of sensory evidence in motion discrimination. , 2007, Journal of vision.

[49]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[50]  L. Itti,et al.  Search Goal Tunes Visual Features Optimally , 2007, Neuron.

[51]  Geoffrey M Boynton,et al.  The Representation of Behavioral Choice for Motion in Human Visual Cortex , 2007, The Journal of Neuroscience.

[52]  G. Boynton,et al.  Feature-Based Attentional Modulations in the Absence of Direct Visual Stimulation , 2007, Neuron.

[53]  J. Gallant,et al.  Identifying natural images from human brain activity , 2008, Nature.

[54]  C. Law,et al.  Neural correlates of perceptual learning in a sensory-motor, but not a sensory, cortical area , 2008, Nature Neuroscience.

[55]  N. Logothetis What we can do and what we cannot do with fMRI , 2008, Nature.

[56]  H. Berg,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S7 Tables S1 to S3 References Movies S1 to S6 Tuned Responses of Astrocytes and Their Influence on Hemodynamic Signals in the Visual Cortex , 2022 .

[57]  J. Maunsell,et al.  Spatial Summation Can Explain the Attentional Modulation of Neuronal Responses to Multiple Stimuli in Area V4 , 2008, The Journal of Neuroscience.

[58]  D. Heeger,et al.  The Normalization Model of Attention , 2009, Neuron.

[59]  Yevgeniy B. Sirotin,et al.  Anticipatory haemodynamic signals in sensory cortex not predicted by local neuronal activity. , 2009, Nature.

[60]  Joonyeol Lee,et al.  A Normalization Model of Attentional Modulation of Single Unit Responses , 2009, PloS one.

[61]  D. Heeger,et al.  Decoding and Reconstructing Color from Responses in Human Visual Cortex , 2009, The Journal of Neuroscience.

[62]  Miranda Scolari,et al.  Estimating the influence of attention on population codes in human visual cortex using voxel-based tuning functions , 2009, NeuroImage.

[63]  Geoffrey M Ghose,et al.  Attentional modulation of visual responses by flexible input gain. , 2009, Journal of neurophysiology.

[64]  J. Serences,et al.  Adaptive Allocation of Attentional Gain , 2009, The Journal of Neuroscience.

[65]  C. Law,et al.  Reinforcement learning can account for associative and perceptual learning on a visual decision task , 2009, Nature Neuroscience.

[66]  J. Serences,et al.  Basing perceptual decisions on the most informative sensory neurons. , 2010, Journal of neurophysiology.

[67]  Andreas Kleinschmidt,et al.  The Blind, the Lame, and the Poor Signals of Brain Function—a Comment on Sirotin and Das (2009) , 2022 .

[68]  Jascha D. Swisher,et al.  Multiscale Pattern Analysis of Orientation-Selective Activity in the Primary Visual Cortex , 2010, The Journal of Neuroscience.

[69]  D. Heeger,et al.  Cross-orientation suppression in human visual cortex. , 2011, Journal of neurophysiology.

[70]  D. Heeger,et al.  Attentional Enhancement via Selection and Pooling of Early Sensory Responses in Human Visual Cortex , 2011, Neuron.

[71]  Jack L. Gallant,et al.  Encoding and decoding in fMRI , 2011, NeuroImage.

[72]  Daniel A. Handwerker,et al.  Simple explanations before complex theories: Alternative interpretations of Sirotin and Das' observations , 2011, NeuroImage.

[73]  Jeremy Freeman,et al.  Orientation Decoding Depends on Maps, Not Columns , 2011, The Journal of Neuroscience.

[74]  M. A. Smith,et al.  Stimulus Selectivity and Spatial Coherence of Gamma Components of the Local Field Potential , 2011, The Journal of Neuroscience.

[75]  Daniel A. Handwerker,et al.  Hemodynamic signals not predicted? Not so: A comment on Sirotin and Das (2009) , 2011, NeuroImage.

[76]  Yevgeniy B. Sirotin,et al.  What could underlie the trial-related signal? A response to the commentaries by Drs. Kleinschmidt and Muller, and Drs. Handwerker and Bandettini , 2011, NeuroImage.

[77]  John T. Serences,et al.  Computational advances towards linking BOLD and behavior , 2012, Neuropsychologia.