Attention amplifies neural representations of changes in sensory input at the expense of perceptual accuracy

Attention enhances the neural representations of behaviorally relevant stimuli, typically by a push–pull increase of the neuronal response gain to attended vs. unattended stimuli. This selectively improves perception and consequently behavioral performance. However, to enhance the detectability of stimulus changes, attention might also distort neural representations, compromising accurate stimulus representation. We test this hypothesis by recording neural responses in the visual cortex of rhesus monkeys during a motion direction change detection task. We find that attention indeed amplifies the neural representation of direction changes, beyond a similar effect of adaptation. We further show that humans overestimate such direction changes, providing a perceptual correlate of our neurophysiological observations. Our results demonstrate that attention distorts the neural representations of abrupt sensory changes and consequently perceptual accuracy. This likely represents an evolutionary adaptive mechanism that allows sensory systems to flexibly forgo accurate representation of stimulus features to improve the encoding of stimulus change. We allocate attention to relevant sensory stimuli to enhance their neural processing. Here, the authors show that attention, like adaptation, causes a misrepresentation and misperception of visual changes in our environment in cases where this aids the perceptual task at hand.

[1]  M. Carrasco,et al.  The locus of attentional effects in texture segmentation , 2000, Nature Neuroscience.

[2]  J. Maunsell,et al.  Attention improves performance primarily by reducing interneuronal correlations , 2009, Nature Neuroscience.

[3]  Detlef Wegener,et al.  Transient activity in monkey area MT represents speed changes and is correlated with human behavioral performance. , 2015, Journal of neurophysiology.

[4]  Stefan Treue,et al.  Feature-based attention influences motion processing gain in macaque visual cortex , 1999, Nature.

[5]  J. Maunsell,et al.  Attention-related changes in correlated neuronal activity arise from normalization mechanisms , 2017, Nature Neuroscience.

[6]  E. Cook,et al.  The Functional Link between Area MT Neural Fluctuations and Detection of a Brief Motion Stimulus , 2011, The Journal of Neuroscience.

[7]  M. Morgan,et al.  Visual Search for a Tilted Target: Tests of Spatial Uncertainty Models , 1998, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[8]  Marisa Carrasco,et al.  Spatial attention alters visual appearance. , 2019, Current opinion in psychology.

[9]  S. Treue,et al.  Attention Decreases Phase-Amplitude Coupling, Enhancing Stimulus Discriminability in Cortical Area MT , 2015, Front. Neural Circuits.

[10]  S. Solomon,et al.  Moving Sensory Adaptation beyond Suppressive Effects in Single Neurons , 2014, Current Biology.

[11]  S. Treue,et al.  Basic Neuroscience Research with Nonhuman Primates: A Small but Indispensable Component of Biomedical Research , 2014, Neuron.

[12]  D. Bradley,et al.  Structure and function of visual area MT. , 2005, Annual review of neuroscience.

[13]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[14]  William T. Newsome,et al.  Cortical microstimulation influences perceptual judgements of motion direction , 1990, Nature.

[15]  Ronald A. Rensink,et al.  Change blindness: past, present, and future , 2005, Trends in Cognitive Sciences.

[16]  S. Treue Neural correlates of attention in primate visual cortex , 2001, Trends in Neurosciences.

[17]  Geoffrey M Ghose,et al.  Temporal precision of neuronal information in a rapid perceptual judgment. , 2009, Journal of neurophysiology.

[18]  M. Carrasco,et al.  Covert attention affects the psychometric function of contrast sensitivity , 2002, Vision Research.

[19]  Christopher C. Pack,et al.  Bidirectional manipulation of GABAergic inhibition in MT: A comparison of neuronal and psychophysical performance , 2014 .

[20]  F Mechler,et al.  Robust Temporal Coding of Contrast by V1 Neurons for Transient But Not for Steady-State Stimuli , 1998, The Journal of Neuroscience.

[21]  Nicholas V. Swindale,et al.  Orientation tuning curves: empirical description and estimation of parameters , 1998, Biological Cybernetics.

[22]  J. Martinez-Trujillo,et al.  Effects of attention and distractor contrast on the responses of middle temporal area neurons to transient motion direction changes , 2015, The European journal of neuroscience.

[23]  Katsumi Aoki,et al.  Recent development of flow visualization , 2004, J. Vis..

[24]  K. H. Britten,et al.  A relationship between behavioral choice and the visual responses of neurons in macaque , 2008 .

[25]  M. Carrasco,et al.  Attention alters appearance , 2004, Nature Neuroscience.

[26]  Kim Borron,et al.  THE PAST 25 YEARS , 2000 .

[27]  E. Seidemann,et al.  Effect of spatial attention on the responses of area MT neurons. , 1999, Journal of neurophysiology.

[28]  S. Thorpe,et al.  Dynamics of orientation coding in area V1 of the awake primate , 1993, Visual Neuroscience.

[29]  Stefan Treue,et al.  Distracter suppression dominates attentional modulation of responses to multiple stimuli inside the receptive fields of middle temporal neurons , 2017, The European journal of neuroscience.

[30]  J. Maunsell,et al.  Effects of Attention on the Processing of Motion in Macaque Middle Temporal and Medial Superior Temporal Visual Cortical Areas , 1999, The Journal of Neuroscience.

[31]  S. Treue,et al.  Strategic deployment of feature-based attentional gain in primate visual cortex , 2019, PLoS biology.

[32]  D. Holdstock Past, present--and future? , 2005, Medicine, conflict, and survival.

[33]  Stefan Treue,et al.  An Attention-Sensitive Memory Trace in Macaque MT Following Saccadic Eye Movements , 2016, PLoS biology.

[34]  K. H. Britten,et al.  A relationship between behavioral choice and the visual responses of neurons in macaque MT , 1996, Visual Neuroscience.

[35]  Amy M. Ni,et al.  Tuned Normalization Explains the Size of Attention Modulations , 2012, Neuron.

[36]  M. Carrasco Visual attention: The past 25 years , 2011, Vision Research.

[37]  John H. R. Maunsell,et al.  Neuronal Mechanisms of Visual Attention. , 2015, Annual review of vision science.

[38]  H. Seung,et al.  Tilt aftereffect and adaptation-induced changes in orientation tuning in visual cortex. , 2005, Journal of neurophysiology.

[39]  A. Kreiter,et al.  Monkey Area MT Latencies to Speed Changes Depend on Attention and Correlate with Behavioral Reaction Times , 2013, Neuron.

[40]  G. Orban,et al.  Response latency of macaque area MT/V5 neurons and its relationship to stimulus parameters. , 1999, Journal of neurophysiology.

[41]  Thomas Zhihao Luo,et al.  Neuronal Modulations in Visual Cortex Are Associated with Only One of Multiple Components of Attention , 2015, Neuron.

[42]  Thomas Zhihao Luo,et al.  Attentional Changes in Either Criterion or Sensitivity Are Associated with Robust Modulations in Lateral Prefrontal Cortex , 2018, Neuron.

[43]  J. Movshon,et al.  The analysis of visual motion: a comparison of neuronal and psychophysical performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[44]  J. Assad,et al.  Neural Activity in the Middle Temporal Area and Lateral Intraparietal Area during Endogenously Cued Shifts of Attention , 2009, The Journal of Neuroscience.

[45]  M. Carrasco,et al.  The contribution of covert attention to the set-size and eccentricity effects in visual search. , 1998, Journal of experimental psychology. Human perception and performance.

[46]  Stefan Treue,et al.  Revisiting motion repulsion: evidence for a general phenomenon? , 1999, Vision Research.

[47]  J. Movshon,et al.  Adaptation changes the direction tuning of macaque MT neurons , 2004, Nature Neuroscience.

[48]  Stefan Treue,et al.  Reference Repulsion When Judging the Direction of Visual Motion , 1998, Perception.

[49]  John H. R. Maunsell,et al.  Dynamics of neuronal responses in macaque MT and VIP during motion detection , 2002, Nature Neuroscience.

[50]  Mohammad Reza Daliri,et al.  Routing information flow by separate neural synchrony frequencies allows for “functionally labeled lines” in higher primate cortex , 2019, Proceedings of the National Academy of Sciences.

[51]  M. Carrasco,et al.  How do attention and adaptation affect contrast sensitivity? , 2007, Journal of vision.

[52]  Christopher C. Pack,et al.  Temporal dynamics of a neural solution to the aperture problem in visual area MT of macaque brain , 2001, Nature.

[53]  Yaffa Yeshurun,et al.  Covert attention increases spatial resolution with or without masks: support for signal enhancement. , 2002, Journal of vision.

[54]  Dissecting Modulatory Effects of Visual Attention in Primate Lateral Prefrontal Cortex Using Signal Detection Theory , 2018, Neuron.

[55]  R. Born,et al.  Timescales of Sensory- and Decision-Related Activity in the Middle Temporal and Medial Superior Temporal Areas , 2010, The Journal of Neuroscience.

[56]  M. Livingstone,et al.  Neuronal correlates of visibility and invisibility in the primate visual system , 1998, Nature Neuroscience.

[57]  John H. R. Maunsell,et al.  Attentional modulation of visual motion processing in cortical areas MT and MST , 1996, Nature.

[58]  K. Nakayama,et al.  Sustained and transient components of focal visual attention , 1989, Vision Research.

[59]  Patrick E. Shrout,et al.  Should Significance Tests be Banned? Introduction to a Special Section Exploring the Pros and Cons , 1997 .

[60]  Marisa Carrasco,et al.  Attention improves or impairs visual performance by enhancing spatial resolution , 1998, Nature.

[61]  W. Merigan,et al.  Motion perception following lesions of the superior temporal sulcus in the monkey. , 1994, Cerebral cortex.

[62]  R. Born,et al.  Adaptation to Speed in Macaque Middle Temporal and Medial Superior Temporal Areas , 2013, The Journal of Neuroscience.