Reward- and Attention-related Biasing of Sensory Selection in Visual Cortex

Attention to task-relevant features leads to a biasing of sensory selection in extrastriate cortex. Features signaling reward seem to produce a similar bias, but how modulatory effects due to reward and attention relate to each other is largely unexplored. To address this issue, it is critical to separate top–down settings defining reward relevance from those defining attention. To this end, we used a visual search paradigm in which the target's definition (attention to color) was dissociated from reward relevance by delivering monetary reward on search frames where a certain task-irrelevant color was combined with the target-defining color to form the target object. We assessed the state of neural biasing for the attended and reward-relevant color by analyzing the neuromagnetic brain response to asynchronously presented irrelevant distractor probes drawn in the target-defining color, the reward-relevant color, and a completely irrelevant color as a reference. We observed that for the prospect of moderate rewards, the target-defining color but not the reward-relevant color produced a selective enhancement of the neuromagnetic response between 180 and 280 msec in ventral extrastriate visual cortex. Increasing reward prospect caused a delayed attenuation (220–250 msec) of the response to reward probes, which followed a prior (160–180 msec) response enhancement in dorsal ACC. Notably, shorter latency responses in dorsal ACC were associated with stronger attenuation in extrastriate visual cortex. Finally, an analysis of the brain response to the search frames revealed that the presence of the reward-relevant color in search distractors elicited an enhanced response that was abolished after increasing reward size. The present data together indicate that when top–down definitions of reward relevance and attention are separated, the behavioral significance of reward-associated features is still rapidly coded in higher-level cortex areas, thereby commanding effective top–down inhibitory control to counter a selection bias for those features in extrastriate visual cortex.

[1]  C Alain,et al.  Attentional set modulates visual areas: an event-related potential study of attentional capture. , 2001, Brain research. Cognitive brain research.

[2]  Pierre Jolicoeur,et al.  Tracking the Location of Visuospatial Attention in a Contingent Capture Paradigm , 2008, Journal of Cognitive Neuroscience.

[3]  Barry Giesbrecht,et al.  Neural evidence reveals the rapid effects of reward history on selective attention , 2015, Brain Research.

[4]  C. N. Boehler,et al.  Task-Load-Dependent Activation of Dopaminergic Midbrain Areas in the Absence of Reward , 2011, The Journal of Neuroscience.

[5]  B. Gibson,et al.  Attraction, Distraction and Action: Multiple Perspectives on Attentional Capture. Advances in Psychology , 2001 .

[6]  E. Maylor,et al.  Inhibitory component of externally controlled covert orienting in visual space. , 1985, Journal of experimental psychology. Human perception and performance.

[7]  M. Woldorff,et al.  Dorsal anterior cingulate cortex resolves conflict from distracting stimuli by boosting attention toward relevant events. , 2004, Cerebral cortex.

[8]  L. Chelazzi,et al.  Behavioral/systems/cognitive Reward Changes Salience in Human Vision via the Anterior Cingulate , 2022 .

[9]  S. Hillyard,et al.  Involvement of striate and extrastriate visual cortical areas in spatial attention , 1999, Nature Neuroscience.

[10]  M. Bear,et al.  Reward Timing in the Primary Visual Cortex , 2006, Science.

[11]  Steven J Luck,et al.  Capture versus suppression of attention by salient singletons: Electrophysiological evidence for an automatic attend-to-me signal , 2010, Attention, perception & psychophysics.

[12]  Carsten Nicolas Boehler,et al.  Electrophysiological evidence for the involvement of proactive and reactive control in a rewarded stop-signal task , 2015, NeuroImage.

[13]  Jon Driver,et al.  Reward Priority of Visual Target Singletons Modulates Event-Related Potential Signatures of Attentional Selection , 2009, Psychological science.

[14]  Katherine M. Armstrong,et al.  Visuomotor Origins of Covert Spatial Attention , 2003, Neuron.

[15]  H. Egeth,et al.  Overriding stimulus-driven attentional capture , 1994, Perception & psychophysics.

[16]  Kristina M. Visscher,et al.  A Core System for the Implementation of Task Sets , 2006, Neuron.

[17]  John M. Pearson,et al.  Fictive Reward Signals in the Anterior Cingulate Cortex , 2009, Science.

[18]  Richard P. Heitz,et al.  On the origin of event-related potentials indexing covert attentional selection during visual search. , 2009, Journal of neurophysiology.

[19]  J. Theeuwes,et al.  Electrophysiological Evidence of the Capture of Visual Attention , 2006, Journal of Cognitive Neuroscience.

[20]  Stefan Treue,et al.  Feature-based attention influences motion processing gain in macaque visual cortex , 1999, Nature.

[21]  S. Luck,et al.  Neural sources of focused attention in visual search. , 2000, Cerebral cortex.

[22]  E. Vogel,et al.  Human Variation in Overriding Attentional Capture , 2009, The Journal of Neuroscience.

[23]  Aaron R. Seitz,et al.  Dissociable Neural Effects of Long-term Stimulus–Reward Pairing in Macaque Visual Cortex , 2010, Journal of Cognitive Neuroscience.

[24]  K. Nelissen,et al.  Dopaminergic Reward Signals Selectively Decrease fMRI Activity in Primate Visual Cortex , 2013, Neuron.

[25]  M. Eimer,et al.  Goal-driven attentional capture by invisible colors: Evidence from event-related potentials , 2009, Psychonomic bulletin & review.

[26]  M. Posner,et al.  Components of visual orienting , 1984 .

[27]  Charles L. Folk,et al.  Contingent attentional capture or delayed allocation of attention? , 2001, Perception & psychophysics.

[28]  Keiji Tanaka,et al.  Conflict-induced behavioural adjustment: a clue to the executive functions of the prefrontal cortex , 2009, Nature Reviews Neuroscience.

[29]  J. Theeuwes,et al.  Attentional and oculomotor capture , 2001 .

[30]  T. Moore,et al.  CONTROL OF VISUAL CORTICAL SIGNALS BY PREFRONTAL DOPAMINE , 2011, Nature.

[31]  S. Haber,et al.  The Reward Circuit: Linking Primate Anatomy and Human Imaging , 2010, Neuropsychopharmacology.

[32]  R W Remington,et al.  The structure of attentional control: contingent attentional capture by apparent motion, abrupt onset, and color. , 1994, Journal of experimental psychology. Human perception and performance.

[33]  Dominique Lamy,et al.  Effects of task relevance and stimulus-driven salience in feature-search mode. , 2004, Journal of experimental psychology. Human perception and performance.

[34]  S. Luck,et al.  Attention to Features Precedes Attention to Locations in Visual Search: Evidence from Electromagnetic Brain Responses in Humans , 2004, The Journal of Neuroscience.

[35]  John H. R. Maunsell,et al.  Feature-based attention in visual cortex , 2006, Trends in Neurosciences.

[36]  Martin Eimer,et al.  Involuntary Attentional Capture is Determined by Task Set: Evidence from Event-related Brain Potentials , 2008, Journal of Cognitive Neuroscience.

[37]  Patrik Vuilleumier,et al.  Affective and motivational control of vision. , 2015, Current opinion in neurology.

[38]  R. Desimone,et al.  Responses of Neurons in Inferior Temporal Cortex during Memory- Guided Visual Search , 1998 .

[39]  B. Anderson The attention habit: how reward learning shapes attentional selection , 2016, Annals of the New York Academy of Sciences.

[40]  Andri S. Björnsson,et al.  Money talks in attention bias modification: Reward in a dot-probe task affects attentional biases , 2015 .

[41]  Leslie G. Ungerleider,et al.  Mechanisms of visual attention in the human cortex. , 2000, Annual review of neuroscience.

[42]  S. Treue Neural correlates of attention in primate visual cortex , 2001, Trends in Neurosciences.

[43]  B. B. Lee,et al.  The physiological basis of heterochromatic flicker photometry demonstrated in the ganglion cells of the macaque retina. , 1988, The Journal of physiology.

[44]  Patryk A. Laurent,et al.  Value-driven attentional capture , 2011, Proceedings of the National Academy of Sciences.

[45]  L. M. Warner,et al.  The Neural Mechanisms for Minimizing Cross-Modal Distraction , 2004, The Journal of Neuroscience.

[46]  M. Gazzaniga,et al.  Combined spatial and temporal imaging of brain activity during visual selective attention in humans , 1994, Nature.

[47]  Hans-Jochen Heinze,et al.  Localizing visual discrimination processes in time and space. , 2002, Journal of neurophysiology.

[48]  W. Zoest,et al.  Reward creates oculomotor salience , 2012, Current Biology.

[49]  Simon Hong,et al.  New Insights on the Subcortical Representation of Reward This Review Comes from a Themed Issue on Cognitive Neuroscience Edited Lateral Habenula Serotonin Neurons , 2022 .

[50]  B. Gibson,et al.  Stimulus-driven attentional capture is contingent on attentional set for displaywide visual features. , 1998, Journal of experimental psychology. Human perception and performance.

[51]  B. C. Motter,et al.  Neural correlates of feature selective memory and pop-out in extrastriate area V4 , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[52]  M. Peelen,et al.  Neural Mechanisms of Incentive Salience in Naturalistic Human Vision , 2015, Neuron.

[53]  J. Theeuwes Top-down and bottom-up control of visual selection. , 2010, Acta psychologica.

[54]  Okihide Hikosaka,et al.  Reward-Dependent Gain and Bias of Visual Responses in Primate Superior Colliculus , 2003, Neuron.

[55]  Jonathan D. Cohen,et al.  Conflict monitoring and anterior cingulate cortex: an update , 2004, Trends in Cognitive Sciences.

[56]  George R. Mangun,et al.  Reflexive Attention Modulates Processing of Visual Stimuli in Human Extrastriate Cortex , 1998, Psychological science.

[57]  Junying Yuan,et al.  Selective gating of visual signals by microstimulation of frontal cortex , 2022 .

[58]  R A Abrams,et al.  Color-based inhibition of return , 1995, Perception & psychophysics.

[59]  J. Martinez-Trujillo,et al.  Strength of Response Suppression to Distracter Stimuli Determines Attentional-Filtering Performance in Primate Prefrontal Neurons , 2011, Neuron.

[60]  John T Serences,et al.  Value-Based Modulations in Human Visual Cortex , 2008, Neuron.

[61]  R. Klein,et al.  Inhibition of return , 2000, Trends in Cognitive Sciences.

[62]  W. Schultz Multiple reward signals in the brain , 2000, Nature Reviews Neuroscience.

[63]  Steven J Luck,et al.  Active suppression of distractors that match the contents of visual working memory , 2011, Visual cognition.

[64]  Mircea Ariel Schoenfeld,et al.  The modulatory impact of reward and attention on global feature selection in human visual cortex , 2015 .

[65]  Tom Eichele,et al.  Posterior Medial Frontal Cortex Activity Predicts Post-Error Adaptations in Task-Related Visual and Motor Areas , 2011, The Journal of Neuroscience.

[66]  Eric Ruthruff,et al.  Contingent attentional capture by top-down control settings: converging evidence from event-related potentials. , 2008, Journal of experimental psychology. Human perception and performance.

[67]  Martin Eimer,et al.  Attentional capture by visual singletons is mediated by top-down task set: new evidence from the N2pc component. , 2008, Psychophysiology.

[68]  D. Guthrie,et al.  Significance testing of difference potentials. , 1991, Psychophysiology.

[69]  J. Maunsell Neuronal representations of cognitive state: reward or attention? , 2004, Trends in Cognitive Sciences.

[70]  Jon Driver,et al.  Fortune and reversals of fortune in visual search: Reward contingencies for pop-out targets affect search efficiency and target repetition effects , 2010, Attention, perception & psychophysics.

[71]  S. Yantis 2. Attentional capture in vision , 1996 .

[72]  Anthony J. Ries,et al.  Automatic Versus Contingent Mechanisms of Sensory-Driven Neural Biasing and Reflexive Attention , 2005, Journal of Cognitive Neuroscience.

[73]  J. Martinez-Trujillo,et al.  Strength of Response Suppression to Distracter Stimuli Determines Attentional-Filtering Performance in Primate Prefrontal Neurons , 2011, Neuron.

[74]  Vincent Di Lollo,et al.  Electrophysiological Indices of Target and Distractor Processing in Visual Search , 2009, Journal of Cognitive Neuroscience.

[75]  Stefan Treue,et al.  Spatial and feature-based effects of exogenous cueing on visual motion processing , 2006, Vision Research.

[76]  T. Moore,et al.  Microstimulation of the frontal eye field and its effects on covert spatial attention. , 2004, Journal of neurophysiology.

[77]  J. Driver,et al.  Rewarding Feedback After Correct Visual Discriminations Has Both General and Specific Influences on Visual Cortex , 2010, Journal of neurophysiology.

[78]  H Egeth,et al.  Consequences of allocating attention to locations and to other attributes , 1992, Perception & psychophysics.

[79]  E. Vogel,et al.  Sensory gain control (amplification) as a mechanism of selective attention: electrophysiological and neuroimaging evidence. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[80]  Joshua W. Brown,et al.  Monitoring and Control of Action by the Frontal Lobes , 2002, Neuron.

[81]  J. C. Johnston,et al.  Involuntary covert orienting is contingent on attentional control settings. , 1992, Journal of experimental psychology. Human perception and performance.