Pavlovian reward learning underlies value driven attentional capture

Recent evidence shows that distractors that signal high compared to low reward availability elicit stronger attentional capture, even when this is detrimental for task-performance. This suggests that simply correlating stimuli with reward administration, rather than their instrumental relationship with obtaining reward, produces value-driven attentional capture. However, in previous studies, reward delivery was never response independent, as only correct responses were rewarded, nor was it completely task-irrelevant, as the distractor signaled the magnitude of reward that could be earned on that trial. In two experiments, we ensured that associative reward learning was completely response independent by letting participants perform a task at fixation, while high and low rewards were automatically administered following the presentation of task-irrelevant colored stimuli in the periphery (Experiment 1) or at fixation (Experiment 2). In a following non-reward test phase, using the additional singleton paradigm, the previously reward signaling stimuli were presented as distractors to assess truly task-irrelevant value driven attentional capture. The results showed that high compared to low reward-value associated distractors impaired performance, and thus captured attention more strongly. This suggests that genuine Pavlovian conditioning of stimulus-reward contingencies is sufficient to obtain value-driven attentional capture. Furthermore, value-driven attentional capture can occur following associative reward learning of temporally and spatially task-irrelevant distractors that signal the magnitude of available reward (Experiment 1), and is independent of training spatial shifts of attention towards the reward signaling stimuli (Experiment 2). This confirms and strengthens the idea that Pavlovian reward learning underlies value driven attentional capture.

[1]  L. Chelazzi,et al.  Rewards teach visual selective attention , 2013, Vision Research.

[2]  Steven B. Most,et al.  Cognitive control and counterproductive oculomotor capture by reward-related stimuli , 2015 .

[3]  Tom Beesley,et al.  When goals conflict with values: counterproductive attentional and oculomotor capture by reward-related stimuli. , 2015, Journal of experimental psychology. General.

[4]  D. Gitelman,et al.  Monetary incentives enhance processing in brain regions mediating top-down control of attention. , 2005, Cerebral cortex.

[5]  Jane E. Raymond,et al.  How Attention Changes in Response to Incentives , 2015, Journal of Cognitive Neuroscience.

[6]  G. Campana,et al.  Where perception meets memory: A review of repetition priming in visual search tasks , 2010, Attention, perception & psychophysics.

[7]  L. Pessoa,et al.  Embedding Reward Signals into Perception and Cognition , 2010, Front. Neurosci..

[8]  James T. Townsend,et al.  Methods of Modeling Capacity in Simple Processing Systems , 2014 .

[9]  Gisella K. Diaz,et al.  Irrelevant learned reward associations disrupt voluntary spatial attention , 2016, Attention, perception & psychophysics.

[10]  Jan Theeuwes,et al.  Exogenous visual orienting by reward. , 2014, Journal of vision.

[11]  J. Theeuwes Perceptual selectivity for color and form , 1992, Perception & psychophysics.

[12]  Jan Theeuwes,et al.  Oculomotor capture by stimuli that signal the availability of reward. , 2015, Journal of neurophysiology.

[13]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[14]  M. Botvinick,et al.  Motivation and cognitive control: from behavior to neural mechanism. , 2015, Annual review of psychology.

[15]  Jan Theeuwes,et al.  Reward Guides Vision when It's Your Thing: Trait Reward-Seeking in Reward-Mediated Visual Priming , 2010, PloS one.

[16]  M. Brysbaert,et al.  Combining speed and accuracy in cognitive psychology: Is the inverse efficiency score (IES) a better dependent variable than the mean reaction time (RT) and the percentage of errors (PE)? , 2011 .

[17]  Claus Bundesen,et al.  Visual selective attention , 1995 .

[18]  Steven Yantis,et al.  Learned Value Magnifies Salience-Based Attentional Capture , 2011, PloS one.

[19]  Julie D. Golomb,et al.  A taxonomy of external and internal attention. , 2011, Annual review of psychology.

[20]  J. Theeuwes Top-down and bottom-up control of visual selection. , 2010, Acta psychologica.

[21]  Sarah Shomstein,et al.  Shaping Attention With Reward , 2013, Psychological science.

[22]  Christopher J. Mitchell,et al.  Attention and associative learning in humans: An integrative review. , 2016, Psychological bulletin.

[23]  T. Egner,et al.  The Neural Underpinnings of How Reward Associations Can Both Guide and Misguide Attention , 2011, The Journal of Neuroscience.

[24]  Jan Theeuwes,et al.  Reward can modulate attentional capture, independent of top-down set , 2015, Attention, perception & psychophysics.

[25]  Jan Theeuwes,et al.  Reward modulates oculomotor competition between differently valued stimuli , 2015, Vision Research.

[26]  J. Theeuwes,et al.  Distractors that signal reward attract the eyes , 2015 .

[27]  The effect of reward on orienting and reorienting in exogenous cuing , 2014, Cognitive, affective & behavioral neuroscience.

[28]  Jan Theeuwes,et al.  Effects of reward on oculomotor control. , 2016, Journal of neurophysiology.

[29]  Jon Driver,et al.  Reward Priority of Visual Target Singletons Modulates Event-Related Potential Signatures of Attentional Selection , 2009, Psychological science.

[30]  B. Skinner Superstition in the pigeon. , 1948, Journal of experimental psychology.

[31]  James T. Townsend,et al.  The Stochastic Modeling of Elementary Psychological Processes , 1983 .

[32]  L. Chelazzi,et al.  Learning to Attend and to Ignore Is a Matter of Gains and Losses , 2009, Psychological science.

[33]  J. Saiki,et al.  Task-irrelevant stimulus-reward association induces value-driven attentional capture , 2015, Attention, perception & psychophysics.

[34]  Patryk A. Laurent,et al.  Value-driven attentional capture , 2011, Proceedings of the National Academy of Sciences.

[35]  J. Theeuwes,et al.  Top-down versus bottom-up attentional control: a failed theoretical dichotomy , 2012, Trends in Cognitive Sciences.

[36]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[37]  L. Chelazzi,et al.  Behavioral/systems/cognitive Reward Changes Salience in Human Vision via the Anterior Cingulate , 2022 .

[38]  B. Anderson The attention habit: how reward learning shapes attentional selection , 2016, Annals of the New York Academy of Sciences.

[39]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[40]  J. Theeuwes,et al.  Appetitive and aversive outcome associations modulate exogenous cueing , 2016, Attention, perception & psychophysics.

[41]  B. Anderson A value-driven mechanism of attentional selection. , 2013, Journal of vision.

[42]  Jan Theeuwes,et al.  OpenSesame: An open-source, graphical experiment builder for the social sciences , 2011, Behavior Research Methods.

[43]  L. Chelazzi,et al.  Visual Selective Attention and the Effects of Monetary Rewards , 2006, Psychological science.

[44]  L. Pessoa How do emotion and motivation direct executive control? , 2009, Trends in Cognitive Sciences.