Dissociable Effects of Reward on Attentional Learning: From Passive Associations to Active Monitoring

Visual selective attention (VSA) is the cognitive function that regulates ongoing processing of retinal input in order for selected representations to gain privileged access to perceptual awareness and guide behavior, facilitating analysis of currently relevant information while suppressing the less relevant input. Recent findings indicate that the deployment of VSA is shaped according to past outcomes. Targets whose selection has led to rewarding outcomes become relatively easier to select in the future, and distracters that have been ignored with higher gains are more easily discarded. Although outcomes (monetary rewards) were completely predetermined in our prior studies, participants were told that higher rewards would follow more efficient responses. In a new experiment we have eliminated the illusory link between performance and outcomes by informing subjects that rewards were randomly assigned. This trivial yet crucial manipulation led to strikingly different results. Items that were associated more frequently with higher gains became more difficult to ignore, regardless of the role (target or distracter) they played when differential rewards were delivered. Therefore, VSA is shaped by two distinct reward-related learning mechanisms: one requiring active monitoring of performance and outcome, and a second one detecting the sheer association between objects in the environment (whether attended or ignored) and the more-or-less rewarding events that accompany them.

[1]  Marlene Behrmann,et al.  Probability Cuing of Target Location Facilitates Visual Search Implicitly in Normal Participants and Patients with Hemispatial Neglect , 2002, Psychological science.

[2]  Leyre Castro,et al.  Animal learning. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[3]  A. Baddeley Human Memory: Theory and Practice, Revised Edition , 1990 .

[4]  R. Dolan,et al.  Subliminal Instrumental Conditioning Demonstrated in the Human Brain , 2008, Neuron.

[5]  P. Lovibond Facilitation of instrumental behavior by a Pavlovian appetitive conditioned stimulus. , 1983 .

[6]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[7]  A. Dickinson,et al.  Judgement of Act-Outcome Contingency: The Role of Selective Attribution , 1984 .

[8]  M. Chun,et al.  Contextual cueing of visual attention , 2022 .

[9]  Aaron R. Seitz,et al.  Rewards Evoke Learning of Unconsciously Processed Visual Stimuli in Adult Humans , 2009, Neuron.

[10]  D. Shanks Learning: from association to cognition. , 2010, Annual review of psychology.

[11]  J. Duncan EPS Mid-Career Award 2004: Brain mechanisms of attention , 2006, Quarterly journal of experimental psychology.

[12]  J. Raymond,et al.  Selective Visual Attention and Motivation , 2009, Psychological science.

[13]  W. Schneider,et al.  Automatic attraction of attention to former targets in visual displays of letters , 2001, Perception & psychophysics.

[14]  Wilfried Kunde,et al.  Location-specific target expectancies in visual search , 1999 .

[15]  A. Baron,et al.  Effects of instructions and reinforcement-feedback on human operant behavior maintained by fixed-interval reinforcement. , 1969, Journal of the experimental analysis of behavior.

[16]  H. Pashler,et al.  The Psychology of Attention , 2000 .

[17]  M. Mishkin,et al.  Learning increases stimulus salience in anterior inferior temporal cortex of the macaque. , 2001, Journal of neurophysiology.

[18]  Gordon D Logan,et al.  An instance theory of attention and memory. , 2002, Psychological review.

[19]  D. Shanks Associationism and cognition: Human contingency learning at 25 , 2007, Quarterly journal of experimental psychology.

[20]  Pearce Animal learning and cognition , 1997 .

[21]  Yi-Yuan Tang,et al.  Attention training and attention state training , 2009, Trends in Cognitive Sciences.

[22]  L. Chelazzi,et al.  Visual Selective Attention and the Effects of Monetary Rewards , 2006, Psychological science.

[23]  Aaron R. Seitz,et al.  Dissociable Neural Effects of Long-term Stimulus–Reward Pairing in Macaque Visual Cortex , 2010, Journal of Cognitive Neuroscience.

[24]  George Sperling,et al.  Long-lasting sensitization to a given colour after visual search , 2004, Nature.

[25]  T. A. Kelley,et al.  Learning to attend: effects of practice on information selection. , 2009, Journal of vision.

[26]  G. Campana,et al.  Where perception meets memory: A review of repetition priming in visual search tasks , 2010, Attention, perception & psychophysics.

[27]  L. Chelazzi,et al.  Behavioral/systems/cognitive Reward Changes Salience in Human Vision via the Anterior Cingulate , 2022 .

[28]  A. Mizuno,et al.  A change of the leading player in flow Visualization technique , 2006, J. Vis..

[29]  Jan Theeuwes,et al.  Reward Guides Vision when It's Your Thing: Trait Reward-Seeking in Reward-Mediated Visual Priming , 2010, PloS one.

[30]  M. Chun,et al.  Top-Down Attentional Guidance Based on Implicit Learning of Visual Covariation , 1999 .

[31]  M. Chun,et al.  Interactions between attention and memory , 2007, Current Opinion in Neurobiology.

[32]  M. Delgado,et al.  Modulation of Caudate Activity by Action Contingency , 2004, Neuron.

[33]  Jon Driver,et al.  Reward Priority of Visual Target Singletons Modulates Event-Related Potential Signatures of Attentional Selection , 2009, Psychological science.

[34]  P. Lovibond Facilitation of instrumental behavior by a Pavlovian appetitive conditioned stimulus. , 1983, Journal of experimental psychology. Animal behavior processes.

[35]  R. Desimone,et al.  Neural mechanisms for visual memory and their role in attention. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[36]  Jay Pratt,et al.  Learning to ignore: Acquisition of sustained attentional suppression , 2009, Psychonomic bulletin & review.

[37]  M. Chun,et al.  Contextual Cueing: Implicit Learning and Memory of Visual Context Guides Spatial Attention , 1998, Cognitive Psychology.

[38]  Julie D. Golomb,et al.  A taxonomy of external and internal attention. , 2011, Annual review of psychology.

[39]  J. de Houwer,et al.  Associative learning of likes and dislikes: a review of 25 years of research on human evaluative conditioning. , 2001, Psychological bulletin.

[40]  Nathaniel J. Blair,et al.  Blocking and backward blocking involve learned inattention , 2000, Psychonomic bulletin & review.

[41]  R. Shiffrin,et al.  Controlled and automatic human information processing: I , 1977 .

[42]  J. O'Doherty,et al.  Reward representations and reward-related learning in the human brain: insights from neuroimaging , 2004, Current Opinion in Neurobiology.

[43]  Daniel W. Hommer,et al.  Anticipating instrumentally obtained and passively-received rewards: A factorial fMRI investigation , 2007, Behavioural Brain Research.

[44]  J. Driver,et al.  Rewarding Feedback After Correct Visual Discriminations Has Both General and Specific Influences on Visual Cortex , 2010, Journal of neurophysiology.

[45]  C. L. M. The Psychology of Attention , 1890, Nature.

[46]  T. A. Kelley,et al.  Human Neuroscience , 2022 .

[47]  M. Chun,et al.  Selective attention modulates implicit learning , 2001, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[48]  J. Reynolds,et al.  Attentional modulation of visual processing. , 2004, Annual review of neuroscience.

[49]  Jon Driver,et al.  Fortune and reversals of fortune in visual search: Reward contingencies for pop-out targets affect search efficiency and target repetition effects , 2010, Attention, perception & psychophysics.

[50]  L. Chelazzi,et al.  Learning to Attend and to Ignore Is a Matter of Gains and Losses , 2009, Psychological science.

[51]  J Miller,et al.  Components of the location probability effect in visual search tasks. , 1988, Journal of experimental psychology. Human perception and performance.

[52]  A. Field,et al.  Associative learning of likes and dislikes: Some current controversies and possible ways forward , 2005, Cognition & emotion.

[53]  Jan Theeuwes,et al.  Please Scroll down for Article Visual Cognition Reward Has a Residual Impact on Target Selection in Visual Search, but Not on the Suppression of Distractors , 2022 .

[54]  Vivian M Ciaramitaro,et al.  Stimulus probability directs spatial attention: an enhancement of sensitivity in humans and monkeys , 2001, Vision Research.

[55]  M C Newland,et al.  Effects of self-generated rules on the development of schedule-controlled behavior. , 1992, Journal of the experimental analysis of behavior.

[56]  H. Carr The laws of association. , 1931 .

[57]  Christopher J. Peck,et al.  Reward Modulates Attention Independently of Action Value in Posterior Parietal Cortex , 2009, The Journal of Neuroscience.

[58]  W. Schultz Behavioral theories and the neurophysiology of reward. , 2006, Annual review of psychology.

[59]  D. Shanks,et al.  Human instrumental learning: a critical review of data and theory. , 1993, British journal of psychology.

[60]  Z. Vidnyánszky,et al.  Learning to suppress task-irrelevant visual stimuli with attention , 2005, Vision Research.

[61]  Hélène S. Hakyemez,et al.  Striatal dopamine transmission in healthy humans during a passive monetary reward task , 2008, NeuroImage.

[62]  David E. Greenway,et al.  Instructions, multiple schedules, and extinction: Distinguishing rule-governed from schedule-controlled behavior. , 1986, Journal of the experimental analysis of behavior.

[63]  S. Yantis,et al.  Visual attention: control, representation, and time course. , 1997, Annual review of psychology.

[64]  N. Schmajuk Animal learning and cognition , 1997 .