Reward Modulates Attention Independently of Action Value in Posterior Parietal Cortex

While numerous studies have explored the mechanisms of reward-based decisions (the choice of action based on expected gain), few have asked how reward influences attention (the selection of information relevant for a decision). Here we show that a powerful determinant of attentional priority is the association between a stimulus and an appetitive reward. A peripheral cue heralded the delivery of reward or no reward (these cues are termed herein RC+ and RC−, respectively); to experience the predicted outcome, monkeys made a saccade to a target that appeared unpredictably at the same or opposite location relative to the cue. Although the RC had no operant associations (did not specify the required saccade), they automatically biased attention, such that an RC+ attracted attention and an RC− repelled attention from its location. Neurons in the lateral intraparietal area (LIP) encoded these attentional biases, maintaining sustained excitation at the location of an RC+ and inhibition at the location of an RC−. Contrary to the hypothesis that LIP encodes action value, neurons did not encode the expected reward of the saccade. Moreover, at odds with an adaptive decision process, the cue-evoked biases interfered with the required saccade, and these biases increased rather than abating with training. After prolonged training, valence selectivity appeared at shorter latencies and automatically transferred to a novel task context, suggesting that training produced visual plasticity. The results suggest that reward predictors gain automatic attentional priority regardless of their operant associations, and this valence-specific priority is encoded in LIP independently of the expected reward of an action.

[1]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[2]  N. P. Bichot,et al.  Visual feature selectivity in frontal eye fields induced by experience in mature macaques , 1996, Nature.

[3]  S. Wise,et al.  Evolution of Directional Preferences in the Supplementary Eye Field during Acquisition of Conditional Oculomotor Associations , 1996, The Journal of Neuroscience.

[4]  John H. R. Maunsell,et al.  Shape selectivity in primate lateral intraparietal cortex , 1998, Nature.

[5]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[6]  E. Miller,et al.  Neural Activity in the Primate Prefrontal Cortex during Associative Learning , 1998, Neuron.

[7]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[8]  M. Goldberg,et al.  Activity of neurons in the lateral intraparietal area of the monkey during an antisaccade task , 1999, Nature Neuroscience.

[9]  Wolfram Schultz,et al.  Behavioral reactions reflecting differential reward expectations in monkeys , 2001, Experimental Brain Research.

[10]  N. Sigala,et al.  Visual categorization shapes feature selectivity in the primate temporal cortex , 2002, Nature.

[11]  M. Goldberg,et al.  Neuronal Activity in the Lateral Intraparietal Area and Spatial Attention , 2003, Science.

[12]  P. Glimcher,et al.  Activity in Posterior Parietal Cortex Is Correlated with the Relative Subjective Desirability of Action , 2004, Neuron.

[13]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[14]  Jillian H. Fecteau,et al.  Neural correlates of the automatic and goal-driven biases in orienting spatial attention. , 2004, Journal of neurophysiology.

[15]  M. Roesch,et al.  Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex , 2004, Science.

[16]  J. Maunsell Neuronal representations of cognitive state: reward or attention? , 2004, Trends in Cognitive Sciences.

[17]  Andrew M. Poulos,et al.  The neuroscience of mammalian associative learning. , 2005, Annual review of psychology.

[18]  David L. Sheinberg,et al.  Distractor familiarity leads to more efficient visual search for complex stimuli , 2005, Perception & psychophysics.

[19]  W. Newsome,et al.  Choosing the greater of two goods: neural currencies for valuation and decision making , 2005, Nature Reviews Neuroscience.

[20]  Jillian H. Fecteau,et al.  Correlates of Capture of Attention and Inhibition of Return across Stages of Visual Processing , 2005, Journal of Cognitive Neuroscience.

[21]  P. Vuilleumier,et al.  How brains beware: neural mechanisms of emotional attention , 2005, Trends in Cognitive Sciences.

[22]  Michael L. Platt,et al.  Neural correlates of reward and attention in macaque area LIP , 2006, Neuropsychologia.

[23]  David J. Freedman,et al.  Experience-dependent representation of visual categories in parietal cortex , 2006, Nature.

[24]  Jacqueline Gottlieb,et al.  Integration of Exogenous Input into a Dynamic Salience Map Revealed by Perturbing Attention , 2006, The Journal of Neuroscience.

[25]  Jacqueline Gottlieb,et al.  LIP responses to a popout stimulus are reduced if it is overtly ignored , 2006, Nature Neuroscience.

[26]  W. Schultz,et al.  Influences of Rewarding and Aversive Outcomes on Activity in Macaque Lateral Prefrontal Cortex , 2006, Neuron.

[27]  Puiu F. Balan,et al.  Integration of Visuospatial and Effector Information during Symbolically Cued Limb Movements in Monkey Lateral Intraparietal Area , 2006, The Journal of Neuroscience.

[28]  M. Carrasco,et al.  PSYCHOLOGICAL SCIENCE Research Article Emotion Facilitates Perception and Potentiates the Perceptual Benefits of Attention , 2022 .

[29]  Vincent P Ferrera,et al.  Walk the line: parietal neurons respect category boundaries , 2006, Nature Neuroscience.

[30]  W. Schultz Behavioral theories and the neurophysiology of reward. , 2006, Annual review of psychology.

[31]  David L. Sheinberg,et al.  Context Familiarity Enhances Target Processing by Inferior Temporal Cortex Neurons , 2007, The Journal of Neuroscience.

[32]  M. Roesch,et al.  Neuronal Activity Related to Anticipated Reward in Frontal Cortex , 2007, Annals of the New York Academy of Sciences.

[33]  R. Bogacz Optimal decision-making theories: linking neurobiology with behaviour , 2007, Trends in Cognitive Sciences.

[34]  Jacqueline Gottlieb,et al.  Neuronal Correlates of the Set-Size Effect in Monkey Lateral Intraparietal Area , 2008, PLoS biology.

[35]  Luiz Pessoa,et al.  Affective Learning Enhances Visual Detection and Responses in Primary Visual Cortex , 2008, The Journal of Neuroscience.

[36]  Raymond Klein,et al.  Inhibition of return , 2000, Trends in Cognitive Sciences.

[37]  Jacqueline Gottlieb,et al.  Functional Significance of Nonspatial Information in Monkey Lateral Intraparietal Area , 2009, The Journal of Neuroscience.