Temporal development of asymmetric reward-induced bias in macaques.

Time and expected outcome are two ubiquitous factors contributing to decision-making. However, it is unclear how they interact to influence motor responses. When two differential reward outcomes are expected at the end of a waiting period, behavioral bias is consistently induced, manifested as shorter latencies for motor responses associated with the preferred reward. To examine how this bias develops in time during the waiting period, we manipulated the duration of the waiting period in an asymmetric reward saccade task in monkeys. We found that the bias increases with the duration of waiting period. Surprisingly, the bias resulted from gradual suppression of saccades to nonpreferred targets rather than from facilitation of saccades to preferred targets. These results have important implications on the neural correlates of reward-induced bias.

[1]  O. Hikosaka,et al.  Comparison of Reward Modulation in the Frontal Eye Field and Caudate of the Macaque , 2006, The Journal of Neuroscience.

[2]  Kae Nakamura,et al.  Basal ganglia orient eyes to reward. , 2006, Journal of neurophysiology.

[3]  Y. Shinoda,et al.  Commissural excitation and inhibition by the superior colliculus in tectoreticular neurons projecting to omnipause neuron and inhibitory burst neuron regions. , 2005, Journal of neurophysiology.

[4]  M. Shadlen,et al.  A representation of the hazard rate of elapsed time in macaque area LIP , 2005, Nature Neuroscience.

[5]  L. Green,et al.  A discounting framework for choice with delayed and probabilistic rewards. , 2004, Psychological bulletin.

[6]  J. Maunsell Neuronal representations of cognitive state: reward or attention? , 2004, Trends in Cognitive Sciences.

[7]  O. Hikosaka,et al.  Neural Correlates of Rewarded and Unrewarded Eye Movements in the Primate Caudate Nucleus , 2003, The Journal of Neuroscience.

[8]  Okihide Hikosaka,et al.  Reward-Dependent Gain and Bias of Visual Responses in Primate Superior Colliculus , 2003, Neuron.

[9]  Okihide Hikosaka,et al.  Effects of motivational conflicts on visually elicited saccades in monkeys , 2003, Experimental Brain Research.

[10]  B. Stein,et al.  Opposing basal ganglia processes shape midbrain visuomotor activity bilaterally , 2003, Nature.

[11]  M. Roesch,et al.  Impact of expected reward on neuronal activity in prefrontal cortex, frontal and supplementary eye fields and premotor cortex. , 2003, Journal of neurophysiology.

[12]  Geoffrey M. Ghose,et al.  Attentional modulation in visual cortex depends on task timing , 2002, Nature.

[13]  O. Hikosaka,et al.  A neural correlate of response bias in monkey caudate nucleus , 2002, Nature.

[14]  O. Hikosaka,et al.  Visual and Anticipatory Bias in Three Cortical Eye Fields of the Monkey during an Adaptive Decision-Making Task , 2002, The Journal of Neuroscience.

[15]  Okihide Hikosaka,et al.  Role of Primate Substantia Nigra Pars Reticulata in Reward-Oriented Saccadic Eye Movement , 2002, The Journal of Neuroscience.

[16]  O. Hikosaka,et al.  Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex. , 2002, Journal of neurophysiology.

[17]  O. Hikosaka,et al.  Feature-Based Anticipation of Cues that Predict Reward in Monkey Caudate Nucleus , 2002, Neuron.

[18]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[19]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[20]  O. Hikosaka,et al.  Expectation of reward modulates cognitive signals in the basal ganglia , 1998, Nature Neuroscience.

[21]  D. Munoz,et al.  Lateral inhibitory interactions in the intermediate layers of the monkey superior colliculus. , 1998, Journal of neurophysiology.

[22]  H. de Wit,et al.  Determination of discount functions in rats with an adjusting-amount procedure. , 1997, Journal of the experimental analysis of behavior.

[23]  J. Findlay,et al.  The effect of visual attention on peripheral discrimination thresholds in single and multiple element displays. , 1988, Acta psychologica.

[24]  J. E. Mazur Tests of an equivalence rule for fixed and variable reinforcer delays. , 1984 .

[25]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[26]  A. Sanders,et al.  The Relation between Physical Stimulus Properties and the Effect of Foreperiod Duration on Reaction Time , 1973, The Quarterly journal of experimental psychology.

[27]  Raymond S. Nickerson,et al.  Response times with nonaging foreperiods , 1969 .

[28]  D. M. Green,et al.  Detection of auditory signals presented at random times: III , 1967 .

[29]  L. Karlin Reaction time as a function of foreperiod duration and variability. , 1959, Journal of experimental psychology.

[30]  Foley Pj The foreperiod and simple reaction time. , 1959 .

[31]  Okihide Hikosaka,et al.  Functional differences between macaque prefrontal cortex and caudate nucleus during eye movements with and without reward , 2006, Experimental Brain Research.

[32]  Daniel D. Holt,et al.  Discounting of delayed food rewards in pigeons and rats: is there a magnitude effect? , 2004, Journal of the experimental analysis of behavior.

[33]  O. Hikosaka,et al.  Reward-dependent spatial selectivity of anticipatory activity in monkey caudate neurons. , 2002, Journal of neurophysiology.

[34]  A. Logue,et al.  Adjusting delay to reinforcement: comparing choice in pigeons and humans. , 1988, Journal of experimental psychology. Animal behavior processes.