Neuronal activity in primate orbitofrontal cortex reflects the value of time.

Neurons in monkey orbitofrontal cortex (OF) are known to respond to reward-predicting cues with a strength that depends on the value of the predicted reward as determined 1) by intrinsic attributes including size and quality and 2) by extrinsic factors including the monkey's state of satiation and awareness of what other rewards are currently available. We pose here the question whether another extrinsic factor critical to determining reward value-the delay expected to elapse before delivery-influences neuronal activity in OF. To answer this question, we recorded from OF neurons while monkeys performed a memory-guided saccade task in which a cue presented early in each trial predicted whether the delay before the monkey could respond and receive a reward of fixed size would be short or long. OF neurons tended to fire more strongly in response to a cue predicting a short delay. The tendency to fire more strongly in anticipation of a short delay was correlated across neurons with the tendency to fire more strongly before a large reward. We conclude that neuronal activity in OF represents the time-discounted value of the expected reward.

[1]  R J HERRNSTEIN,et al.  Relative and absolute strength of response as a function of frequency of reinforcement. , 1961, Journal of the experimental analysis of behavior.

[2]  D. Robinson,et al.  A METHOD OF MEASURING EYE MOVEMENT USING A SCLERAL SEARCH COIL IN A MAGNETIC FIELD. , 1963, IEEE transactions on bio-medical engineering.

[3]  J. A. McDonald,et al.  Orality, Preference Behavior, and Reinforcement Value of Nonfood Object in Monkeys with Orbital Frontal Lesions , 1969, Science.

[4]  D. R. Snyder,et al.  Effects of orbital frontal lesions on aversive and aggressive behaviors in rhesus monkeys. , 1970, Journal of comparative and physiological psychology.

[5]  M. Mishkin,et al.  Limbic lesions and the problem of stimulus--reinforcement associations. , 1972, Experimental neurology.

[6]  D. R. Snyder,et al.  Alterations in aversive and aggressive behaviors following orbital frontal lesions in rhesus monkeys. , 1972, Acta neurobiologiae experimentalis.

[7]  R. Thaler.  Some empirical evidence on dynamic inconsistency , 1981 .

[8]  C. Brinkman.  Supplementary motor area of the monkey's cerebral cortex: short- and long-term deficits after unilateral ablation and the effects of subsequent callosal section , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  Hidehiko Komatsu,et al.  A grid system and a microsyringe for single cell recording , 1988, Journal of Neuroscience Methods.

[10]  D. Gaffan,et al.  Amygdalar interaction with the mediodorsal nucleus of the thalamus and the ventromedial prefrontal cortex in stimulus-reward associative learning in the monkey , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  J. Elster,et al.  Choice Over Time , 1992 .

[12]  E. Rolls,et al.  Gustatory, olfactory, and visual convergence within the primate orbitofrontal cortex , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  D. Hoffman,et al.  Differential effects of muscimol microinjection into dorsal and ventral aspects of the premotor cortex of monkeys. , 1994, Journal of neurophysiology.

[14]  E. Rolls,et al.  Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex. , 1996, Journal of neurophysiology.

[15]  E. Rolls,et al.  The Orbitofrontal Cortex , 2019 .

[16]  T. Robbins,et al.  Dissociation in prefrontal cortex of affective and attentional shifts , 1996, Nature.

[17]  J. Evenden,et al.  The pharmacology of impulsive behaviour in rats: the effects of drugs on response choice with varying delays of reinforcement , 1996, Psychopharmacology.

[18]  Edward J. Tehovnik,et al.  Reversible inactivation of macaque frontal eye field , 1997, Experimental Brain Research.

[19]  M. Mishkin,et al.  Effects of orbital frontal and anterior cingulate lesions on object and spatial memory in rhesus monkeys , 1997, Neuropsychologia.

[20]  G. Schoenbaum,et al.  Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning , 1998, Nature Neuroscience.

[21]  E. J. Tehovnik,et al.  Reversible inactivation of macaque dorsomedial frontal cortex: effects on saccades and fixations , 1999, Experimental Brain Research.

[22]  M. Segraves,et al.  Muscimol-induced inactivation of monkey frontal eye field: effects on visually and memory-guided saccades. , 1999, Journal of neurophysiology.

[23]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[24]  S. Mobini,et al.  Theory and method in the quantitative analysis of ”impulsive choice” behaviour: implications for psychopharmacology , 1999, Psychopharmacology.

[25]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[26]  G. Schoenbaum,et al.  Neural Encoding in Orbitofrontal Cortex and Basolateral Amygdala during Olfactory Discrimination Learning , 1999, The Journal of Neuroscience.

[27]  E. Rolls.  The orbitofrontal cortex and reward. , 2000, Cerebral cortex.

[28]  J. Hollerman,et al.  Reward processing in primate orbitofrontal cortex and basal ganglia. , 2000, Cerebral cortex.

[29]  W. Schultz,et al.  Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. , 2000, Journal of neurophysiology.

[30]  K. Hikosaka,et al.  Delay activity of orbital and lateral prefrontal neurons of the monkey varying with different rewards. , 2000, Cerebral cortex.

[31]  T. Robbins,et al.  Impulsive Choice Induced in Rats by Lesions of the Nucleus Accumbens Core , 2001, Science.

[32]  T. Robbins,et al.  Dissociable contributions of the orbitofrontal and lateral prefrontal cortex of the marmoset to performance on a detour reaching task , 2001, The European journal of neuroscience.

[33]  J. Deakin,et al.  Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement , 2002, Psychopharmacology.

[34]  B. Richmond,et al.  Anterior Cingulate: Single Neuronal Signals Related to Degree of Reward Expectancy , 2002, Science.

[35]  P. Montague,et al.  Neural Economics and the Biological Substrates of Valuation , 2002, Neuron.

[36]  E. Miller,et al.  Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task , 2003, The European journal of neuroscience.

[37]  M. Roesch,et al.  Impact of expected reward on neuronal activity in prefrontal cortex, frontal and supplementary eye fields and premotor cortex. , 2003, Journal of neurophysiology.

[38]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[39]  Munetaka Shidara,et al.  Differential encoding of information about progress through multi-trial reward schedules by three groups of ventral striatal neurons , 2004, Neuroscience Research.

[40]  D. Gaffan,et al.  Amygdalectomy and ventromedial prefrontal ablation produce similar deficits in food choice and in simple object discrimination learning for an unseen reward , 2004, Experimental Brain Research.

[41]  Alicia Izquierdo,et al.  Combined unilateral lesions of the amygdala and orbital prefrontal cortex impair affective processing in rhesus monkeys. , 2004, Journal of neurophysiology.

[42]  Richard C Saunders,et al.  DNA targeting of rhinal cortex D2 receptor protein reversibly blocks learning of cues that predict reward. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[43]  S. Thorpe,et al.  The orbitofrontal cortex: Neuronal activity in the behaving monkey , 2004, Experimental Brain Research.

[44]  M. Roesch,et al.  Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex , 2004, Science.

[45]  M. Mishkin,et al.  Perseverative interference in monkeys following selective lesions of the inferior prefrontal convexity , 1970, Experimental Brain Research.

[46]  S. Tsujimoto,et al.  Neuronal activity representing temporal prediction of reward in the primate prefrontal cortex. , 2005, Journal of neurophysiology.

[47]  M. Roesch,et al.  Neuronal activity dependent on anticipated and elapsed delay in macaque prefrontal cortex, frontal and supplementary eye fields, and premotor cortex. , 2005, Journal of neurophysiology.