Reward processing in primate orbitofrontal cortex and basal ganglia.

This article reviews and interprets neuronal activities related to the expectation and delivery of reward in the primate orbitofrontal cortex, in comparison with slowly discharging neurons in the striatum (caudate, putamen and ventral striatum, including nucleus accumbens) and midbrain dopamine neurons. Orbitofrontal neurons showed three principal forms of reward-related activity during the performance of delayed response tasks, namely responses to reward-predicting instructions, activations during the expectation period immediately preceding reward and responses following reward. These activations discriminated between different rewards, often on the basis of the animals' preferences. Neurons in the striatum were also activated in relation to the expectation and detection of reward but in addition showed activities related to the preparation, initiation and execution of movements which reflected the expected reward. Dopamine neurons responded to rewards and reward-predicting stimuli, and coded an error in the prediction of reward. Thus, the investigated cortical and basal ganglia structures showed multiple, heterogeneous, partly simultaneous activations which were related to specific aspects of rewards. These activations may represent the neuronal substrates of rewards during learning and established behavioral performance. The processing of reward expectations suggests an access to central representations of rewards which may be used for the neuronal control of goaldirected behavior.

[1]  C. Jacobsen,et al.  Studies of cerebral function in primates. IV. The effects of frontal lobe lesions on the delayed alternation habit in monkeys. , 1937 .

[2]  H. E. Rosvold,et al.  Behavioral effects of selective ablation of the caudate nucleus. , 1967, Journal of comparative and physiological psychology.

[3]  H. Niki,et al.  Prefrontal cortical unit activity and delayed alternation performance in monkeys. , 1971, Journal of neurophysiology.

[4]  G. E. Alexander,et al.  Neuron Activity Related to Short-Term Memory , 1971, Science.

[5]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[6]  J. Fuster Unit activity in prefrontal cortex during delayed-response performance: neuronal correlates of transient memory. , 1973, Journal of neurophysiology.

[7]  K. Kubota,et al.  Visuokinetic activities of primate prefrontal neurons during delayed-response performance. , 1974, Journal of neurophysiology.

[8]  J. T. Murphy,et al.  The role of the basal ganglia in controlling a movement initiated by a visually presented cue , 1980, Brain Research.

[9]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.

[10]  Joaquin M. Fuster,et al.  Single cell activity in ventral prefrontal cortex of behaving monkeys , 1981, Brain Research.

[11]  P. Goldman-Rakic,et al.  Longitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  H Nishijo,et al.  Single neuron responses in amygdala of alert monkey during complex sensory stimulation with affective significance , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  D. Pandya,et al.  Association fiber pathways to the frontal cortex from the superior temporal region in the rhesus monkey , 1988, The Journal of comparative neurology.

[14]  H. Barbas Anatomic organization of basoventral and mediodorsal visual recipient prefrontal regions in the rhesus monkey , 1988, The Journal of comparative neurology.

[15]  R. Wise,et al.  Brain dopamine and reward. , 1989, Annual review of psychology.

[16]  O. Hikosaka,et al.  Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. , 1989, Journal of neurophysiology.

[17]  O. Hikosaka,et al.  Functional properties of monkey caudate neurons. I. Activities related to saccadic eye movements. , 1989, Journal of neurophysiology.

[18]  Edmund T. Rolls,et al.  Delay, discriminatory, and modality specific neurons in striatum and pallidum during short-term memory tasks , 1990, Brain Research.

[19]  G. E. Alexander,et al.  Preparation for movement: neural representations of intended direction in three motor areas of the monkey. , 1990, Journal of neurophysiology.

[20]  S. Haber,et al.  Topographic organization of the ventral striatal efferent projections in the rhesus monkey: An anterograde tracing study , 1990, The Journal of comparative neurology.

[21]  W. Schultz,et al.  Dopamine neurons of the monkey midbrain: contingencies of responses to active touch during self-initiated arm movements. , 1990, Journal of neurophysiology.

[22]  P. Goldman-Rakic,et al.  Visuospatial coding in primate prefrontal neurons revealed by oculomotor paradigms. , 1990, Journal of neurophysiology.

[23]  E. Rolls,et al.  Gustatory responses of single neurons in the caudolateral orbitofrontal cortex of the macaque monkey. , 1990, Journal of neurophysiology.

[24]  G E Alexander,et al.  Movement-related neuronal activity selectively coding either direction or muscle pattern in three motor areas of the monkey. , 1990, Journal of neurophysiology.

[25]  D A Washburn,et al.  Perceived control in rhesus monkeys (Macaca mulatta): enhanced video-task performance. , 1991, Journal of experimental psychology. Animal behavior processes.

[26]  E. Montgomery,et al.  The striatum and motor cortex in motor initiation and execution , 1991, Brain Research.

[27]  W. Schultz,et al.  Responses of monkey dopamine neurons during learning of behavioral reactions. , 1992, Journal of neurophysiology.

[28]  W. Schultz,et al.  Neuronal activity in monkey ventral striatum related to the expectation of reward , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  W. Schultz,et al.  Neuronal activity in monkey striatum related to the expectation of predictable environmental events. , 1992, Journal of neurophysiology.

[30]  P. Goldman-Rakic,et al.  Dissociation of object and spatial processing domains in primate prefrontal cortex. , 1993, Science.

[31]  W. Schultz,et al.  Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[32]  P. Goldman-Rakic,et al.  Prefrontal neuronal activity in rhesus monkeys performing a delayed anti-saccade task , 1993, Nature.

[33]  B. Balleine,et al.  Motivational control of goal-directed action , 1994 .

[34]  W. Schultz,et al.  Importance of unpredictability for reward responses in primate dopamine neurons. , 1994, Journal of neurophysiology.

[35]  A. Graybiel,et al.  Highly restricted origin of prefrontal cortical inputs to striosomes in the macaque monkey , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[36]  C R Olson,et al.  Object-centered direction selectivity in the macaque supplementary eye field , 1995, Science.

[37]  O. Hikosaka Models of information processing in the basal Ganglia edited by James C. Houk, Joel L. Davis and David G. Beiser, The MIT Press, 1995. $60.00 (400 pp) ISBN 0 262 08234 9 , 1995, Trends in Neurosciences.

[38]  J. Price,et al.  Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys , 1995, The Journal of comparative neurology.

[39]  W. Schultz,et al.  Context-dependent activity in primate striatum reflecting past and future behavioral events. , 1995 .

[40]  E. Lynd-Balta,et al.  The orbital and medial prefrontal circuit through the primate basal ganglia , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[41]  W. Schultz,et al.  Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli , 1996, Nature.

[42]  E. Rolls,et al.  The Orbitofrontal Cortex , 2019 .

[43]  E T Rolls,et al.  Olfactory neuronal responses in the primate orbitofrontal cortex: analysis in an olfactory discrimination task. , 1996, Journal of neurophysiology.

[44]  T. Robbins,et al.  Dissociation in prefrontal cortex of affective and attentional shifts , 1996, Nature.

[45]  Masataka Watanabe Reward expectancy in primate prefrental neurons , 1996, Nature.

[46]  T. Robbins,et al.  Neurobehavioural mechanisms of reward and motivation , 1996, Current Opinion in Neurobiology.

[47]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[48]  G. Koob,et al.  The Neurobiology of Addiction , 1997, Alcohol health and research world.

[49]  S C Rao,et al.  Integration of what and where in the primate prefrontal cortex. , 1997, Science.

[50]  B. Richmond,et al.  Neuronal Signals in the Monkey Ventral Striatum Related to Progress through a Predictable Series of Trials , 1998, The Journal of Neuroscience.

[51]  Leslie G. Ungerleider,et al.  A neural system for human visual working memory. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[52]  H. Damasio,et al.  Dissociation Of Working Memory from Decision Making within the Human Prefrontal Cortex , 1998, The Journal of Neuroscience.

[53]  J. Hollerman,et al.  Influence of reward expectation on behavior-related neuronal activity in primate striatum. , 1998, Journal of neurophysiology.

[54]  G. Schoenbaum,et al.  Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning , 1998, Nature Neuroscience.

[55]  J. Hollerman,et al.  Dopamine neurons report an error in the temporal prediction of reward during learning , 1998, Nature Neuroscience.

[56]  J. Tanji,et al.  Role for cingulate motor area cells in voluntary movement selection based on reward. , 1998, Science.

[57]  REWARD DISCRIMINATION IN PRIMATE STRIATUM , 1998 .

[58]  M. Petrides,et al.  Functional organization of spatial and nonspatial working memory processing within the human lateral frontal cortex. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[59]  O. Hikosaka,et al.  Expectation of reward modulates cognitive signals in the basal ganglia , 1998, Nature Neuroscience.

[60]  J. Hollerman,et al.  Modifications of reward expectation-related neuronal activity during learning in primate striatum. , 1998, Journal of neurophysiology.

[61]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[62]  E. Rolls The orbitofrontal cortex and reward. , 2000, Cerebral cortex.

[63]  C. Cavada,et al.  The anatomical connections of the macaque monkey orbitofrontal cortex. A review. , 2000, Cerebral cortex.

[64]  J. Price,et al.  The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. , 2000, Cerebral cortex.

[65]  W. Schultz,et al.  Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. , 2000, Journal of neurophysiology.

[66]  W. Schultz,et al.  Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex. , 2000, Journal of neurophysiology.

[67]  K. Hikosaka,et al.  Delay activity of orbital and lateral prefrontal neurons of the monkey varying with different rewards. , 2000, Cerebral cortex.