Different Pedunculopontine Tegmental Neurons Signal Predicted and Actual Task Rewards

The dopamine system has been implicated in guiding behavior based on rewards. The pedunculopontine tegmental nucleus (PPTN) of the brainstem receives afferent inputs from reward-related structures, including the cerebral cortices and the basal ganglia, and in turn provides strong excitatory projections to dopamine neurons. This anatomical evidence predicts that PPTN neurons may carry reward information. To elucidate the functional role of the PPTN in reward-seeking behavior, we recorded single PPTN neurons while monkeys performed a visually guided saccade task in which the predicted reward value was informed by the shape of the fixation target. Two distinct groups of neurons, fixation target (FT) and reward delivery (RD) neurons, carried reward information. The activity of FT neurons persisted between FT onset and reward delivery, with the level of activity associated with the magnitude of the expected reward. RD neurons discharged phasically after reward delivery, with the levels of activity associated with the actual reward. These results suggest that separate populations of PPTN neurons signal predicted and actual reward values, both of which are necessary for the computation of reward prediction error as represented by dopamine neurons.

[1]  W. Newsome,et al.  The temporal precision of reward prediction in dopamine neurons , 2008, Nature Neuroscience.

[2]  J. Bolam,et al.  Cholinergic modulation of midbrain dopaminergic systems , 2008, Brain Research Reviews.

[3]  Brian D Corneil,et al.  Recruitment of a head-turning synergy by low-frequency activity in the primate superior colliculus. , 2008, Journal of neurophysiology.

[4]  E. Rolls,et al.  Cerebral Cortex Advance Access published June 22, 2007 Expected Value, Reward Outcome, and Temporal Difference Error Representations in a Probabilistic Decision Task , 2022 .

[5]  J. O'Doherty,et al.  Neural coding of reward-prediction error signals during classical conditioning with attractive faces. , 2007, Journal of neurophysiology.

[6]  P. Winn How best to consider the structure and function of the pedunculopontine tegmental nucleus: Evidence from animal studies , 2006, Journal of the Neurological Sciences.

[7]  Kae Nakamura,et al.  Basal ganglia orient eyes to reward. , 2006, Journal of neurophysiology.

[8]  O. Hikosaka,et al.  Immediate changes in anticipatory activity of caudate neurons associated with reversal of position-reward contingency. , 2005, Journal of neurophysiology.

[9]  W. Pan,et al.  Pedunculopontine Tegmental Nucleus Controls Conditioned Responses of Midbrain Dopamine Neurons in Behaving Rats , 2005, The Journal of Neuroscience.

[10]  J. Paul Bolam,et al.  Pedunculopontine nucleus and basal ganglia: distant relatives or part of the same family? , 2004, Trends in Neurosciences.

[11]  M. Roesch,et al.  Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex , 2004, Science.

[12]  O. Hikosaka,et al.  Dopamine Neurons Can Represent Context-Dependent Prediction Error , 2004, Neuron.

[13]  W. Schultz,et al.  Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm , 2003, The Journal of Neuroscience.

[14]  A. Grace,et al.  Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission , 2003, Nature Neuroscience.

[15]  M. Roesch,et al.  Impact of expected reward on neuronal activity in prefrontal cortex, frontal and supplementary eye fields and premotor cortex. , 2003, Journal of neurophysiology.

[16]  W. Schultz Getting Formal with Dopamine and Reward , 2002, Neuron.

[17]  Yasushi Kobayashi,et al.  Contribution of pedunculopontine tegmental nucleus neurons to performance of visually guided saccade tasks in monkeys. , 2002, Journal of neurophysiology.

[18]  Roland E. Suri,et al.  TD models of reward predictive responses in dopamine neurons , 2002, Neural Networks.

[19]  O. Hikosaka,et al.  Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex. , 2002, Journal of neurophysiology.

[20]  W. Schultz,et al.  Dopamine responses comply with basic assumptions of formal learning theory , 2001, Nature.

[21]  K. Nakano,et al.  Efferent projections of infralimbic and prelimbic areas of the medial prefrontal cortex in the Japanese monkey, Macaca fuscata , 2001, Brain Research.

[22]  K. Hikosaka,et al.  Delay activity of orbital and lateral prefrontal neurons of the monkey varying with different rewards. , 2000, Cerebral cortex.

[23]  Joshua W. Brown,et al.  How the Basal Ganglia Use Parallel Excitatory and Inhibitory Learning Pathways to Selectively Respond to Unexpected Rewarding Cues , 1999, The Journal of Neuroscience.

[24]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[25]  José Luis Contreras-Vidal,et al.  A Predictive Reinforcement Model of Dopamine Neurons for Learning Approach Behavior , 1999, Journal of Computational Neuroscience.

[26]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[27]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[28]  Tatsuya Kimura,et al.  Cerebellar complex spikes encode both destinations and errors in arm movements , 1998, Nature.

[29]  M. Matsumura,et al.  Single-unit activity in the primate nucleus tegmenti pedunculopontinus related to voluntary arm movement , 1997, Neuroscience Research.

[30]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[31]  B. K. Hartman,et al.  Distribution of pontomesencephalic cholinergic neurons projecting to substantia nigra differs significantly from those projecting to ventral tegmental area , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[32]  S. T. Kitai,et al.  Glutamatergic and cholinergic inputs from the pedunculopontine tegmental nucleus to dopamine neurons in the substantia nigra pars compacta , 1995, Neuroscience Research.

[33]  C. Gross,et al.  Neural ensemble coding in inferior temporal cortex. , 1994, Journal of neurophysiology.

[34]  C. Blaha,et al.  Modulation of dopamine efflux in the striatum following cholinergic stimulation of the substantia nigra in intact and pedunculopontine tegmental nucleus-lesioned rats , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[35]  H. Fibiger,et al.  Afferent connections of the laterodorsal and the pedunculopontine tegmental nuclei in the rat: A retro‐ and antero‐grade transport and immunohistochemical study , 1992, The Journal of comparative neurology.

[36]  Hidehiko Komatsu,et al.  A grid system and a microsyringe for single cell recording , 1988, Journal of Neuroscience Methods.

[37]  T. Ono,et al.  Neuronal responses in monkey lateral hypothalamus during operant feeding behavior , 1986, Brain Research Bulletin.

[38]  E. Scarnati,et al.  Pedunculopontine-evoked excitation of substantia nigra neurons in the rat , 1984, Brain Research.

[39]  E. Rolls,et al.  Neurophysiological analysis of brain-stimulation reward in the monkey , 1980, Brain Research.

[40]  L B Lusted,et al.  General problems in medical decision making with comments on ROC analysis. , 1978, Seminars in nuclear medicine.

[41]  B L Whitsel,et al.  Variability in somatosensory cortical neuron discharge: effects on capacity to signal different stimulus conditions using a mean rate code. , 1978, Journal of neurophysiology.

[42]  A. Fuchs,et al.  A method for measuring horizontal and vertical eye movement chronically in the monkey. , 1966, Journal of applied physiology.

[43]  V. Mountcastle,et al.  THE VARIABILITY OF CENTRAL NEURAL ACTIVITY IN A SENSORY SYSTEM, AND ITS IMPLICATIONS FOR THE CENTRAL REFLECTION OF SENSORY EVENTS. , 1963, Journal of neurophysiology.

[44]  Barry J Richmond,et al.  Dynamic changes in representations of preceding and upcoming reward in monkey orbitofrontal cortex. , 2008, Cerebral cortex.

[45]  Kenji Doya,et al.  Reinforcement Learning in Continuous Time and Space , 2000, Neural Computation.

[46]  Joel L. Davis,et al.  A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement , 1994 .