Statistics of midbrain dopamine neuron spike trains in the awake primate.

Work in behaving primates indicates that midbrain dopamine neurons encode a prediction error, the difference between an obtained reward and the reward expected. Studies of dopamine action potential timing in the alert and anesthetized rat indicate that dopamine neurons respond in tonic and phasic modes, a distinction that has been less well characterized in the primates. We used spike train models to examine the relationship between the tonic and burst modes of activity in dopamine neurons while monkeys were performing a reinforced visuo-saccadic movement task. We studied spiking activity during four task-related intervals; two of these were intervals during which no task-related events occurred, whereas two were periods marked by task-related phasic activity. We found that dopamine neuron spike trains during the intervals when no events occurred were well described as tonic. Action potentials appeared to be independent, to occur at low frequency, and to be almost equally well described by Gaussian and Poisson-like (gamma) processes. Unlike in the rat, interspike intervals as low as 20 ms were often observed during these presumptively tonic epochs. Having identified these periods of presumptively tonic activity, we were able to quantitatively define phasic modulations (both increases and decreases in activity) during the intervals in which task-related events occurred. This analysis revealed that the phasic modulations of these neurons include both bursting, as has been described previously, and pausing. Together bursts and pauses seemed to provide a continuous, although nonlinear, representation of the theoretically defined reward prediction error of reinforcement learning.

[1]  David R. Cox,et al.  The statistical analysis of series of events , 1966 .

[2]  D. Cox,et al.  The statistical analysis of series of events , 1966 .

[3]  R. Rescorla A theory of pavlovian conditioning: The effectiveness of reinforcement and non-reinforcement , 1972 .

[4]  Philip M. Groves,et al.  Statistical properties of neuronal spike trains in the substantia nigra: Cell types and their interactions , 1977, Brain Research.

[5]  A. Grace,et al.  The control of firing pattern in nigral dopamine neurons: burst firing , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  B. Bunney,et al.  Firing properties of substantia nigra dopaminergic neurons in freely moving rats. , 1985, Life sciences.

[7]  T. Kita,et al.  Electrical membrane properties of rat substantia nigra compacta neurons in an in vitro slice preparation , 1986, Brain Research.

[8]  W. Shofner,et al.  Regularity and latency of units in ventral cochlear nucleus: implications for unit classification and generation of response properties. , 1988, Journal of neurophysiology.

[9]  B. Bunney,et al.  Intracellular studies of dopamine neurons in vitro: pacemakers modulated by dopamine. , 1988, European journal of pharmacology.

[10]  D. German,et al.  Electrophysiological and pharmacological evidence for the existence of distinct subpopulations of nigrostriatal dopaminergic neuron in the rat , 1988, Neuroscience.

[11]  A. Grace Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: A hypothesis for the etiology of schizophrenia , 1991, Neuroscience.

[12]  W. Schultz,et al.  Responses of monkey dopamine neurons during learning of behavioral reactions. , 1992, Journal of neurophysiology.

[13]  R. North,et al.  Burst firing in dopamine neurons induced by N-methyl-D-aspartate: role of electrogenic sodium pump. , 1992, Science.

[14]  W. Schultz,et al.  Importance of unpredictability for reward responses in primate dopamine neurons. , 1994, Journal of neurophysiology.

[15]  JM Tepper,et al.  GABAA receptor-mediated inhibition of rat substantia nigra dopaminergic neurons by pars reticulata projection neurons , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  R. Hoffman,et al.  Nonlinear sequence-dependent structure of nigral dopamine neuron interspike interval firing patterns. , 1995, Biophysical journal.

[17]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[19]  P. Glimcher,et al.  Response properties of saccade-related burst neurons in the central mesencephalic reticular formation. , 1997, Journal of neurophysiology.

[20]  J. Hollerman,et al.  Dopamine neurons report an error in the temporal prediction of reward during learning , 1998, Nature Neuroscience.

[21]  J. Tepper,et al.  GABAA and GABAB antagonists differentially affect the firing pattern of substantia nigra dopaminergic neurons in vivo , 1999, Synapse.

[22]  P. Shepard,et al.  Afferent modulation of dopamine neuron firing patterns , 1999, Current Opinion in Neurobiology.

[23]  David R. Anderson,et al.  Model selection and inference : a practical information-theoretic approach , 2000 .

[24]  Vivian M Ciaramitaro,et al.  Application of neurosonography to experimental physiology , 2001, Journal of Neuroscience Methods.

[25]  W. Schultz,et al.  Dopamine responses comply with basic assumptions of formal learning theory , 2001, Nature.

[26]  Emery N. Brown,et al.  The Time-Rescaling Theorem and Its Application to Neural Spike Train Data Analysis , 2002, Neural Computation.

[27]  B. Hyland,et al.  Firing modes of midbrain dopamine cells in the freely moving rat , 2002, Neuroscience.

[28]  Sham M. Kakade,et al.  Opponent interactions between serotonin and dopamine , 2002, Neural Networks.

[29]  W. Meck,et al.  Dissecting the Brain's Internal Clock: How Frontal–Striatal Circuitry Keeps Time and Shifts Attention , 2002, Brain and Cognition.

[30]  William H. Press,et al.  Numerical recipes in C , 2002 .

[31]  A. Grace,et al.  Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission , 2003, Nature Neuroscience.

[32]  Emery N. Brown,et al.  Computational Neuroscience: A Comprehensive Approach , 2022 .

[33]  Tatsuo K Sato,et al.  Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons , 2003, The Journal of Neuroscience.

[34]  O. Hikosaka,et al.  Dopamine Neurons Can Represent Context-Dependent Prediction Error , 2004, Neuron.

[35]  E. Vaadia,et al.  Coincident but Distinct Messages of Midbrain Dopamine and Striatal Tonically Active Neurons , 2004, Neuron.

[36]  A. Grace,et al.  Dopaminergic modulation of limbic and cortical drive of nucleus accumbens in goal-directed behavior , 2005, Nature Neuroscience.

[37]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[38]  A. Spada,et al.  The Power of the Dark Side: Huntington’s Disease Protein and p53 Form a Deadly Alliance , 2005, Neuron.

[39]  P. Glimcher,et al.  Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal , 2005, Neuron.

[40]  J. Lisman,et al.  The Hippocampal-VTA Loop: Controlling the Entry of Information into Long-Term Memory , 2005, Neuron.