Temporal Specificity of Reward Prediction Errors Signaled by Putative Dopamine Neurons in Rat VTA Depends on Ventral Striatum

[1]  W. Newsome,et al.  The temporal precision of reward prediction in dopamine neurons , 2008, Nature Neuroscience.

[2]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[3]  Elyssa B. Margolis,et al.  Nucleus Accumbens Medium Spiny Neurons Target Non-Dopaminergic Neurons in the Ventral Tegmental Area , 2011, The Journal of Neuroscience.

[4]  C. Lansink,et al.  Endocannabinoids Shape Accumbal Encoding of Cue-Motivated Behavior via CB1 Receptor Activation in the Ventral Tegmentum , 2012, Neuron.

[5]  Kelly R. Tan,et al.  Cocaine Disinhibits Dopamine Neurons by Potentiation of GABA Transmission in the Ventral Tegmental Area , 2013, Science.

[6]  Anne E Carpenter,et al.  Neuron-type specific signals for reward and punishment in the ventral tegmental area , 2011, Nature.

[7]  S. Nicola.  The nucleus accumbens as part of a basal ganglia action selection circuit , 2007, Psychopharmacology.

[8]  Stan B. Floresco,et al.  Contributions of the nucleus accumbens and its subregions to different aspects of risk-based decision making , 2011, Cognitive, affective & behavioral neuroscience.

[9]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  A. Grace,et al.  Glutamatergic Afferents from the Hippocampus to the Nucleus Accumbens Regulate Activity of Ventral Tegmental Area Dopamine Neurons , 2001, The Journal of Neuroscience.

[11]  W. Meck,et al.  Hippocampal function is required for feedback control of an internal clock's criterion. , 1988, Behavioral neuroscience.

[12]  W. Pan,et al.  Dopamine Cells Respond to Predicted Events during Classical Conditioning: Evidence for Eligibility Traces in the Reward-Learning Network , 2005, The Journal of Neuroscience.

[13]  S. Mizumori,et al.  Effects of Prefrontal Cortical Inactivation on Neural Activity in the Ventral Tegmental Area , 2013, The Journal of Neuroscience.

[14]  S. Floresco,et al.  Preferential Involvement by Nucleus Accumbens Shell in Mediating Probabilistic Learning and Reversal Shifts , 2014, The Journal of Neuroscience.

[15]  Naoshige Uchida,et al.  Arithmetic and local circuitry underlying dopamine prediction errors , 2015, Nature.

[16]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[17]  A. Grace,et al.  Are you or aren’t you? Challenges associated with physiologically identifying dopamine neurons , 2012, Trends in Neurosciences.

[18]  R. Church,et al.  Hippocampus, time, and memory--a retrospective analysis. , 2013, Behavioral neuroscience.

[19]  G. Di Chiara.  Nucleus accumbens shell and core dopamine: differential role in behavior and addiction. , 2002, Behavioural brain research.

[20]  J. Hollerman,et al.  Dopamine neurons report an error in the temporal prediction of reward during learning , 1998, Nature Neuroscience.

[21]  B. Everitt,et al.  Hierarchical recruitment of phasic dopamine signaling in the striatum during the progression of cocaine use , 2012, Proceedings of the National Academy of Sciences.

[22]  Naoshige Uchida,et al.  Habenula Lesions Reveal that Multiple Mechanisms Underlie Dopamine Prediction Errors , 2015, Neuron.

[23]  Geoffrey Schoenbaum,et al.  The role of the nucleus accumbens in knowing when to respond. , 2011, Learning & memory.

[24]  R. Church,et al.  Hippocampus, time, and memory. , 1984, Behavioral neuroscience.

[25]  A. Grace,et al.  Opposing effects of striatonigral feedback pathways on midbrain dopamine cell activity , 1985, Brain Research.

[26]  Karl J. Friston,et al.  Temporal Difference Models and Reward-Related Learning in the Human Brain , 2003, Neuron.

[27]  D. Wilkin,et al.  Neuron , 2001, Brain Research.

[28]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[29]  M. Roesch,et al.  Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards , 2007, Nature Neuroscience.

[30]  W. Schultz,et al.  Dopamine responses comply with basic assumptions of formal learning theory , 2001, Nature.

[31]  Eytan Ruppin,et al.  Actor-critic models of the basal ganglia: new anatomical and computational perspectives , 2002, Neural Networks.

[32]  Warren H Meck,et al.  Cortico-striatal Representation of Time in Animals and Humans This Review Comes from a Themed Issue on Cognitive Neuroscience Edited Evidence from Patient Populations and Electrical Potentials Neuroimaging Evidence Using Fmri and Pet , 2022 .

[33]  Timothy E. J. Behrens,et al.  Dissociable Reward and Timing Signals in Human Midbrain and Ventral Striatum , 2011, Neuron.

[34]  Heterogeneous composition of dopamine neurons of the rat A10 region: molecular evidence for diverse signaling properties , 2013, Brain Structure and Function.

[35]  W. Schultz,et al.  Importance of unpredictability for reward responses in primate dopamine neurons. , 1994, Journal of neurophysiology.

[36]  Ventral Striatum Lesions Enhance Stimulus and Response Encoding in Dorsal Striatum , 2014, Biological Psychiatry.

[37]  A. Barto,et al.  Adaptive Critics and the Basal Ganglia , 1994 .

[38]  Joseph J. Paton,et al.  A Scalable Population Code for Time in the Striatum , 2015, Current Biology.

[39]  Simon Hong,et al.  A pallidus-habenula-dopamine pathway signals inferred stimulus values. , 2010, Journal of neurophysiology.

[40]  Xin Jin,et al.  Start/stop signals emerge in nigrostriatal circuits during sequence learning , 2010, Nature.

[41]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[42]  H. Eichenbaum.  Time cells in the hippocampus: a new dimension for mapping memories , 2014, Nature Reviews Neuroscience.

[43]  Robert C. Wilson,et al.  Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex , 2011, Nature Neuroscience.

[44]  Elyssa B. Margolis,et al.  The ventral tegmental area revisited: is there an electrophysiological marker for dopaminergic neurons? , 2006, The Journal of physiology.

[45]  Y. Niv,et al.  Ventral Striatum and Orbitofrontal Cortex Are Both Required for Model-Based, But Not Model-Free, Reinforcement Learning , 2011, The Journal of Neuroscience.

[46]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[47]  O. Hikosaka,et al.  Two types of dopamine neuron distinctly convey positive and negative motivational signals , 2009, Nature.

[48]  T. Robbins,et al.  Putting a spin on the dorsal–ventral divide of the striatum , 2004, Trends in Neurosciences.

[49]  E. Vaadia,et al.  Midbrain dopamine neurons encode decisions for future action , 2006, Nature Neuroscience.

[50]  M. Roesch,et al.  Encoding of Time-Discounted Rewards in Orbitofrontal Cortex Is Independent of Value Representation , 2006, Neuron.

[51]  H. Groenewegen,et al.  The anatomical relationship of the prefrontal cortex with the striatopallidal system, the thalamus and the amygdala: evidence for a parallel organization. , 1990, Progress in brain research.

[52]  Douglas L. Jones,et al.  From motivation to action: Functional interface between the limbic system and the motor system , 1980, Progress in Neurobiology.

[53]  Josiah R. Boivin,et al.  Positive Reinforcement Mediated by Midbrain Dopamine Neurons Requires D1 and D2 Receptor Activation in the Nucleus Accumbens , 2014, PloS one.

[54]  Peter Dayan,et al.  Temporal difference models describe higher-order learning in humans , 2004, Nature.

[55]  S. Mizumori,et al.  Prefrontal Regulation of Neuronal Activity in the Ventral Tegmental Area. , 2016, Cerebral cortex.

[56]  David S. Touretzky,et al.  Representation and Timing in Theories of the Dopamine System , 2006, Neural Computation.

[57]  W. Schultz,et al.  Influence of Reward Delays on Responses of Dopamine Neurons , 2008, The Journal of Neuroscience.

[58]  W. Hauber,et al.  Nmda, but Not Dopamine D 2 , Receptors in the Rat Nucleus Accumbens Are Involved in Guidance of Instrumental Behavior by Stimuli Predicting Reward Magnitude , 2022 .

[59]  Sachie K. Ogawa,et al.  Whole-Brain Mapping of Direct Inputs to Midbrain Dopamine Neurons , 2012, Neuron.

[60]  M. Roesch,et al.  The Orbitofrontal Cortex and Ventral Tegmental Area Are Necessary for Learning from Unexpected Outcomes , 2009, Neuron.

[61]  M. Roesch,et al.  Ventral Striatal Neurons Encode the Value of the Chosen Action in Rats Deciding between Differently Delayed or Sized Rewards , 2009, The Journal of Neuroscience.

[62]  M. Roesch,et al.  Separate Populations of Neurons in Ventral Striatum Encode Value and Motivation , 2013, PloS one.

[63]  K. Berridge,et al.  What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? , 1998, Brain Research Reviews.

[64]  R. R. Bush,et al.  A Mathematical Model for Simple Learning , 1951 .

[65]  S. Floresco,et al.  Separate Prefrontal-Subcortical Circuits Mediate Different Components of Risk-Based Decision Making , 2012, The Journal of Neuroscience.