Phasic Mesolimbic Dopamine Signaling Precedes and Predicts Performance of a Self-Initiated Action Sequence Task

[1]  B. Skinner,et al.  Principles of Behavior , 1944 .

[2]  J. Axelrod,et al.  Effect of Cocaine on the Disposition of Noradrenaline labelled with Tritium , 1960, Nature.

[3]  Marvin Minsky,et al.  Steps toward Artificial Intelligence , 1995, Proceedings of the IRE.

[4]  G. Paxinos,et al.  The Rat Brain in Stereotaxic Coordinates , 1983 .

[5]  T. Ono,et al.  Neuronal activity in the ventral tegmental area (VTA) during motivated bar press feeding in the monkey , 1987, Brain Research.

[6]  W. Schultz,et al.  Somatosensory input to dopamine neurones of the monkey midbrain: responses to pain pinch under anaesthesia and to active touch in behavioural context. , 1989, Progress in brain research.

[7]  Richard S. Sutton,et al.  Sequential Decision Problems and Neural Networks , 1989, NIPS 1989.

[8]  W. Schultz,et al.  Dopamine neurons of the monkey midbrain: contingencies of responses to active touch during self-initiated arm movements. , 1990, Journal of neurophysiology.

[9]  W. Schultz,et al.  Responses of monkey dopamine neurons during learning of behavioral reactions. , 1992, Journal of neurophysiology.

[10]  W. Schultz,et al.  Reward-related activity in the monkey striatum and substantia nigra. , 1993, Progress in brain research.

[11]  W. Schultz,et al.  Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  Joel L. Davis,et al.  A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement , 1994 .

[13]  S. N. Haber,et al.  The organization of midbrain projections to the ventral striatum in the primate , 1994, Neuroscience.

[14]  S. Haber,et al.  The organization of midbrain projections to the striatum in the primate: Sensorimotor-related striatum versus ventral striatum , 1994, Neuroscience.

[15]  Joel L. Davis,et al.  Adaptive Critics and the Basal Ganglia , 1995 .

[16]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[18]  A. Graybiel.  The Basal Ganglia and Chunking of Action Repertoires , 1998, Neurobiology of Learning and Memory.

[19]  W. Schultz,et al.  Learning of sequential movements by neural network model with dopamine-like reinforcement signal , 1998, Experimental Brain Research.

[20]  K. Berridge,et al.  What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? , 1998, Brain Research Reviews.

[21]  W. Schultz.  The Reward Signal of Midbrain Dopamine Neurons. , 1999, News in physiological sciences : an international journal of physiology produced jointly by the International Union of Physiological Sciences and the American Physiological Society.

[22]  S. Ikemoto,et al.  The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking , 1999, Brain Research Reviews.

[23]  J. Mirenowicz,et al.  Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists. , 2000, Behavioral neuroscience.

[24]  J. Salamone,et al.  Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement , 2001, Neuroscience.

[25]  W. Schultz,et al.  Dopamine responses comply with basic assumptions of formal learning theory , 2001, Nature.

[26]  W. Schultz.  Getting Formal with Dopamine and Reward , 2002, Neuron.

[27]  Eytan Ruppin,et al.  Actor-critic models of the basal ganglia: new anatomical and computational perspectives , 2002, Neural Networks.

[28]  Samuel M. McClure,et al.  A computational substrate for incentive salience , 2003, Trends in Neurosciences.

[29]  Garret D Stuber,et al.  Real-time measurements of phasic changes in extracellular dopamine concentration in freely moving rats by fast-scan cyclic voltammetry. , 2003, Methods in molecular medicine.

[30]  R. Wightman,et al.  Subsecond dopamine release promotes cocaine seeking , 2003, Nature.

[31]  R. Wightman,et al.  Dopamine Operates as a Subsecond Modulator of Food Seeking , 2004, The Journal of Neuroscience.

[32]  O. Hikosaka,et al.  A possible role of midbrain dopamine neurons in short- and long-term adaptation of saccades to position-reward mapping. , 2004, Journal of neurophysiology.

[33]  R. Wightman,et al.  Resolving neurotransmitters detected by fast-scan cyclic voltammetry. , 2004, Analytical chemistry.

[34]  C. Bradshaw,et al.  Quantitative analysis of the effects of some “atypical” and “conventional” antipsychotics on progressive ratio schedule performance , 2005, Psychopharmacology.

[35]  A. Redish,et al.  Addiction as a Computational Process Gone Awry , 2004, Science.

[36]  W. Pan,et al.  Dopamine Cells Respond to Predicted Events during Classical Conditioning: Evidence for Eligibility Traces in the Reward-Learning Network , 2005, The Journal of Neuroscience.

[37]  R. Wightman,et al.  Real-time measurement of dopamine fluctuations after cocaine in the brain of behaving rats. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[38]  S. M. Anderson,et al.  Cocaine-induced alterations in dopamine receptor signaling: implications for reinforcement and reinstatement. , 2005, Pharmacology & therapeutics.

[39]  Richard S. Sutton,et al.  Learning to predict by the methods of temporal differences , 1988, Machine Learning.

[40]  B. Balleine,et al.  Consolidation and Reconsolidation of Incentive Learning in the Amygdala , 2005, The Journal of Neuroscience.

[41]  R. Wightman,et al.  Rapid Dopamine Signaling in the Nucleus Accumbens during Contingent and Noncontingent Cocaine Administration , 2005, Neuropsychopharmacology.

[42]  K. Berridge.  The debate over dopamine’s role in reward: the case for incentive salience , 2007, Psychopharmacology.

[43]  J. Salamone,et al.  Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits , 2007, Psychopharmacology.

[44]  P. Dayan,et al.  Tonic dopamine: opportunity costs and the control of response vigor , 2007, Psychopharmacology.

[45]  T. Robbins,et al.  A role for mesencephalic dopamine in activation: commentary on Berridge (2006) , 2007, Psychopharmacology.

[46]  S. Hyman.  The Neurobiology of Addiction: Implications for Voluntary Control of Behavior , 2007, The American journal of bioethics : AJOB.

[47]  R. Wightman,et al.  Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens , 2007, Nature Neuroscience.

[48]  M. Lévesque,et al.  Raclopride-induced motor consolidation impairment in primates: role of the dopamine type-2 receptor in movement chunking into integrated sequences , 2007, Experimental Brain Research.

[49]  Vanessa M. Tolosa,et al.  Silicon Wafer-Based Platinum Microelectrode Array Biosensor for Near Real-Time Measurement of Glutamate in Vivo , 2008, Sensors.

[50]  J. Jankovic.  Parkinson’s disease: clinical features and diagnosis , 2008, Journal of Neurology, Neurosurgery, and Psychiatry.

[51]  J. W. Aldridge,et al.  Dissecting components of reward: 'liking', 'wanting', and learning. , 2009, Current opinion in pharmacology.

[52]  Jun Zhang,et al.  A Neural Computational Model of Incentive Salience , 2009, PLoS Comput. Biol..

[53]  G. Stuber,et al.  Neural encoding of cocaine‐seeking behavior is coincident with phasic dopamine release in the accumbens core and shell , 2009, The European journal of neuroscience.

[54]  B. Balleine,et al.  Evidence of Action Sequence Chunking in Goal-Directed Instrumental Conditioning and Its Dependence on the Dorsomedial Prefrontal Cortex , 2009, The Journal of Neuroscience.

[55]  Maxime Levesque,et al.  Motor sequence learning in primate: Role of the D2 receptor in movement chunking during consolidation , 2009, Behavioural Brain Research.

[56]  N. Volkow,et al.  Imaging dopamine's role in drug abuse and addiction , 2009, Neuropharmacology.

[57]  B. Balleine,et al.  Distinct opioid circuits determine the palatability and the desirability of rewarding events , 2009, Proceedings of the National Academy of Sciences.

[58]  Joshua L. Jones,et al.  Basolateral Amygdala Modulates Terminal Dopamine Release in the Nucleus Accumbens and Conditioned Responding , 2010, Biological Psychiatry.

[59]  Nora D Volkow,et al.  Neurocircuitry of Addiction , 2010, Neuropsychopharmacology.

[60]  Nephi Stella,et al.  Chronic microsensors for longitudinal, subsecond dopamine detection in behaving animals , 2009, Nature Methods.

[61]  Ethan S. Bromberg-Martin,et al.  Dopamine in Motivational Control: Rewarding, Aversive, and Alerting , 2010, Neuron.

[62]  P. Garris,et al.  Sensitization of rapid dopamine signaling in the nucleus accumbens core and shell after repeated cocaine in rats. , 2010, Journal of neurophysiology.

[63]  Xin Jin,et al.  Start/stop signals emerge in nigrostriatal circuits during sequence learning , 2010, Nature.

[64]  B. Balleine,et al.  Differential dependence of Pavlovian incentive motivation and instrumental incentive learning processes on dopamine signaling. , 2011, Learning & memory.

[65]  T. Robinson,et al.  A selective role for dopamine in reward learning , 2010, Nature.

[66]  B. Balleine,et al.  Extracellular Dopamine Levels in Striatal Subregions Track Shifts in Motivation and Response Cost during Instrumental Conditioning , 2011, The Journal of Neuroscience.

[67]  Seeking–taking chain schedules of cocaine and sucrose self-administration: effects of reward size, reward omission, and α-flupenthixol , 2011, Psychopharmacology.

[68]  S. Ostlund,et al.  Dopamine Receptor Blockade Attenuates the General Incentive Motivational Effects of Noncontingently Delivered Rewards and Reward-Paired Cues Without Affecting Their Ability to Bias Action Selection , 2012, Neuropsychopharmacology.