Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli

MIDBRAIN dopamine systems are crucially involved in motivational processes underlying the learning and execution of goal-directed behaviour1–5. Dopamine neurons in monkeys are uniformly activated by unpredicted appetitive stimuli such as food and liquid rewards and conditioned, reward-predicting stimuli. By contrast, fully predicted stimuli are ineffective6–8, and the omission of predicted reward depresses their activity9. These characteristics follow associative-learning rules10,11, suggesting that dopamine responses report an error in reward prediction12. Accordingly, neural network models are efficiently trained using a dopamine-like reinforcement signal13,14. However, it is unknown whether the responses to environmental stimuli concern specific motivational attributes or reflect more general stimulus salience4,15. To resolve this, we have compared dopamine impulse responses to motivationally opposing appetitive and aversive stimuli. In contrast to appetitive events, primary and conditioned non-noxious aversive stimuli either failed to activate dopamine neurons or, in cases of close resemblance with appetitive stimuli, induced weaker responses than appetitive stimuli. Thus, dopamine neurons preferentially report environmental stimuli with appetitive rather than aversive motivational value.

[1]  W. F. Prokasy,et al.  Classical conditioning II: Current research and theory. , 1972 .

[2]  A. Dickinson Contemporary Animal Learning Theory , 1981 .

[3]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.

[4]  R. Beninger,et al.  Pimozide blocks establishment but not expression of amphetamine-produced environment-specific conditioning. , 1983, Science.

[5]  S. Skaper,et al.  Age-dependent requirements of sympathetic neurons in serum-free culture. , 1983, Brain research.

[6]  M. D. Crutcher,et al.  Relations between movement and single cell discharge in the substantia nigra of the behaving monkey , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  T. F. Freund,et al.  Tyrosine hydroxylase-immunoreactive boutons in synaptic contact with identified striatonigral neurons, with particular reference to dendritic spines , 1984, Neuroscience.

[8]  M. Le Moal,et al.  Differential reactivity of dopaminergic neurons in the nucleus accumbens in response to different behavioral situations. An in vivo voltammetric study in free moving rats , 1986, Brain Research.

[9]  W. Schultz,et al.  Responses of nigrostriatal dopamine neurons to high-intensity somatosensory stimulation in the anesthetized monkey. , 1987, Journal of neurophysiology.

[10]  William H. Church,et al.  Detecting behaviorally relevant changes in extracellular dopamine with microdialysis , 1987, Brain Research.

[11]  D. Gaffan,et al.  Amygdalectomy and disconnection in visual learning for auditory secondary reinforcement by monkeys , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  H Nishijo,et al.  Single neuron responses in amygdala of alert monkey during complex sensory stimulation with affective significance , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  R. Wise,et al.  Brain dopamine and reward. , 1989, Annual review of psychology.

[14]  E. Abercrombie,et al.  Differential Effect of Stress on In Vivo Dopamine Release in Striatum, Nucleus Accumbens, and Medial Frontal Cortex , 1989, Journal of neurochemistry.

[15]  T. Robbins,et al.  Involvement of the amygdala in stimulus-reward associations: Interaction with the ventral striatum , 1989, Neuroscience.

[16]  P. Goldman-Rakic,et al.  Dopamine synaptic complex with pyramidal neurons in primate cerebral cortex. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[17]  W. Schultz,et al.  Dopamine neurons of the monkey midbrain: contingencies of responses to active touch during self-initiated arm movements. , 1990, Journal of neurophysiology.

[18]  T. Robbins,et al.  Functions of dopamine in the dorsal and ventral striatum , 1992 .

[19]  W. Schultz,et al.  Responses of monkey dopamine neurons during learning of behavioral reactions. , 1992, Journal of neurophysiology.

[20]  J. Gray,et al.  Increased dopamine release in vivo in nucleus accumbens and caudate nucleus of the rat during drinking: A microdialysis study , 1992, Neuroscience.

[21]  W. Schultz Activity of dopamine neurons in the behaving primate , 1992 .

[22]  K. Berridge,et al.  The neural basis of drug craving: An incentive-sensitization theory of addiction , 1993, Brain Research Reviews.

[23]  W. Schultz,et al.  Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  P. Garris,et al.  Heterogeneity of evoked dopamine overflow wihin the striatal and striatoamygdaloid regions , 1994, Neuroscience.

[25]  K. Chergui,et al.  Nonlinear relationship between impulse flow, dopamine release and dopamine elimination in the rat brainin vivo , 1994, Neuroscience.

[26]  Karl J. Friston,et al.  Value-dependent selection in the brain: Simulation in a synthetic neural model , 1994, Neuroscience.

[27]  W. Schultz,et al.  Importance of unpredictability for reward responses in primate dopamine neurons. , 1994, Journal of neurophysiology.

[28]  Joel L. Davis,et al.  Adaptive Critics and the Basal Ganglia , 1995 .

[29]  A. D. Smith,et al.  Immunocytochemical localization of D1 and D2 dopamine receptors in the basal ganglia of the rat: Light and electron microscopy , 1995, Neuroscience.