Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task

The present investigation had two aims: (1) to study responses of dopamine neurons to stimuli with attentional and motivational significance during several steps of learning a behavioral task, and (2) to study the activity of dopamine neurons during the performance of cognitive tasks known to be impaired after lesions of these neurons. Monkeys that had previously learned a simple reaction time task were trained to perform a spatial delayed response task via two intermediate tasks. During the learning of each new task, a total of 25% of 76 dopamine neurons showed phasic responses to the delivery of primary liquid reward, whereas only 9% of 163 neurons responded to this event once task performance was established. This produced an average population response during but not after learning of each task. Reward responses during learning were significantly more numerous and pronounced in area A10, as compared to areas A8 and A9. Dopamine neurons also showed phasic responses to the two conditioned stimuli. These were the instruction cue, which was the first stimulus in each trial and indicated the target of the upcoming arm movement (58% of 76 neurons during and 44% of 163 neurons after learning), and the trigger stimulus, which was a conditioned incentive stimulus predicting reward and eliciting a saccadic eye movement and an arm reaching movement (38% of neurons during and 40% after learning). None of the dopamine neurons showed sustained activity in the delay between the instruction and trigger stimuli that would resemble the activity of neurons in dopamine terminal areas, such as the striatum and frontal cortex. Thus, dopamine neurons respond phasically to alerting external stimuli with behavioral significance whose detection is crucial for learning and performing delayed response tasks. The lack of sustained activity suggests that dopamine neurons do not encode representational processes, such as working memory, expectation of external stimuli or reward, or preparation of movement. Rather, dopamine neurons are involved with transient changes of impulse activity in basic attentional and motivational processes underlying learning and cognitive behavior.

[1]  J. Fuster Unit activity in prefrontal cortex during delayed-response performance: neuronal correlates of transient memory. , 1973, Journal of neurophysiology.

[2]  K. Kubota,et al.  Visuokinetic activities of primate prefrontal neurons during delayed-response performance. , 1974, Journal of neurophysiology.

[3]  H. Niki Differential activity of prefrontal units during right and left delayed response trials. , 1974, Brain research.

[4]  O. Creutzfeldt,et al.  Extracellular and intracellular recordings from cat's cortical whisker projection area: thalamocortical response transformation. , 1977, Journal of neurophysiology.

[5]  H. Simon,et al.  Dopaminergic A10 neurones are involved in cognitive functions , 1980, Nature.

[6]  J. Szabo Organization of the ascending striatal afferents in monkeys , 1980, The Journal of comparative neurology.

[7]  J. D. Miller,et al.  Mesencephalic dopaminergic unit activity in the behaviorally conditioned rat. , 1981, Life sciences.

[8]  D. Felten,et al.  Monoamine distribution in primate brain. V. Monoaminergic nuclei: Anatomy, pathways, and local organization , 1982, Brain Research Bulletin.

[9]  P. Schwindt,et al.  Negative slope conductance due to a persistent subthreshold sodium current in cat neocortical neurons in vitro , 1982, Brain Research.

[10]  P. Goldman-Rakic,et al.  Brainstem innervation of prefrontal and anterior cingulate cortex in the rhesus monkey revealed by retrograde transport of HRP , 1982, The Journal of comparative neurology.

[11]  D. Felten,et al.  Monoamine distribution in primate brain V. Monoaminergic nuclei: Anatomy, pathways and local organization , 1983, Brain Research Bulletin.

[12]  B. Jacobs,et al.  Behavioral correlates of dopaminergic unit activity in freely moving cats , 1983, Brain Research.

[13]  M. Horstink,et al.  Cognitive and motor shifting aptitude disorder in Parkinson's disease. , 1984, Journal of neurology, neurosurgery, and psychiatry.

[14]  W. Schultz Responses of midbrain dopamine neurons to behavioral trigger stimuli in the monkey. , 1986, Journal of neurophysiology.

[15]  W. Schultz,et al.  Responses of nigrostriatal dopamine neurons to high-intensity somatosensory stimulation in the anesthetized monkey. , 1987, Journal of neurophysiology.

[16]  P. Calabresi,et al.  Intracellular studies on the dopamine-induced firing inhibition of neostriatal neurons in vitro: Evidence for D1 receptor involvement , 1987, Neuroscience.

[17]  J. Saint-Cyr,et al.  Procedural learning and neostriatal dysfunction in man. , 1988, Brain : a journal of neurology.

[18]  C. Wilson,et al.  Intracellular recording of identified neostriatal patch and matrix spiny cells in a slice preparation preserving cortical inputs. , 1989, Journal of neurophysiology.

[19]  W. Schultz,et al.  Dopamine neurons of the monkey midbrain: contingencies of responses to active touch during self-initiated arm movements. , 1990, Journal of neurophysiology.

[20]  J. Schneider,et al.  Chronic exposure to low doses of MPTP. I. Cognitive deficits in motor asymptomatic monkeys , 1990, Brain Research.

[21]  W. Schultz,et al.  Dopamine neurons of the monkey midbrain: contingencies of responses to stimuli eliciting immediate behavioral reactions. , 1990, Journal of neurophysiology.

[22]  T. Sawaguchi,et al.  Catecholaminergic effects on neuronal activity related to a delayed response task in monkey prefrontal cortex. , 1990, Journal of neurophysiology.

[23]  T. Sawaguchi,et al.  Effects of dopamine antagonists on neuronal activity related to a delayed response task in monkey prefrontal cortex. , 1990, Journal of neurophysiology.

[24]  W. Schultz,et al.  Responses of monkey midbrain dopamine neurons during delayed alternation performance , 1991, Brain Research.

[25]  P. Goldman-Rakic,et al.  D1 dopamine receptors in prefrontal cortex: involvement in working memory , 1991, Science.

[26]  W. Schultz,et al.  Responses of monkey dopamine neurons during learning of behavioral reactions. , 1992, Journal of neurophysiology.

[27]  W. Schultz,et al.  Neuronal activity in monkey striatum related to the expectation of predictable environmental events. , 1992, Journal of neurophysiology.

[28]  B. MacVicar,et al.  Multiple types of calcium channels in acutely isolated rat neostriatal neurons , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.