Comparison of population activity in the dorsal premotor cortex and putamen during the learning of arbitrary visuomotor mappings

A previous study found that as monkeys learned novel mappings between visual cues and responses, neuronal activity patterns evolved at approximately the same time in both the dorsal premotor cortex (PMd) and the putamen. Here we report that, in both regions, the population activity for novel mappings came to resemble that for familiar ones as learning progressed. Both regions showed activity differences on trials with correct responses versus those with incorrect ones. In addition to these common features, we observed two noteworthy differences between PMd and putamen activity during learning. After a response choice had been made, but prior to feedback about the correctness of that choice (reward or nonreward), the putamen showed a sustained activity increase in activity, whereas PMd did not. Also in the putamen, this prereward activity was highly selective for the specific visuomotor mapping that had just been performed, and this selectivity was maintained until the time of the reward. After performance reached an asymptote, the degree of this selectivity decreased markedly to the level typical for familiar visuomotor mappings. These findings support the hypothesis that neurons in the striatum play a pivotal role in associative learning.

[1]  Bernice W. Polemis.  Nonparametric Statistics for the Behavioral Sciences , 1959 .

[2]  P. Groves.  A theory of the functional organization of the neostriatum and the neostriatal control of voluntary movement , 1983, Brain Research Reviews.

[3]  M. Petrides.  Deficits in non-spatial conditional associative learning after periarcuate lesions in the monkey , 1985, Behavioural Brain Research.

[4]  R. Passingham,et al.  Premotor cortex and the conditions for movement in monkeys (Macaca fascicularis) , 1985, Behavioural Brain Research.

[5]  S. Foote,et al.  The distribution of tyrosine hydroxylase-immunoreactive fibers in primate neocortex is widespread but regionally specific , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  D. Gaffan,et al.  Monkey hippocampus and learning about spatially directed movements , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  Mitsuo Kawato,et al.  Adaptation and learning in control of voluntary movement by the central nervous system , 1988, Adv. Robotics.

[8]  B. Berger,et al.  Regional and laminar distribution of the dopamine and serotonin innervation in the macaque cerebral cortex: A radioautographic study , 1988, The Journal of comparative neurology.

[9]  David Gaffan,et al.  Inferotemporal-frontal disconnection and fornix transection in visuomotor conditional learning by monkeys , 1988, Behavioural Brain Research.

[10]  L. Squire,et al.  The Neuropsychology of Memory , 1990 .

[11]  S. Wise,et al.  Learning-dependent neuronal activity in the premotor cortex: activity during the acquisition of conditional motor associations , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  M. J. Eacott,et al.  Inferotemporal‐frontal Disconnection: The Uncinate Fascicle and Visual Associative Learning in Monkeys , 1992, The European journal of neuroscience.

[13]  J. Kaas,et al.  Topography and collateralization of the dopaminergic projections to motor and lateral prefrontal cortex in owl monkeys , 1992, The Journal of comparative neurology.

[14]  Alan C. Evans,et al.  Role of the human anterior cingulate cortex in the control of oculomotor, manual, and speech responses: a positron emission tomography study. , 1993, Journal of neurophysiology.

[15]  E. Rolls,et al.  Modification of the responses of hippocampal neurons in the monkey during the learning of a conditional spatial response task , 1993, Hippocampus.

[16]  P. Goldman-Rakic,et al.  Characterization of the dopaminergic innervation of the primate frontal cortex using a dopamine-specific antibody. , 1993, Cerebral cortex.

[17]  A. Barto,et al.  Distributed motor commands in the limb premotor network , 1993, Trends in Neurosciences.

[18]  Joel L. Davis,et al.  A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement , 1994 .

[19]  S. Wise,et al.  Neuronal activity in the supplementary eye field during acquisition of conditional oculomotor associations. , 1995, Journal of neurophysiology.

[20]  S. Wise,et al.  Supplementary eye field contrasted with the frontal eye field during acquisition of conditional oculomotor associations. , 1995, Journal of neurophysiology.

[21]  S P Wise,et al.  Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling action. , 1995, Cerebral cortex.

[22]  Joel L. Davis,et al.  Adaptive Critics and the Basal Ganglia , 1995 .

[23]  J. Mink.  THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS , 1996, Progress in Neurobiology.

[24]  Elisabeth A. Murray,et al.  Role of the hippocampus plus subjacent cortex but not amygdala in visuomotor conditional learning in rhesus monkeys. , 1996, Behavioral neuroscience.

[25]  M. Hallett,et al.  Frontal and parietal networks for conditional motor learning: a positron emission tomography study. , 1997, Journal of neurophysiology.

[26]  R. Ridley,et al.  Evidence for a Specific Information Processing Deficit in Monkeys with Lesions of the Septohippocampal System , 1997, Cortex.

[27]  J. Hollerman,et al.  Influence of reward expectation on behavior-related neuronal activity in primate striatum. , 1998, Journal of neurophysiology.

[28]  J. Hollerman,et al.  Dopamine neurons report an error in the temporal prediction of reward during learning , 1998, Nature Neuroscience.

[29]  S L Moody,et al.  A Model That Accounts for Activity in Primate Frontal Cortex during a Delayed Matching-to-Sample Task , 1998, The Journal of Neuroscience.

[30]  E. Miller,et al.  Neural Activity in the Primate Prefrontal Cortex during Associative Learning , 1998, Neuron.

[31]  J. Hollerman,et al.  Modifications of reward expectation-related neuronal activity during learning in primate striatum. , 1998, Journal of neurophysiology.

[32]  W. Schultz,et al.  A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task , 1999, Neuroscience.

[33]  C. I. Connolly,et al.  Building neural representations of habits. , 1999, Science.

[34]  Ivan Toni,et al.  Prefrontal-basal ganglia pathways are involved in the learning of arbitrary visuomotor associations: a PET study , 1999, Experimental Brain Research.

[35]  R Shadmehr,et al.  Electromyographic Correlates of Learning an Internal Model of Reaching Movements , 1999, The Journal of Neuroscience.

[36]  S. Wise,et al.  Role of the Hippocampal System in Conditional Motor Learning: Mapping Antecedents to Action , 1999, Hippocampus.

[37]  R. Turner,et al.  Corticostriatal Activity in Primary Motor Cortex of the Macaque , 2000, The Journal of Neuroscience.

[38]  E. Ruppin,et al.  Reinforcement-Driven Dimensionality Reduction - A Model for Information Processing in the Basal Ganglia , 2000, Journal of basic and clinical physiology and pharmacology.

[39]  Bao-Ming Li,et al.  Deficit in conditional visuomotor learning by local infusion of bicuculline into the ventral prefrontal cortex in monkeys , 2000, The European journal of neuroscience.

[40]  M. Laubach,et al.  Cortical ensemble activity increasingly predicts behaviour outcomes during learning of a motor task , 2022 .

[41]  Örjan Ekeberg,et al.  Cortex-basal ganglia interaction and attractor states , 2001, Neurocomputing.

[42]  R. Passingham,et al.  Learning Arbitrary Visuomotor Associations: Temporal Dynamic of Brain Activity , 2001, NeuroImage.

[43]  Peter Redgrave,et al.  A computational model of action selection in the basal ganglia. I. A new functional anatomy , 2001, Biological Cybernetics.

[44]  W. Schultz,et al.  Dopamine responses comply with basic assumptions of formal learning theory , 2001, Nature.

[45]  Hagai Bergman,et al.  Stepping out of the box: information processing in the neural networks of the basal ganglia , 2001, Current Opinion in Neurobiology.

[46]  M. Arbib,et al.  Modeling functions of striatal dopamine modulation in learning and planning , 2001, Neuroscience.

[47]  M. Inase,et al.  Pallidal activity is involved in visuomotor association learning in monkeys , 2001, The European journal of neuroscience.

[48]  S P Wise,et al.  The role of ventral and orbital prefrontal cortex in conditional visuomotor learning and strategy use in rhesus monkeys (Macaca mulatta). , 2001, Behavioral neuroscience.

[49]  Joshua W. Brown,et al.  Monitoring and Control of Action by the Frontal Lobes , 2002, Neuron.

[50]  R. Ridley,et al.  Crossed unilateral lesions of temporal lobe structures and cholinergic cell bodies impair visual conditional and object discrimination learning in monkeys , 2002, The European journal of neuroscience.

[51]  T. Bussey,et al.  Interaction of ventral and orbital prefrontal cortex with inferotemporal cortex in conditional visuomotor learning. , 2002, Behavioral neuroscience.

[52]  R. Passingham,et al.  Changes of cortico-striatal effective connectivity during visuomotor learning. , 2002, Cerebral cortex.

[53]  T. Bussey,et al.  Fornix transection impairs conditional visuomotor learning in tasks involving nonspatially differentiated responses. , 2002, Journal of neurophysiology.

[54]  Charles J. Wilson,et al.  Corticostriatal combinatorics: the implications of corticostriatal axonal arborizations. , 2002, Journal of neurophysiology.

[55]  L. Frank,et al.  Single Neurons in the Monkey Hippocampus and Learning of New Associations , 2003, Science.

[56]  Jerald D. Kralik,et al.  Chronic, multisite, multielectrode recordings in macaque monkeys , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[57]  O. Hikosaka,et al.  Correlation of primate caudate neural activity and saccade parameters in reward-oriented behavior. , 2003, Journal of neurophysiology.

[58]  Driss Boussaoud,et al.  Conditional visuo-motor learning in primates: a key role for the basal ganglia , 2003, Journal of Physiology-Paris.

[59]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[60]  J. Sanes,et al.  Experience-Dependent Activation Patterns in Human Brain during Visual-Motor Associative Learning , 2003, The Journal of Neuroscience.

[61]  S P Wise,et al.  Role of the hippocampal system in associative learning beyond the spatial domain. , 2003, Brain : a journal of neurology.

[62]  J. Hollerman,et al.  Changes in behavior-related neuronal activity in the striatum during learning , 2003, Trends in Neurosciences.

[63]  Joshua W. Brown,et al.  Performance Monitoring by the Anterior Cingulate Cortex During Saccade Countermanding , 2003, Science.

[64]  D. Boussaoud,et al.  Neuronal activity in the monkey striatum during conditional visuomotor learning , 2003, Experimental Brain Research.

[65]  C. J. Maclean,et al.  Unilateral hippocampal and inferotemporal cortex lesions in opposite hemispheres impair learning of single-pair visual discriminations as well as visuovisual conditional tasks in monkeys , 2003, Behavioural Brain Research.

[66]  S. Wise,et al.  Comparison of learning‐related neuronal activity in the dorsal premotor cortex and striatum , 2004, The European journal of neuroscience.

[67]  O. Hikosaka,et al.  A possible role of midbrain dopamine neurons in short- and long-term adaptation of saccades to position-reward mapping. , 2004, Journal of neurophysiology.

[68]  M. Gluck,et al.  Cortico-striatal contributions to feedback-based learning: converging data from neuroimaging and neuropsychology. , 2004, Brain : a journal of neurology.

[69]  W. Schultz.  Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology , 2004, Current Opinion in Neurobiology.

[70]  S. Wise,et al.  Premotor cortex of the rhesus monkey: neuronal activity in anticipation of predictable environmental events , 2004, Experimental Brain Research.

[71]  R. Passingham,et al.  Motor learning in monkeys (Macaca fascicularis) with lesions in motor thalamus , 2004, Experimental Brain Research.

[72]  O. Hikosaka,et al.  Reward-predicting activity of dopamine and caudate neurons--a possible mechanism of motivational control of saccadic eye movement. , 2004, Journal of neurophysiology.

[73]  M. D. Crutcher,et al.  Single cell studies of the primate putamen , 2004, Experimental Brain Research.

[74]  M. Roesch,et al.  Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex , 2004, Science.

[75]  Karl J. Friston,et al.  Cortical areas and the selection of movement: a study with positron emission tomography , 1991, Experimental Brain Research.

[76]  R. Passingham,et al.  Cortico‐basal ganglia pathways are essential for the recall of well–established visuomotor associations , 2004, The European journal of neuroscience.

[77]  E. Miller,et al.  Different time courses of learning-related activity in the prefrontal cortex and striatum , 2005, Nature.