Different time courses of learning-related activity in the prefrontal cortex and striatum

To navigate our complex world, our brains have evolved a sophisticated ability to quickly learn arbitrary rules such as ‘stop at red’. Studies in monkeys using a laboratory test of this capacity—conditional association learning—have revealed that frontal lobe structures (including the prefrontal cortex) as well as subcortical nuclei of the basal ganglia are involved in such learning. Neural correlates of associative learning have been observed in both brain regions, but whether or not these regions have unique functions is unclear, as they have typically been studied separately using different tasks. Here we show that during associative learning in monkeys, neural activity in these areas changes at different rates: the striatum (an input structure of the basal ganglia) showed rapid, almost bistable, changes compared with a slower trend in the prefrontal cortex that was more in accordance with slow improvements in behavioural performance. Also, pre-saccadic activity began progressively earlier in the striatum but not in the prefrontal cortex as learning took place. These results support the hypothesis that rewarded associations are first identified by the basal ganglia, the output of which ‘trains’ slower learning mechanisms in the frontal cortex.

[1]  A. Graybiel The basal ganglia and the initiation of movement. , 1990, Revue neurologique.

[2]  Graybiel Am The basal ganglia and the initiation of movement. , 1990 .

[3]  M. Metz-Lutz Handbook of neuropsychology, Vol 6 et 7, Rapin I, Segalowitz SJ (Eds.). Elsevier (1992) , 1993 .

[4]  R. Passingham The frontal lobes and voluntary action , 1993 .

[5]  S P Wise,et al.  Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling action. , 1995, Cerebral cortex.

[6]  J. Schall,et al.  Neural Control of Voluntary Movement Initiation , 1996, Science.

[7]  Charles J. Wilson,et al.  The origins of two-state spontaneous membrane potential fluctuations of neostriatal spiny neurons , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[8]  C. Gerfen,et al.  The frontal cortex-basal ganglia system in primates. , 1996, Critical reviews in neurobiology.

[9]  J. Fuster The Prefrontal Cortex , 1997 .

[10]  V. Meskenaite,et al.  Calretinin‐immunoreactive local circuit neurons in area 17 of the cynomolgus monkey, Macaca fascicularis , 1997, The Journal of comparative neurology.

[11]  A. Graybiel The Basal Ganglia and Chunking of Action Repertoires , 1998, Neurobiology of Learning and Memory.

[12]  E. Miller,et al.  Neural Activity in the Primate Prefrontal Cortex during Associative Learning , 1998, Neuron.

[13]  J. Hollerman,et al.  Modifications of reward expectation-related neuronal activity during learning in primate striatum. , 1998, Journal of neurophysiology.

[14]  A. Burkhalter,et al.  Connectivity of GABAergic calretinin-immunoreactive neurons in rat primary visual cortex. , 1999, Cerebral cortex.

[15]  R. Lund,et al.  Receptive field properties of single neurons in rat primary visual cortex. , 1999, Journal of neurophysiology.

[16]  S. Wise,et al.  Rule-dependent neuronal activity in the prefrontal cortex , 1999, Experimental Brain Research.

[17]  Ivan Toni,et al.  Prefrontal-basal ganglia pathways are involved in the learning of arbitrary visuomotor associations: a PET study , 1999, Experimental Brain Research.

[18]  B. Connors,et al.  Two networks of electrically coupled inhibitory neurons in neocortex , 1999, Nature.

[19]  I. Ohzawa,et al.  Functional Micro-Organization of Primary Visual Cortex: Receptive Field Analysis of Nearby Neurons , 1999, The Journal of Neuroscience.

[20]  A. Dickinson,et al.  Neuronal coding of prediction errors. , 2000, Annual review of neuroscience.

[21]  T. Bussey,et al.  Role of prefrontal cortex in a network for arbitrary visuomotor mapping , 2000, Experimental Brain Research.

[22]  O. Hikosaka,et al.  Role of the basal ganglia in the control of purposive saccadic eye movements. , 2000, Physiological reviews.

[23]  Edward M Callaway,et al.  Diversity and Cell Type Specificity of Local Excitatory Connections to Neurons in Layer 3B of Monkey Primary Visual Cortex , 2000, Neuron.

[24]  R. O’Reilly,et al.  Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain , 2000 .

[25]  C. Halldin,et al.  A PET study of , 2000, The international journal of neuropsychopharmacology.

[26]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[27]  J. Wickens,et al.  A cellular mechanism of reward-related learning , 2001, Nature.

[28]  O. Hikosaka,et al.  A neural correlate of response bias in monkey caudate nucleus , 2002, Nature.

[29]  B. Knowlton,et al.  Learning and memory functions of the Basal Ganglia. , 2002, Annual review of neuroscience.

[30]  P. Strick,et al.  Basal-ganglia 'projections' to the prefrontal cortex of the primate. , 2002, Cerebral cortex.

[31]  L. Frank,et al.  Single Neurons in the Monkey Hippocampus and Learning of New Associations , 2003, Science.

[32]  M. D’Esposito,et al.  Neural Evidence for Representation-Specific Response Selection , 2003, Journal of Cognitive Neuroscience.

[33]  Andreas Burkhalter,et al.  Distinct GABAergic Targets of Feedforward and Feedback Connections Between Lower and Higher Areas of Rat Visual Cortex , 2003, The Journal of Neuroscience.

[34]  Samuel M. McClure,et al.  Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum , 2003, Neuron.

[35]  D. Boussaoud,et al.  Neuronal activity in the monkey striatum during conditional visuomotor learning , 2003, Experimental Brain Research.

[36]  H. Bergman,et al.  Information processing, dimensionality reduction and reinforcement learning in the basal ganglia , 2003, Progress in Neurobiology.

[37]  S. Wise,et al.  Comparison of learning‐related neuronal activity in the dorsal premotor cortex and striatum , 2004, The European journal of neuroscience.

[38]  Jun Tanji,et al.  Area-selective neuronal activity in the dorsolateral prefrontal cortex for information retrieval and action planning. , 2004, Journal of neurophysiology.