The Involvement of Corticostriatal Loops in Learning Across Tasks, Species, and Methodologies

The basal ganglia contribute to a variety of forms of learning. The first goal of this chapter is to review the different tasks (instrumental conditioning, visual discrimination, arbitrary visuomotor learning, rule learning, categorization, and decision making) that have been used to study basal-ganglia-dependent learning in rodents, monkeys, and humans. These tasks have several features in common: in each, the subject is first presented with a stimulus within a behavioral context, is then required to respond with an appropriate behavior, and finally receives a reward or positive feedback for correct behavior. The second goal of this chapter is to examine how these different features (stimulus, response, and reward) involve the independent corticostriatal loops that connect the basal ganglia with cerebral cortex. The visual corticostriatal loop is involved in aspects of visual stimulus processing; the motor corticostriatal loop is involved in response selection; and the executive and motivation corticostriatal loops are involved in processing feedback and reward. The chapter concludes with a discussion of how the corticostriatal loops interact during learning.

[1]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[2]  M. Packard,et al.  Differential effects of fornix and caudate nucleus lesions on two radial maze tasks: evidence for multiple memory systems , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[3]  J. D. McGaugh,et al.  Double dissociation of fornix and caudate nucleus lesions on acquisition of two water maze tasks: further evidence for multiple memory systems. , 1992, Behavioral neuroscience.

[4]  Leslie G. Ungerleider,et al.  Subcortical connections of inferior temporal areas TE and TEO in macaque monkeys , 1993, The Journal of comparative neurology.

[5]  R. Passingham The frontal lobes and voluntary action , 1993 .

[6]  D. Joel,et al.  The organization of the basal ganglia-thalamocortical circuits: Open interconnected rather than closed segregated , 1994, Neuroscience.

[7]  D. Gaffan,et al.  Visual Learning for an Auditory Secondary Reinforcer by Macaques is Intact after Uncinate Fascicle Section: Indirect Evidence for the Involvement of the Corpus Striatum , 1995, The European journal of neuroscience.

[8]  A. Parent,et al.  Functional anatomy of the basal ganglia. I. The cortico-basal ganglia-thalamo-cortical loop , 1995, Brain Research Reviews.

[9]  M. Mishkin,et al.  Responses of cells in the tail of the caudate nucleus during visual discrimination learning. , 1995, Journal of neurophysiology.

[10]  Jane S. Paulsen,et al.  Dissociations within nondeclarative memory in Huntington's disease. , 1996 .

[11]  Jennifer A. Mangels,et al.  A Neostriatal Habit Learning System in Humans , 1996, Science.

[12]  P. Strick,et al.  The temporal lobe is a target of output from the basal ganglia. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[13]  Gregory Ashby,et al.  A neuropsychological theory of multiple systems in category learning. , 1998, Psychological review.

[14]  L R Squire,et al.  A reexamination of the concurrent discrimination learning task: the importance of anterior inferotemporal cortex, area TE. , 1998, Behavioral neuroscience.

[15]  T. Robbins,et al.  Cognitive functions and corticostriatal circuits: insights from Huntington's disease , 1998, Trends in Cognitive Sciences.

[16]  L. Squire,et al.  A reexamination of the concurrent discrimination learning task , 1998 .

[17]  F. Ashby,et al.  On the nature of implicit categorization , 1999, Psychonomic bulletin & review.

[18]  Carol A. Seger,et al.  Striatal activation during acquisition of a cognitive skill. , 1999, Neuropsychology.

[19]  P. Redgrave,et al.  The basal ganglia: a vertebrate solution to the selection problem? , 1999, Neuroscience.

[20]  C. I. Connolly,et al.  Building neural representations of habits. , 1999, Science.

[21]  T. Bussey,et al.  Role of prefrontal cortex in a network for arbitrary visuomotor mapping , 2000, Experimental Brain Research.

[22]  S. Wise,et al.  Arbitrary associations between antecedents and actions , 2000, Trends in Neurosciences.

[23]  M. Merello,et al.  [Functional anatomy of the basal ganglia]. , 2000, Revista de neurologia.

[24]  L. Squire,et al.  Contrasting Effects on Discrimination Learning after Hippocampal Lesions and Conjoint Hippocampal–Caudate Lesions in Monkeys , 2000, The Journal of Neuroscience.

[25]  Nikolaus R. McFarland,et al.  Striatonigrostriatal Pathways in Primates Form an Ascending Spiral from the Shell to the Dorsolateral Striatum , 2000, The Journal of Neuroscience.

[26]  L. Nystrom,et al.  Tracking the hemodynamic responses to reward and punishment in the striatum. , 2000, Journal of neurophysiology.

[27]  M. Mishkin,et al.  Visual habit formation in monkeys with neurotoxic lesions of the ventrocaudal neostriatum , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[28]  M. Petrides,et al.  Wisconsin Card Sorting Revisited: Distinct Neural Circuits Participating in Different Stages of the Task Identified by Event-Related Functional Magnetic Resonance Imaging , 2001, The Journal of Neuroscience.

[29]  M. Gluck,et al.  Interactive memory systems in the human brain , 2001, Nature.

[30]  E. Hirsch,et al.  Three‐dimensional cartography of functional territories in the human striatopallidal complex by using calbindin immunoreactivity , 2002, The Journal of comparative neurology.

[31]  J. Yelnik Functional anatomy of the basal ganglia , 2002, Movement disorders : official journal of the Movement Disorder Society.

[32]  Carol A. Seger,et al.  Striatal activity in concept learning , 2002, Cognitive, affective & behavioral neuroscience.

[33]  R. Passingham,et al.  Changes of cortico-striatal effective connectivity during visuomotor learning. , 2002, Cerebral cortex.

[34]  Patrick Dupont,et al.  Human Brain Regions Involved in Visual Categorization , 2002, NeuroImage.

[35]  T. Robbins,et al.  Defining the Neural Mechanisms of Probabilistic Reversal Learning Using Event-Related Functional Magnetic Resonance Imaging , 2002, The Journal of Neuroscience.

[36]  D. Boussaoud,et al.  Neuronal activity in the monkey striatum during conditional visuomotor learning , 2003, Experimental Brain Research.

[37]  S. Wise,et al.  Comparison of learning‐related neuronal activity in the dorsal premotor cortex and striatum , 2004, The European journal of neuroscience.

[38]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[39]  J. Wickens,et al.  Computational models of the basal ganglia: from robots to membranes , 2004, Trends in Neurosciences.

[40]  M. Gluck,et al.  Cortico-striatal contributions to feedback-based learning: converging data from neuroimaging and neuropsychology. , 2004, Brain : a journal of neurology.

[41]  T. Robbins,et al.  Differential Responses in Human Striatum and Prefrontal Cortex to Changes in Object and Rule Relevance , 2004, The Journal of Neuroscience.

[42]  T. Robbins,et al.  Putting a spin on the dorsal–ventral divide of the striatum , 2004, Trends in Neurosciences.

[43]  M. Delgado,et al.  Modulation of Caudate Activity by Action Contingency , 2004, Neuron.

[44]  R. Passingham,et al.  Cortico‐basal ganglia pathways are essential for the recall of well–established visuomotor associations , 2004, The European journal of neuroscience.

[45]  A. Graybiel,et al.  Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories , 2005, Nature.

[46]  Camelia M. Kuhnen,et al.  The Neural Basis of Financial Risk Taking , 2005, Neuron.

[47]  E. Miller,et al.  Different time courses of learning-related activity in the prefrontal cortex and striatum , 2005, Nature.

[48]  Carol A. Seger,et al.  The Roles of the Caudate Nucleus in Human Classification Learning , 2005, The Journal of Neuroscience.

[49]  David L. Faigman,et al.  Human category learning. , 2005, Annual review of psychology.

[50]  M. Brass,et al.  Neural Circuitry Underlying Rule Use in Humans and Nonhuman Primates , 2005, The Journal of Neuroscience.

[51]  S. Inati,et al.  An fMRI study of reward-related probability learning , 2005, NeuroImage.

[52]  M. Kawato,et al.  Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning. , 2006, Journal of neurophysiology.

[53]  S. Haber,et al.  Reward-Related Cortical Inputs Define a Large Striatal Region in Primates That Interface with Associative Cortical Connections, Providing a Substrate for Incentive-Based Learning , 2006, The Journal of Neuroscience.

[54]  S. Nicola The nucleus accumbens as part of a basal ganglia action selection circuit , 2007, Psychopharmacology.

[55]  Ziv M. Williams,et al.  Selective enhancement of associative learning by microstimulation of the anterior caudate , 2006, Nature Neuroscience.

[56]  J. Hirsch,et al.  A Neural Representation of Categorization Uncertainty in the Human Brain , 2006, Neuron.

[57]  H. Yin,et al.  The role of the basal ganglia in habit formation , 2006, Nature Reviews Neuroscience.

[58]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[59]  R. Poldrack,et al.  Ventral–striatal/nucleus–accumbens sensitivity to prediction errors during classification learning , 2006, Human brain mapping.

[60]  S. Quartz,et al.  Neural Differentiation of Expected Reward and Risk in Human Subcortical Structures , 2006, Neuron.

[61]  Evan M. Gordon,et al.  Neural Signatures of Economic Preferences for Risk and Ambiguity , 2006, Neuron.

[62]  Russell A Poldrack,et al.  Modulation of competing memory systems by distraction. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[63]  Michael J. Frank,et al.  Hold your horses: A dynamic computational role for the subthalamic nucleus in decision making , 2006, Neural Networks.

[64]  Ivan Toni,et al.  Cerebral Changes during Performance of Overlearned Arbitrary Visuomotor Associations , 2006, The Journal of Neuroscience.

[65]  John McDowall,et al.  When artificial grammar acquisition in Parkinson's disease is impaired: The case of learning via trial-by-trial feedback , 2006, Brain Research.

[66]  Jonathan D. Wallis,et al.  A Comparison of Abstract Rules in the Prefrontal Cortex, Premotor Cortex, Inferior Temporal Cortex, and Striatum , 2006, Journal of Cognitive Neuroscience.

[67]  Carol A. Seger,et al.  Dynamics of frontal, striatal, and hippocampal systems during rule learning. , 2005, Cerebral cortex.

[68]  B. Balleine,et al.  The Role of the Dorsal Striatum in Reward and Decision-Making , 2007, The Journal of Neuroscience.

[69]  M. Kimura,et al.  History- and current instruction-based coding of forthcoming behavioral outcomes in the striatum. , 2007, Journal of neurophysiology.

[70]  Carol A. Seger,et al.  Dissociation between Striatal Regions while Learning to Categorize via Feedback and via Observation , 2007, Journal of Cognitive Neuroscience.

[71]  R. O’Reilly,et al.  Separate neural substrates for skill learning and performance in the ventral and dorsal striatum , 2007, Nature Neuroscience.

[72]  John M. Ennis,et al.  A neurobiological theory of automaticity in perceptual categorization. , 2007, Psychological review.

[73]  W. T. Maddox,et al.  Neural correlates of rule-based and information-integration visual category learning. , 2006, Cerebral cortex.

[74]  Tobias Sommer,et al.  Subregions of the ventral striatum show preferential coding of reward magnitude and probability , 2007, NeuroImage.

[75]  P. Glimcher,et al.  Action and Outcome Encoding in the Primate Caudate Nucleus , 2007, The Journal of Neuroscience.

[76]  Daeyeol Lee,et al.  Encoding of action history in the rat ventral striatum. , 2007, Journal of neurophysiology.

[77]  A. Mikami,et al.  Top-down signal of retrieved information from prefrontal to inferior temporal cortices. , 2007, Journal of neurophysiology.

[78]  Carol A. Seger,et al.  How do the basal ganglia contribute to categorization? Their roles in generalization, response selection, and learning via feedback , 2008, Neuroscience & Biobehavioral Reviews.

[79]  R. Neve,et al.  Transfection of mutant CREB in the striatum, but not the hippocampus, impairs long-term memory for response learning , 2008, Neurobiology of Learning and Memory.