The Basal Ganglia and Chunking of Action Repertoires

The basal ganglia have been shown to contribute to habit and stimulus-response (S-R) learning. These forms of learning have the property of slow acquisition and, in humans, can occur without conscious awareness. This paper proposes that one aspect of basal ganglia-based learning is the recoding of cortically derived information within the striatum. Modular corticostriatal projection patterns, demonstrated experimentally, are viewed as producing recoded templates suitable for the gradual selection of new input-output relations in cortico-basal ganglia loops. Recordings from striatal projection neurons and interneurons show that activity patterns in the striatum are modified gradually during the course of S-R learning. It is proposed that this recoding within the striatum can chunk the representations of motor and cognitive action sequences so that they can be implemented as performance units. This scheme generalizes Miller's notion of information chunking to action control. The formation and the efficient implementation of action chunks are viewed as being based on predictive signals. It is suggested that information chunking provides a mechanism for the acquisition and the expression of action repertoires that, without such information compression would be biologically unwieldy or difficult to implement. The learning and memory functions of the basal ganglia are thus seen as core features of the basal ganglia's influence on motor and cognitive pattern generators.

[1]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[2]  R. Hirsh The hippocampus and contextual retrieval of information from memory: a theory. , 1974, Behavioral biology.

[3]  A. Routtenberg,et al.  THE SUBSTANTIA NIGRA AND NEOSTRIATUM: SUBSTRATES FOR MEMORY CONSOLIDATION* , 1978 .

[4]  Kenneth W. Flowers,et al.  Lack of prediction in the motor behaviour of Parkinsonism. , 1978, Brain : a journal of neurology.

[5]  L. Butcher Cholinergic-monoaminergic interactions in the brain , 1978 .

[6]  C. W. Ragsdale,et al.  Histochemically distinct compartments in the striatum of human, monkeys, and cat demonstrated by acetylthiocholinesterase staining. , 1978, Proceedings of the National Academy of Sciences of the United States of America.

[7]  J. Schneider,et al.  Processing of somatosensory information in striatum of behaving cats. , 1981, Journal of neurophysiology.

[8]  Joaquin M. Fuster,et al.  Single cell activity in ventral prefrontal cortex of behaving monkeys , 1981, Brain Research.

[9]  R. Malach,et al.  Mosaic architecture of the somatic sensory-recipient sector of the cat's striatum , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  C. Marsden,et al.  Disturbance of sequential movements in patients with Parkinson's disease. , 1987, Brain : a journal of neurology.

[11]  C. Marsden What do the basal ganglia tell premotor cortical areas? , 1987, Ciba Foundation symposium.

[12]  Marsden Cd What do the basal ganglia tell premotor cortical areas , 1987 .

[13]  A. Crossman Neural mechanisms in disorders of movement. , 1989, Comparative biochemistry and physiology. A, Comparative physiology.

[14]  O Hikosaka,et al.  Functional properties of monkey caudate neurons. II. Visual and auditory responses. , 1989, Journal of neurophysiology.

[15]  O. Hikosaka,et al.  Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. , 1989, Journal of neurophysiology.

[16]  Richard J. Brown Neuropsychology Mental Structure , 1989 .

[17]  M. Moscovitch,et al.  Memory for temporal order and conditional associative-learning in patients with Parkinson's disease , 1990, Neuropsychologia.

[18]  G. E. Alexander,et al.  Preparation for movement: neural representations of intended direction in three motor areas of the monkey. , 1990, Journal of neurophysiology.

[19]  S. Stone-Elander,et al.  Motor learning in man: a positron emission tomographic study. , 1990, Neuroreport.

[20]  D. Harrington,et al.  SEQUENCING IN PARKINSON'S DISEASE , 1991 .

[21]  S. Wise,et al.  Learning-dependent neuronal activity in the premotor cortex: activity during the acquisition of conditional motor associations , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[22]  T. Robbins,et al.  Dissociable roles of the ventral, medial and lateral striatum on the acquisition and performance of a complex visual stimulus-response habit , 1991, Behavioural Brain Research.

[23]  D. Harrington,et al.  Sequencing in Parkinson's disease. Abnormalities in programming and controlling movement. , 1991, Brain : a journal of neurology.

[24]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[25]  A. Graybiel,et al.  Distributed but convergent ordering of corticostriatal projections: analysis of the frontal eye field and the supplementary eye field in the macaque monkey , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[26]  R. Seitz,et al.  Learning of Sequential Finger Movements in Man: A Combined Kinematic and Positron Emission Tomography (PET) Study , 1992, The European journal of neuroscience.

[27]  P Pietrini,et al.  Cerebral glucose metabolism in childhood-onset obsessive-compulsive disorder. Revisualization during pharmacotherapy. , 1992, Archives of general psychiatry.

[28]  J. Mazziotta,et al.  Caudate glucose metabolic rate changes with both drug and behavior therapy for obsessive-compulsive disorder. , 1992, Archives of general psychiatry.

[29]  A. Graybiel,et al.  Dendritic arbors of spiny neurons in the primate striatum are directionally polarized , 1993, The Journal of comparative neurology.

[30]  R. J. McDonald,et al.  A triple dissociation of memory systems: hippocampus, amygdala, and dorsal striatum. , 1993, Behavioral neuroscience.

[31]  Charles J. Wilson,et al.  The generation of natural firing patterns in neostriatal neurons. , 1993, Progress in brain research.

[32]  A. Graybiel,et al.  Dendritic domains of medium spiny neurons in the primate striatum: Relationships to striosomal borders , 1993, The Journal of comparative neurology.

[33]  A. Graybiel,et al.  Two input systems for body representations in the primate striatal matrix: experimental evidence in the squirrel monkey , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[34]  Jun Tanji,et al.  Role for supplementary motor area cells in planning several movements ahead , 1994, Nature.

[35]  N. Alpert,et al.  Regional cerebral blood flow measured during symptom provocation in obsessive-compulsive disorder using oxygen 15-labeled carbon dioxide and positron emission tomography. , 1994, Archives of general psychiatry.

[36]  A. Flaherty,et al.  Input-output organization of the sensorimotor striatum in the squirrel monkey , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[37]  A M Graybiel,et al.  The basal ganglia and adaptive motor control. , 1994, Science.

[38]  J P Donoghue,et al.  Motor Areas of the Cerebral Cortex , 1994, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[39]  A. Graybiel,et al.  Responses of tonically active neurons in the primate's striatum undergo systematic changes during behavioral sensorimotor conditioning , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[40]  A. Graybiel,et al.  Effect of the nigrostriatal dopamine system on acquired neural responses in the striatum of behaving monkeys. , 1994, Science.

[41]  R. Kötter Postsynaptic integration of glutamatergic and dopaminergic signals in the striatum , 1994, Progress in Neurobiology.

[42]  S. Kosslyn,et al.  A PET investigation of implicit and explicit sequence learning , 1995 .

[43]  A. Graybiel,et al.  Highly restricted origin of prefrontal cortical inputs to striosomes in the macaque monkey , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[44]  J. Joseph,et al.  Activity in the caudate nucleus of monkey during spatial sequencing. , 1995, Journal of neurophysiology.

[45]  A. Graybiel Building action repertoires: memory and learning functions of the basal ganglia , 1995, Current Opinion in Neurobiology.

[46]  D. Salmon,et al.  Neurobiology of skill and habit learning , 1995, Current Opinion in Neurobiology.

[47]  A. Parent,et al.  Functional anatomy of the basal ganglia. I. The cortico-basal ganglia-thalamo-cortical loop , 1995, Brain Research Reviews.

[48]  S. Wise,et al.  Neuronal activity in the supplementary eye field during acquisition of conditional oculomotor associations. , 1995, Journal of neurophysiology.

[49]  Xiaoqin Wang,et al.  Remodelling of hand representation in adult cortex determined by timing of tactile stimulation , 1995, Nature.

[50]  M. J. Guerra,et al.  Cortical stimulation induces Fos expression in striatal neurons via NMDA glutamate and dopamine receptors , 1995, Brain Research.

[51]  Spatial learning. The LTP-memory connection. , 1995, Nature.

[52]  A. Graybiel,et al.  Adaptive neural networks in the basal ganglia. , 1995 .

[53]  Joel L. Davis,et al.  Adaptive Critics and the Basal Ganglia , 1995 .

[54]  M. Mishkin,et al.  Responses of cells in the tail of the caudate nucleus during visual discrimination learning. , 1995, Journal of neurophysiology.

[55]  H Mushiake,et al.  Pallidal neuron activity during sequential arm movements. , 1995, Journal of neurophysiology.

[56]  A. Graybiel,et al.  Temporal and spatial characteristics of tonically active neurons of the primate's striatum. , 1995, Journal of neurophysiology.

[57]  Colin Wilson The contribution of cortical neurons to the firing pattern of striatal spiny neurons , 1995 .

[58]  H. Eichenbaum The LTP–memory connection , 1995, Nature.

[59]  T. Sejnowski,et al.  How the Basal Ganglia Make Decisions , 1996 .

[60]  J. Wickens,et al.  Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex In vitro , 1996, Neuroscience.

[61]  A. Damasio,et al.  Neurobiology of Decision-Making , 2012, Research and Perspectives in Neurosciences.

[62]  N. P. Bichot,et al.  Visual feature selectivity in frontal eye fields induced by experience in mature macaques , 1996, Nature.

[63]  D. Oorschot Total number of neurons in the neostriatal, pallidal, subthalamic, and substantia nigral nuclei of the rat basal ganglia: A stereological study using the cavalieri and optical disector methods , 1996, The Journal of comparative neurology.

[64]  P. Calabresi,et al.  The corticostriatal projection: from synaptic plasticity to dysfunctions of the basal ganglia , 1996, Trends in Neurosciences.

[65]  Jennifer A. Mangels,et al.  A Neostriatal Habit Learning System in Humans , 1996, Science.

[66]  J. D. McGaugh,et al.  Inactivation of Hippocampus or Caudate Nucleus with Lidocaine Differentially Affects Expression of Place and Response Learning , 1996, Neurobiology of Learning and Memory.

[67]  M. E. Anderson,et al.  Changes in the control of arm position, movement, and thalamic discharge during local inactivation in the globus pallidus of the monkey. , 1996, Journal of neurophysiology.

[68]  M. Tanaka,et al.  Coding of modified body schema during tool use by macaque postcentral neurones. , 1996, Neuroreport.

[69]  Wendy A. Suzuki,et al.  Neuroanatomy of the monkey entorhinal, perirhinal and parahippocampal cortices: Organization of cortical inputs and interconnections with amygdala and striatum , 1996 .

[70]  M E Phelps,et al.  Systematic changes in cerebral glucose metabolic rate after successful behavior modification treatment of obsessive-compulsive disorder. , 1996, Archives of general psychiatry.

[71]  J. Mink THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS , 1996, Progress in Neurobiology.

[72]  J Tanji,et al.  Role for cells in the presupplementary motor area in updating motor plans. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[73]  K. Berridge,et al.  Implementation of Action Sequences by a Neostriatal Site: A Lesion Mapping Study of Grooming Syntax , 1996, The Journal of Neuroscience.

[74]  S. Wise,et al.  Evolution of Directional Preferences in the Supplementary Eye Field during Acquisition of Conditional Oculomotor Associations , 1996, The Journal of Neuroscience.

[75]  H. Kita Glutamatergic and gabaergic postsynaptic responses of striatal spiny neurons to intrastriatal and cortical stimulation recorded in slice preparations , 1996, Neuroscience.

[76]  J. D. McGaugh,et al.  Stria Terminalis Lesions Attenuate Memory Enhancement Produced by Intracaudate Nucleus Injections of Oxotremorine , 1996, Neurobiology of Learning and Memory.

[77]  O. Hikosaka,et al.  Activation of human presupplementary motor area in learning of sequential procedures: a functional MRI study. , 1996, Journal of neurophysiology.

[78]  P. Calabresi,et al.  Abnormal Synaptic Plasticity in the Striatum of Mice Lacking Dopamine D2 Receptors , 1997, The Journal of Neuroscience.

[79]  H. Parthasarathy,et al.  Local Release of GABAergic Inhibition in the Motor Cortex Induces Immediate-Early Gene Expression in Indirect Pathway Neurons of the Striatum , 1997, The Journal of Neuroscience.

[80]  N. White Mnemonic functions of the basal ganglia , 1997, Current Opinion in Neurobiology.

[81]  M. E. Anderson,et al.  Pallidal discharge related to the kinematics of reaching movements in two dimensions. , 1997, Journal of neurophysiology.

[82]  Richard S. J. Frackowiak,et al.  Anatomy of motor learning. II. Subcortical structures and learning by trial and error. , 1997, Journal of neurophysiology.

[83]  A M Graybiel,et al.  Cortically Driven Immediate-Early Gene Expression Reflects Modular Influence of Sensorimotor Cortex on Identified Striatal Neurons in the Squirrel Monkey , 1997, The Journal of Neuroscience.

[84]  Richard S. J. Frackowiak,et al.  Anatomy of motor learning. I. Frontal cortex and attention to action. , 1997, Journal of neurophysiology.

[85]  M Hallett,et al.  Stimulation over the human supplementary motor area interferes with the organization of future elements in complex motor sequences. , 1997, Brain : a journal of neurology.

[86]  S. Rauch,et al.  Striatal recruitment during an implicit sequence learning task as measured by functional magnetic resonance imaging , 1997, Human brain mapping.

[87]  J. Deniau,et al.  Effect of electrical stimulation of the cerebral cortex on the expression of the fos protein in the basal ganglia , 1997, Neuroscience.

[88]  W. Schultz Dopamine neurons and their role in reward mechanisms , 1997, Current Opinion in Neurobiology.

[89]  S. Charpier,et al.  In vivo activity-dependent plasticity at cortico-striatal connections: evidence for physiological long-term potentiation. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[90]  The role of cortico-striatal circuits in learning sequential information. , 1999, Advances in neurology.

[91]  M. Merello,et al.  [Functional anatomy of the basal ganglia]. , 2000, Revista de neurologia.