Conditional routing of information to the cortex: a model of the basal ganglia's role in cognitive coordination.

The basal ganglia play a central role in cognition and are involved in such general functions as action selection and reinforcement learning. Here, we present a model exploring the hypothesis that the basal ganglia implement a conditional information-routing system. The system directs the transmission of cortical signals between pairs of regions by manipulating separately the selection of sources and destinations of information transfers. We suggest that such a mechanism provides an account for several cognitive functions of the basal ganglia. The model also incorporates a possible mechanism by which subsequent transfers of information control the release of dopamine. This signal is used to produce novel stimulus-response associations by internalizing transferred cortical representations in the striatum. We discuss how the model is related to production systems and cognitive architectures. A series of simulations is presented to illustrate how the model can perform simple stimulus-response tasks, develop automatic behaviors, and provide an account of impairments in Parkinson's and Huntington's diseases.

[1]  HighWire Press.  Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[2]  J. O. Urmson,et al.  The William James Lectures , 1963 .

[3]  W. Cowan,et al.  THE ORGANIZATION OF CORTICO-STRIATE CONNEXIONSIN THE RABBIT. , 1963, Brain : a journal of neurology.

[4]  T. Powell,et al.  The cortico-striate projection in the monkey. , 1970, Brain : a journal of neurology.

[5]  Allen Newell,et al.  Production Systems: Models of Control Structures , 1973 .

[6]  W. Chase,et al.  Visual information processing. , 1974 .

[7]  H. Fibiger,et al.  Demonstration of a pallido‐nigral projection innervating dopaminergic neurons , 1975, The Journal of comparative neurology.

[8]  P. Groves,et al.  The substantia nigra of the rat: A golgi study , 1977, The Journal of comparative neurology.

[9]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[10]  C. W. Ragsdale,et al.  Histochemically distinct compartments in the striatum of human, monkeys, and cat demonstrated by acetylthiocholinesterase staining. , 1978, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Charles J. Wilson,et al.  Fine structure and synaptic connections of the common spiny neuron of the rat neostriatum: A study employing intracellular injection of horseradish peroxidase , 1980 .

[12]  L. Squire,et al.  Preserved learning and retention of pattern-analyzing skill in amnesia: dissociation of knowing how and knowing that. , 1980, Science.

[13]  P. Groves,et al.  Fine structure and synaptic connections of the common spiny neuron of the rat neostriatum: a study employing intracellular inject of horseradish peroxidase. , 1980, The Journal of comparative neurology.

[14]  J. D. Miller,et al.  Mesencephalic dopaminergic unit activity in the behaviorally conditioned rat. , 1981, Life sciences.

[15]  P. Somogyi,et al.  Monosynaptic cortical input and local axon collaterals of identified striatonigral neurons. A light and electron microscopic study using the golgi‐peroxidase transport‐degeneration procedure , 1981, The Journal of comparative neurology.

[16]  Charles J. Wilson,et al.  Spontaneous firing patterns of identified spiny neurons in the rat neostriatum , 1981, Brain Research.

[17]  T. Shallice.  Specific impairments of planning. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[18]  C. Gerfen,et al.  Crossed connections of the substantia nigra in the rat , 1982, The Journal of comparative neurology.

[19]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  Joseph B. Martin.  Huntington's disease , 1984, Neurology.

[21]  C. Gerfen.  The neostriatal mosaic: compartmentalization of corticostriatal input and striatonigral output systems , 1984, Nature.

[22]  G. Graveland,et al.  A Golgi study of the human neostriatum: Neurons and afferent fibers , 1985, The Journal of comparative neurology.

[23]  C. Gerfen,et al.  The neostriatal mosaic: compartmental distribution of calcium-binding protein and parvalbumin in the basal ganglia of the rat and monkey. , 1985, Proceedings of the National Academy of Sciences of the United States of America.

[24]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[25]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[26]  J. Penney,et al.  Striatal inhomogeneities and basal ganglia function , 1986, Movement disorders : official journal of the Movement Disorder Society.

[27]  H. Kita,et al.  Intracellular study of rat substantia nigra pars reticulata neurons in an in vitro slice preparation: electrical membrane properties and response characteristics to subthalamic stimulation , 1987, Brain Research.

[28]  M. Nissen,et al.  Attentional requirements of learning: Evidence from performance measures , 1987, Cognitive Psychology.

[29]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[30]  E. Scarnati,et al.  Pharmacological study of the cortical-induced excitation of subthalamic nucleus neurons in the rat: Evidence for amino acids as putative neurotransmitters , 1987, Neuroscience.

[31]  G. Bower,et al.  From conditioning to category learning: an adaptive network model. , 1988, Journal of experimental psychology. General.

[32]  J. Penney,et al.  Differential loss of striatal projection neurons in Huntington disease. , 1988, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Geoffrey E. Hinton,et al.  A Distributed Connectionist Production System , 1988, Cogn. Sci..

[34]  H. Kita,et al.  Glutamate decarboxylase immunoreactive neurons in rat neostriatum: their morphological types and populations , 1988, Brain Research.

[35]  M. Packard,et al.  Differential effects of fornix and caudate nucleus lesions on two radial maze tasks: evidence for multiple memory systems , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[36]  W. Weiner,et al.  Cognitive impairments associated with early Parkinson's disease , 1989, Neurology.

[37]  J. Penney,et al.  The functional anatomy of basal ganglia disorders , 1989, Trends in Neurosciences.

[38]  J. Deniau,et al.  Disinhibition as a basic process in the expression of striatal functions , 1990, Trends in Neurosciences.

[39]  E. W. Kairiss,et al.  Hebbian synapses: biophysical mechanisms and algorithms. , 1990, Annual review of neuroscience.

[40]  M. Delong,et al.  Primate models of movement disorders of basal ganglia origin , 1990, Trends in Neurosciences.

[41]  A. D. Smith,et al.  The neural network of the basal ganglia as revealed by the study of synaptic connections of identified neurones , 1990, Trends in Neurosciences.

[42]  C. Gerfen,et al.  D1 and D2 dopamine receptor-regulated gene expression of striatonigral and striatopallidal neurons. , 1990, Science.

[43]  L. Squire,et al.  The Neuropsychology of Memory , 1990 .

[44]  Richard Reviewer-Granger.  Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[45]  Prof. Dr. Valentino Braitenberg,et al.  Anatomy of the Cortex , 1991, Studies of Brain Function.

[46]  J. Wickens,et al.  Two dynamic modes of striatal function under dopaminergic‐cholinergic control: Simulation and analysis of a model , 1991, Synapse.

[47]  Lokendra Shastri,et al.  Rules and Variables in Neural Nets , 1991, Neural Computation.

[48]  Geoffrey E. Hinton.  Tensor Product Variable Binding and the Representation of Symbolic Structures in Connectionist Systems , 1991 .

[49]  T. M. Mayhew,et al.  Anatomy of the Cortex: Statistics and Geometry. , 1991 .

[50]  Jérôme Yelnik,et al.  Morphological taxonomy of the neurons of the primate striatum , 1991, The Journal of comparative neurology.

[51]  A. Graybiel,et al.  Distributed but convergent ordering of corticostriatal projections: analysis of the frontal eye field and the supplementary eye field in the macaque monkey , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[52]  M. Just,et al.  From the SelectedWorks of Marcel Adam Just 1992 A capacity theory of comprehension : Individual differences in working memory , 2017 .

[53]  J. D. McGaugh,et al.  Double dissociation of fornix and caudate nucleus lesions on acquisition of two water maze tasks: further evidence for multiple memory systems. , 1992, Behavioral neuroscience.

[54]  C. Gerfen.  The neostriatal mosaic: multiple levels of compartmental organization in the basal ganglia. , 1992, Annual review of neuroscience.

[55]  L. Squire.  Declarative and Nondeclarative Memory: Multiple Brain Systems Supporting Learning and Memory , 1992, Journal of Cognitive Neuroscience.

[56]  H J Sagar,et al.  Different effects of dopaminergic and anticholinergic therapies on cognitive and motor function in Parkinson's disease. A follow-up study of untreated patients. , 1992, Brain : a journal of neurology.

[57]  J. Penney,et al.  Preferential loss of striato‐external pallidal projection neurons in presymptomatic Huntington's disease , 1992, Annals of neurology.

[58]  W. T. Thach,et al.  Basal ganglia intrinsic circuits and their role in behavior , 1993, Current Opinion in Neurobiology.

[59]  P. Strick,et al.  Multiple output channels in the basal ganglia. , 1993, Science.

[60]  Daniel B. Willingham,et al.  Evidence for dissociable motor skills in Huntington’s disease patients , 1993, Psychobiology.

[61]  Charles J. Wilson,et al.  The generation of natural firing patterns in neostriatal neurons. , 1993, Progress in brain research.

[62]  W. Schultz,et al.  Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[63]  Jane S. Paulsen,et al.  Prism adaptation in Alzheimer's and Huntington's disease. , 1993 .

[64]  J. Wickens,et al.  The corticostriatal system on computer simulation: an intermediate mechanism for sequencing of actions. , 1993, Progress in brain research.

[65]  S. Greenfield,et al.  Synaptic connections between pars compacta and pars reticulata neurones: electrophysiological evidence for functional modules within the substantia nigra , 1994, Brain Research.

[66]  D. Shanks,et al.  Characteristics of dissociable human learning systems , 1994, Behavioral and Brain Sciences.

[67]  Joel L. Davis,et al.  A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement , 1994 .

[68]  S. Petersen,et al.  Practice-related changes in human brain functional anatomy during nonmotor learning. , 1994, Cerebral cortex.

[69]  M. Gluck,et al.  Probabilistic classification learning in amnesia. , 1994, Learning & memory.

[70]  P. Strick,et al.  Anatomical evidence for cerebellar and basal ganglia involvement in higher cognitive function. , 1994, Science.

[71]  D. Joel,et al.  The organization of the basal ganglia-thalamocortical circuits: Open interconnected rather than closed segregated , 1994, Neuroscience.

[72]  Charles J. Wilson,et al.  Surround inhibition among projection neurons is weak or nonexistent in the rat neostriatum. , 1994, Journal of neurophysiology.

[73]  JM Tepper,et al.  GABAA receptor-mediated inhibition of rat substantia nigra dopaminergic neurons by pars reticulata projection neurons , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[74]  Tony A. Plate,et al.  Holographic reduced representations , 1995, IEEE Trans. Neural Networks.

[75]  L. Henderson,et al.  Serial reaction time learning and Parkinson's disease: Evidence for a procedural learning deficit , 1995, Neuropsychologia.

[76]  Peter Ford Dominey,et al.  A Model of Corticostriatal Plasticity for Learning Oculomotor Associations and Sequences , 1995, Journal of Cognitive Neuroscience.

[77]  A. Barto,et al.  Adaptive Critics and the Basal Ganglia , 1994 .

[78]  A. Canavan,et al.  Associative learning in degenerative neostriatal disorders: Contrasts in explicit and implicit remembering between Parkinson's and huntington's diseases , 1995, Movement disorders : official journal of the Movement Disorder Society.

[79]  O. Hikosaka,et al.  Learning of sequential movements in the monkey: process of learning and retention of memory. , 1995, Journal of neurophysiology.

[80]  Joel L. Davis,et al.  Adaptive Critics and the Basal Ganglia , 1995 .

[81]  A. Parent,et al.  Functional anatomy of the basal ganglia. II. The place of subthalamic nucleus and external pallidium in basal ganglia circuitry , 1995, Brain Research Reviews.

[82]  J. Wickens,et al.  Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex In vitro , 1996, Neuroscience.

[83]  Y. Smith,et al.  The subthalamic nucleus and the external pallidum: two tightly interconnected structures that control the output of the basal ganglia in the monkey , 1996, Neuroscience.

[84]  L. Squire,et al.  Structure and function of declarative and nondeclarative memory systems. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[85]  Jennifer A. Mangels,et al.  A Neostriatal Habit Learning System in Humans , 1996, Science.

[86]  M. Chesselet,et al.  Basal ganglia and movement disorders: an update , 1996, Trends in Neurosciences.

[87]  J. D. McGaugh,et al.  Inactivation of Hippocampus or Caudate Nucleus with Lidocaine Differentially Affects Expression of Place and Response Learning , 1996, Neurobiology of Learning and Memory.

[88]  John D. E. Gabrieli,et al.  Reduced working memory span in Parkinson's disease: Evidence for the role of frontostriatal system in working and strategic memory. , 1996 .

[89]  Alan C. Evans,et al.  Planning and Spatial Working Memory: a Positron Emission Tomography Study in Humans , 1996, The European journal of neuroscience.

[90]  P. Strick,et al.  The temporal lobe is a target of output from the basal ganglia. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[91]  Alan C. Evans,et al.  Functional Anatomy of Visuomotor Skill Learning in Human Subjects Examined with Positron Emission Tomography , 1996, The European journal of neuroscience.

[92]  John D. E. Gabrieli,et al.  Reduced working memory span in Parkinson's disease: Evidence for the role of frontostriatal system in working and strategic memory. , 1996 .

[93]  Randall C. O'Reilly,et al.  Biologically Plausible Error-Driven Learning Using Local Activation Differences: The Generalized Recirculation Algorithm , 1996, Neural Computation.

[94]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[95]  T. Robbins,et al.  Spatial and non-spatial working memory at different stages of Parkinson's disease , 1997, Neuropsychologia.

[96]  Edward E. Smith,et al.  A Parametric Study of Prefrontal Cortex Involvement in Human Working Memory , 1996, NeuroImage.

[97]  S. Rauch,et al.  Striatal recruitment during an implicit sequence learning task as measured by functional magnetic resonance imaging , 1997, Human brain mapping.

[98]  L. Brown,et al.  Sensory and cognitive functions of the basal ganglia , 1997, Current Opinion in Neurobiology.

[99]  S. Pinker,et al.  A Neural Dissociation within Language: Evidence that the Mental Dictionary Is Part of Declarative Memory, and that Grammatical Rules Are Processed by the Procedural System , 1997, Journal of Cognitive Neuroscience.

[100]  M. West,et al.  Loss of Lever Press-Related Firing of Rat Striatal Forelimb Neurons after Repeated Sessions in a Lever Pressing Task , 1997, The Journal of Neuroscience.

[101]  D E Kieras,et al.  A computational theory of executive cognitive processes and multiple-task performance: Part 1. Basic mechanisms. , 1997, Psychological review.

[102]  Y. Kawaguchi.  Neostriatal cell subtypes and their functional roles , 1997, Neuroscience Research.

[103]  David E. Kieras,et al.  A computational theory of executive cognitive processes and multiple-task performance: Part 2. Accounts of psychological refractory-period phenomena. , 1997 .

[104]  O. Hikosaka,et al.  Differential roles of monkey striatum in learning of sequential hand movement , 1997, Experimental Brain Research.

[105]  T. Robbins,et al.  Cognitive functions and corticostriatal circuits: insights from Huntington's disease , 1998, Trends in Cognitive Sciences.

[106]  W. Schultz,et al.  Learning of sequential movements by neural network model with dopamine-like reinforcement signal , 1998, Experimental Brain Research.

[107]  J. Gabrieli.  Cognitive neuroscience of human memory. , 1998, Annual review of psychology.

[108]  E. Rolls,et al.  Neural networks and brain function , 1998 .

[109]  T. Sejnowski,et al.  A Computational Model of How the Basal Ganglia Produce Sequences , 1998, Journal of Cognitive Neuroscience.

[110]  J. Bolam,et al.  Selective Innervation of Neostriatal Interneurons by a Subclass of Neuron in the Globus Pallidus of the Rat , 1998, The Journal of Neuroscience.

[111]  J. Houk,et al.  Model of cortical-basal ganglionic processing: encoding the serial order of sensory events. , 1998, Journal of neurophysiology.

[112]  C. Wilson,et al.  Mechanisms Underlying Spontaneous Oscillation and Rhythmic Firing in Rat Subthalamic Neurons , 1999, The Journal of Neuroscience.

[113]  W. Schultz,et al.  A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task , 1999, Neuroscience.

[114]  Joshua W. Brown,et al.  How the Basal Ganglia Use Parallel Excitatory and Inhibitory Learning Pathways to Selectively Respond to Unexpected Rewarding Cues , 1999, The Journal of Neuroscience.

[115]  D. Plenz,et al.  A basal ganglia pacemaker formed by the subthalamic nucleus and external globus pallidus , 1999, Nature.

[116]  Jonathan D. Cohen,et al.  A Biologically Based Computational Model of Working Memory , 1999 .

[117]  A. Miyake,et al.  Models of Working Memory: Mechanisms of Active Maintenance and Executive Control , 1999 .

[118]  P. Redgrave,et al.  The basal ganglia: a vertebrate solution to the selection problem? , 1999, Neuroscience.

[119]  C. I. Connolly,et al.  Building neural representations of habits. , 1999, Science.

[120]  J. Tepper,et al.  Inhibitory control of neostriatal projection neurons by GABAergic interneurons , 1999, Nature Neuroscience.

[121]  J. Desmond,et al.  Load-Dependent Roles of Frontal Brain Regions in the Maintenance of Working Memory , 1999, NeuroImage.

[122]  Irene P. Kan,et al.  Effects of Repetition and Competition on Activity in Left Prefrontal Cortex during Word Generation , 1999, Neuron.

[123]  H. Kita,et al.  Excitatory Cortical Inputs to Pallidal Neurons Via the Subthalamic Nucleus in the Monkey , 2000 .

[124]  P. Strick,et al.  Basal Ganglia Output and Cognition: Evidence from Anatomical, Behavioral, and Clinical Studies , 2000, Brain and Cognition.

[125]  G. Arbuthnott,et al.  Computational models of the basal ganglia , 2000, Movement disorders : official journal of the Movement Disorder Society.

[126]  A. Amos.  A Computational Model of Information Processing in the Frontal Cortex and Basal Ganglia , 2000, Journal of Cognitive Neuroscience.

[127]  E. Ruppin,et al.  Reinforcement-Driven Dimensionality Reduction - A Model for Information Processing in the Basal Ganglia , 2000, Journal of basic and clinical physiology and pharmacology.

[128]  M. Dragunow,et al.  The pattern of neurodegeneration in Huntington's disease: a comparative study of cannabinoid, dopamine, adenosine and GABAA receptor alterations in the human basal ganglia in Huntington's disease , 2000, Neuroscience.

[129]  R. Malenka,et al.  Dopaminergic modulation of neuronal excitability in the striatum and nucleus accumbens. , 2000, Annual review of neuroscience.

[130]  R. Dolan,et al.  Dissociation of Mechanisms Underlying Syllogistic Reasoning , 2000, NeuroImage.

[131]  L. Squire,et al.  Contrasting Effects on Discrimination Learning after Hippocampal Lesions and Conjoint Hippocampal–Caudate Lesions in Monkeys , 2000, The Journal of Neuroscience.

[132]  Axel Cleeremans,et al.  Striatum forever, despite sequence learning variability: A random effect analysis of PET data , 2000, Human brain mapping.

[133]  D. Joel,et al.  The connections of the dopaminergic system with the striatum in rats and primates: an analysis with respect to the functional and compartmental organization of the striatum , 2000, Neuroscience.

[134]  Nikolaus R. McFarland,et al.  Striatonigrostriatal Pathways in Primates Form an Ascending Spiral from the Shell to the Dorsolateral Striatum , 2000, The Journal of Neuroscience.

[135]  John G. Taylor,et al.  A neural model of working memory processes in normal subjects, Parkinson's disease and schizophrenia for fMRI design and predictions , 2000, Neural Networks.

[136]  P. Greengard,et al.  Dopamine and cAMP-Regulated Phosphoprotein 32 kDa Controls Both Striatal Long-Term Depression and Long-Term Potentiation, Opposing Forms of Synaptic Plasticity , 2000, The Journal of Neuroscience.

[137]  J. Bolam,et al.  Synaptic organisation of the basal ganglia , 2000, Journal of anatomy.

[138]  Perry F. Renshaw,et al.  Functional deficits in basal ganglia of children with attention-deficit/hyperactivity disorder shown with functional magnetic resonance imaging relaxometry , 2000, Nature Medicine.

[139]  M. Mishkin,et al.  Visual habit formation in monkeys with neurotoxic lesions of the ventrocaudal neostriatum , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[140]  Michael J. Frank,et al.  Interactions between frontal cortex and basal ganglia in working memory: A computational model , 2001, Cognitive, affective & behavioral neuroscience.

[141]  Peter Redgrave,et al.  A computational model of action selection in the basal ganglia. I. A new functional anatomy , 2001, Biological Cybernetics.

[142]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[143]  Jennifer M. Glass,et al.  Virtually Perfect Time Sharing in Dual-Task Performance: Uncorking the Central Cognitive Bottleneck , 2001, Psychological science.

[144]  Richard B. Ivry,et al.  Comparison of the Basal Ganglia and Cerebellum in Shifting Attention. , 2001, Journal of Cognitive Neuroscience.

[145]  A. Dagher,et al.  The role of the striatum and hippocampus in planning: a PET activation study in Parkinson's disease. , 2001, Brain : a journal of neurology.

[146]  Axel Cleeremans,et al.  Can sequence learning be implicit? New evidence with the process dissociation procedure , 2001, Psychonomic bulletin & review.

[147]  M. Arbib,et al.  Modeling functions of striatal dopamine modulation in learning and planning , 2001, Neuroscience.

[148]  Nikolaus R. McFarland,et al.  Thalamic Relay Nuclei of the Basal Ganglia Form Both Reciprocal and Nonreciprocal Cortical Connections, Linking Multiple Frontal Cortical Areas , 2002, The Journal of Neuroscience.

[149]  De Vries.  Book review: R.C. O'Reilly and Y. Munakata: Computational explorations in cognitive neuroscience: understanding the mind by stimulating the brain. Cambridge, Mass: The MIT Press. , 2002 .

[150]  P. Apicella.  Tonically active neurons in the primate striatum and their role in the processing of information about motivationally relevant events , 2002, The European journal of neuroscience.

[151]  B. Knowlton,et al.  Learning and memory functions of the Basal Ganglia. , 2002, Annual review of neuroscience.

[152]  J. O'Doherty,et al.  Neural Responses during Anticipation of a Primary Taste Reward , 2002, Neuron.

[153]  W. Schultz.  Getting Formal with Dopamine and Reward , 2002, Neuron.

[154]  Eliot Hazeltine,et al.  Simultaneous dual-task performance reveals parallel response selection after practice. , 2002, Journal of experimental psychology. Human perception and performance.

[155]  A. Nambu,et al.  Functional significance of the cortico–subthalamo–pallidal ‘hyperdirect’ pathway , 2002, Neuroscience Research.

[156]  Eytan Ruppin,et al.  Actor-critic models of the basal ganglia: new anatomical and computational perspectives , 2002, Neural Networks.

[157]  Wulfram Gerstner,et al.  Mathematical formulations of Hebbian learning , 2002, Biological Cybernetics.

[158]  Charles J. Wilson,et al.  Corticostriatal combinatorics: the implications of corticostriatal axonal arborizations. , 2002, Journal of neurophysiology.

[159]  Jeffery R Wickens,et al.  Inhibitory interactions between spiny projection neurons in the rat striatum. , 2002, Journal of neurophysiology.

[160]  M. Gluck,et al.  How do people solve the "weather prediction" task?: individual variability in strategies for probabilistic category learning. , 2002, Learning & memory.

[161]  Charles J. Wilson,et al.  Activity Patterns in a Model for the Subthalamopallidal Network of the Basal Ganglia , 2002, The Journal of Neuroscience.

[162]  J. Tepper,et al.  Dual Cholinergic Control of Fast-Spiking Interneurons in the Neostriatum , 2002, The Journal of Neuroscience.

[163]  D. Plenz.  When inhibition goes incognito: feedback interaction between spiny projection neurons in striatal function , 2003, Trends in Neurosciences.

[164]  John R Anderson,et al.  Predicting the practice effects on the blood oxygenation level-dependent (BOLD) function of fMRI in a symbolic manipulation task , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[165]  John R. Anderson,et al.  Competition and representation during memory retrieval: Roles of the prefrontal cortex and the posterior parietal cortex , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[166]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[167]  Frank J. Lee,et al.  Production Compilation: A Simple Mechanism to Model Complex Skill Acquisition , 2003, Hum. Factors.

[168]  Xiaohui Xie,et al.  Equivalence of Backpropagation and Contrastive Hebbian Learning in a Layered Network , 2003, Neural Computation.

[169]  S. Haber.  The primate basal ganglia: parallel and integrative networks , 2003, Journal of Chemical Neuroanatomy.

[170]  Jonathan D. Cohen,et al.  Computational roles for dopamine in behavioural control , 2004, Nature.

[171]  R. Kesner,et al.  Memory for spatial locations, motor responses, and objects: triple dissociation among the hippocampus, caudate nucleus, and extrastriate visual cortex , 2004, Experimental Brain Research.

[172]  J. Tepper,et al.  Functional diversity and specificity of neostriatal interneurons , 2004, Current Opinion in Neurobiology.

[173]  Michael J. Frank,et al.  Hippocampus, cortex, and basal ganglia: Insights from computational models of complementary learning systems , 2004, Neurobiology of Learning and Memory.

[174]  José Luis Contreras-Vidal,et al.  A Predictive Reinforcement Model of Dopamine Neurons for Learning Approach Behavior , 1999, Journal of Computational Neuroscience.

[175]  J. Wickens,et al.  Modulation of an Afterhyperpolarization by the Substantia Nigra Induces Pauses in the Tonic Firing of Striatal Cholinergic Interneurons , 2004, The Journal of Neuroscience.

[176]  Michael J. Frank,et al.  By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism , 2004, Science.

[177]  Allen Newell,et al.  Chunking in Soar: The anatomy of a general learning mechanism , 1985, Machine Learning.

[178]  Michael A. Arbib,et al.  Towards a neurally-inspired computer architecture , 2003, Natural Computing.

[179]  Rolf Kötter,et al.  Interactions of glutamate and dopamine in a computational model of the striatum , 1995, Journal of Computational Neuroscience.

[180]  P. Strick,et al.  Macro-architecture of basal ganglia loops with the cerebral cortex: use of rabies virus to reveal multisynaptic circuits. , 2004, Progress in brain research.

[181]  Y. Smith,et al.  The thalamostriatal system: a highly specific network of the basal ganglia circuitry , 2004, Trends in Neurosciences.

[182]  J. Hawkins,et al.  On Intelligence , 2004 .

[183]  T. Robbins,et al.  Striatal contributions to working memory: a functional magnetic resonance imaging study in humans , 2004, The European journal of neuroscience.

[184]  J. O'Doherty,et al.  Reward representations and reward-related learning in the human brain: insights from neuroimaging , 2004, Current Opinion in Neurobiology.

[185]  A. Owen.  Cognitive Dysfunction in Parkinson’s Disease: The Role of Frontostriatal Circuitry , 2004, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[186]  A. Sadikot,et al.  Neurogenesis and stereological morphometry of calretinin‐immunoreactive GABAergic interneurons of the neostriatum , 2004, The Journal of comparative neurology.

[187]  J. Wickens,et al.  The corticostriatal input to giant aspiny interneurons in the rat: a candidate pathway for synchronising the response to reward-related cues , 2004, Brain Research.

[188]  E. Vaadia,et al.  Coincident but Distinct Messages of Midbrain Dopamine and Striatal Tonically Active Neurons , 2004, Neuron.

[189]  Charles J. Wilson,et al.  Comparison of IPSCs Evoked by Spiny and Fast-Spiking Neurons in the Neostriatum , 2004, The Journal of Neuroscience.

[190]  B. Schmand,et al.  Cognitive profile of patients with newly diagnosed Parkinson disease , 2005, Neurology.

[191]  James C. Houk,et al.  Agents of the mind , 2005, Biological Cybernetics.

[192]  E. Miller,et al.  Different time courses of learning-related activity in the prefrontal cortex and striatum , 2005, Nature.

[193]  John R. Anderson,et al.  Learning to achieve perfect timesharing: architectural implications of Hazeltine, Teague, and Ivry (2002). , 2005, Journal of experimental psychology. Human perception and performance.

[194]  F. Gregory Ashby,et al.  FROST: A Distributed Neurocomputational Model of Working Memory Maintenance , 2005, Journal of Cognitive Neuroscience.

[195]  W. Schultz,et al.  Adaptive Coding of Reward Value by Dopamine Neurons , 2005, Science.

[196]  Niels Taatgen,et al.  Modeling Parallelization and Flexibility Improvements in Skill Acquisition: From Dual Tasks to Complex Dynamic Skills , 2005, Cogn. Sci..

[197]  Carol A. Seger,et al.  The Roles of the Caudate Nucleus in Human Classification Learning , 2005, The Journal of Neuroscience.

[198]  A. Faure,et al.  Lesion to the Nigrostriatal Dopamine System Disrupts Stimulus-Response Habit Formation , 2005, The Journal of Neuroscience.

[199]  Dottie M. Clower,et al.  Basal ganglia and cerebellar inputs to 'AIP'. , 2005, Cerebral cortex.

[200]  Stéphane Charpier,et al.  Feedforward Inhibition of Projection Neurons by Fast-Spiking GABA Interneurons in the Rat Striatum In Vivo , 2005, The Journal of Neuroscience.

[201]  John R. Anderson,et al.  Tracing Problem Solving in Real Time: fMRI Analysis of the Subject-paced Tower of Hanoi , 2005, Journal of Cognitive Neuroscience.

[202]  W. Schneider,et al.  Neuroimaging studies of practice-related change: fMRI and meta-analytic evidence of a domain-general control network for learning. , 2005, Brain research. Cognitive brain research.

[203]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[204]  Richard S. Sutton,et al.  Learning to predict by the methods of temporal differences , 1988, Machine Learning.

[205]  A. Graybiel.  The basal ganglia: learning new tricks and loving it , 2005, Current Opinion in Neurobiology.

[206]  John R. Anderson,et al.  Human Symbol Manipulation Within an Integrated Cognitive Architecture , 2005, Cogn. Sci..

[207]  B. Sakmann,et al.  Cortex Is Driven by Weak but Synchronously Active Thalamocortical Synapses , 2006, Science.

[208]  P. Redgrave,et al.  The short-latency dopamine signal: a role in discovering novel actions? , 2006, Nature Reviews Neuroscience.

[209]  Richard Granger,et al.  Engines of the Brain: The Computational Instruction Set of Human Cognition , 2006, AI Mag..

[210]  Jonathan D. Cohen,et al.  Imaging valuation models in human choice. , 2006, Annual review of neuroscience.

[211]  Michael J. Frank,et al.  Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia , 2006, Neural Computation.

[212]  S. Quartz,et al.  Neural Differentiation of Expected Reward and Risk in Human Subcortical Structures , 2006, Neuron.

[213]  Emmanuel Dupoux,et al.  The Role of the Striatum in Processing Language Rules: Evidence from Word Perception in Huntington's Disease , 2006, Journal of Cognitive Neuroscience.

[214]  Paul J. Feltovich,et al.  The Cambridge handbook of expertise and expert performance , 2006 .

[215]  K. Gurney,et al.  A Physiologically Plausible Model of Action Selection and Oscillatory Activity in the Basal Ganglia , 2006, The Journal of Neuroscience.

[216]  M. Frank,et al.  Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. , 2006, Psychological review.

[217]  M. Just,et al.  From the Selectedworks of Marcel Adam Just the Organization of Thinking: What Functional Brain Imaging Reveals about the Neuroarchitecture of Complex Cognition , 2022 .

[218]  Peter Redgrave,et al.  Basal Ganglia , 2020, Encyclopedia of Autism Spectrum Disorders.

[219]  Leonardo Fazio,et al.  Polymorphisms in human dopamine D2 receptor gene affect gene expression, splicing, and neuronal activity during working memory , 2007, Proceedings of the National Academy of Sciences.

[220]  Marcel Adam Just,et al.  Individual Differences in Sentence Comprehension: A Functional Magnetic Resonance Imaging Investigation of Syntactic and Lexical Processing Demands , 2007, Journal of Cognitive Neuroscience.

[221]  John M. Ennis,et al.  A neurobiological theory of automaticity in perceptual categorization. , 2007, Psychological review.

[222]  Enrico Bracci,et al.  Cholinergic Interneurons Control the Excitatory Input to the Striatum , 2007, The Journal of Neuroscience.

[223]  Paul Apicella,et al.  Leading tonically active neurons of the striatum from reward detection to context recognition , 2007, Trends in Neurosciences.

[224]  Brigitte Landeau,et al.  The dynamic network subserving the three phases of cognitive procedural learning , 2007, Human brain mapping.

[225]  Sabrina M. Tom,et al.  The Neural Basis of Loss Aversion in Decision-Making Under Risk , 2007, Science.

[226]  John R. Anderson.  How Can the Human Mind Occur in the Physical Universe , 2007 .

[227]  Michael J. Frank,et al.  Hold Your Horses: Impulsivity, Deep Brain Stimulation, and Medication in Parkinsonism , 2007, Science.

[228]  Terrence C. Stewart,et al.  Building Production Systems with Realistic Spiking Neurons , 2008 .

[229]  T. Klingberg,et al.  Prefrontal cortex and basal ganglia control access to working memory , 2008, Nature Neuroscience.

[230]  Morteza Moazami-Goudarzi,et al.  Enhanced frontal low and high frequency power and synchronization in the resting EEG of parkinsonian patients , 2008, NeuroImage.

[231]  John R. Anderson,et al.  A Connectionist Implementation of the ACT-R Production System , 2008 .

[232]  John R. Anderson,et al.  A central circuit of the mind , 2008, Trends in Cognitive Sciences.

[233]  Cornelis J. Stam,et al.  Increased cortico-cortical functional connectivity in early-stage Parkinson's disease: An MEG study , 2008, NeuroImage.

[234]  John R. Anderson,et al.  Endogenous Control and Task Representation: An fMRI Study in Algebraic Problem-solving , 2008, Journal of Cognitive Neuroscience.

[235]  J. Jankovic.  Parkinson’s disease: clinical features and diagnosis , 2008, Journal of Neurology, Neurosurgery, and Psychiatry.

[236]  Pat Gunn,et al.  A rational account of memory predicts left prefrontal activation during controlled retrieval. , 2008, Cerebral cortex.

[237]  R. O’Reilly,et al.  Computational Explorations in Cognitive Neuroscience , 2009 .

[238]  Paul D. Kieffaber,et al.  Memory systems do not divide on consciousness: Reinterpreting memory in terms of activation and binding. , 2009, Psychological bulletin.

[239]  A. Cooper,et al.  Predictive Reward Signal of Dopamine Neurons , 2011 .

[240]  M. Just,et al.  Exploring the neural dynamics underpinning individual differences in sentence comprehension. , 2011, Cerebral cortex.