Conditional Routing of Information to the Neocortex: A Network Model of Basal Ganglia Function

The basal ganglia are widely regarded as playing a central role in cognition, being involved is such general functions as action selection and reinforcement learning. Here, we present a model exploring the hypothesis that the basal ganglia implement a conditional information routing circuit, where cortical signals are gated and subsequently relayed onto different pathways projecting to the prefrontal cortex. It also accounts for the existence of two distinct branches (pallidal and nigral) of the direct pathway, by assuming that they are used to carry separately content and routing information. A possible mechanism is described by which the indirect pathway can control the release of dopamine along the nigrostriatal pathway, generating a signal that the striatum can use to produce novel stimulus-response associations by internalizing cortical representations. In a series of simulations, it is shown how the model can perform simple stimulus-response tasks, develop automatic behaviors, and provide an account of impairments in Parkinon's and Huntington's disease. Finally, it is also discussed how the proposed model’s mechanisms relates to production systems, a widely adopted formalism for human cognition, and how the reward signals carried by the mesolimbic pathway can be integrated to exert fine control over action selection.

[1]  L. Brown,et al.  Sensory and cognitive functions of the basal ganglia , 1997, Current Opinion in Neurobiology.

[2]  B. Knowlton,et al.  Learning and memory functions of the Basal Ganglia. , 2002, Annual review of neuroscience.

[3]  John R. Anderson,et al.  Learning to achieve perfect timesharing: architectural implications of Hazeltine, Teague, and Ivry (2002). , 2005, Journal of experimental psychology. Human perception and performance.

[4]  J. Aceves,et al.  Inhibitory control of the GABAergic transmission in the rat neostriatum by D2 dopamine receptors , 1999, Neuroscience.

[5]  E. W. Kairiss,et al.  Hebbian synapses: biophysical mechanisms and algorithms. , 1990, Annual review of neuroscience.

[6]  P. Calabresi,et al.  Unilateral dopamine denervation blocks corticostriatal LTP. , 1999, Journal of neurophysiology.

[7]  S. Pinker,et al.  A Neural Dissociation within Language: Evidence that the Mental Dictionary Is Part of Declarative Memory, and that Grammatical Rules Are Processed by the Procedural System , 1997, Journal of Cognitive Neuroscience.

[8]  John R. Anderson,et al.  Tracing Problem Solving in Real Time: fMRI Analysis of the Subject-paced Tower of Hanoi , 2005, Journal of Cognitive Neuroscience.

[9]  Michael J. Frank,et al.  By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism , 2004, Science.

[10]  T. Shallice Specific impairments of planning. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[11]  John R. Anderson,et al.  Human Symbol Manipulation Within an Integrated Cognitive Architecture , 2005, Cogn. Sci..

[12]  J. Desmond,et al.  Load-Dependent Roles of Frontal Brain Regions in the Maintenance of Working Memory , 1999, NeuroImage.

[13]  D. D. de Quervain,et al.  The Neural Basis of Altruistic Punishment , 2004, Science.

[14]  T. Robbins,et al.  Spatial and non-spatial working memory at different stages of Parkinson's disease , 1997, Neuropsychologia.

[15]  M. Gluck,et al.  Probabilistic classification learning in amnesia. , 1994, Learning & memory.

[16]  Richard B. Ivry,et al.  Comparison of the Basal Ganglia and Cerebellum in Shifting Attention. , 2001, Journal of Cognitive Neuroscience.

[17]  S. Rauch,et al.  Striatal recruitment during an implicit sequence learning task as measured by functional magnetic resonance imaging , 1997, Human brain mapping.

[18]  J. Bolam,et al.  Synaptic organisation of the basal ganglia , 2000, Journal of anatomy.

[19]  L. Squire,et al.  Preserved learning and retention of pattern-analyzing skill in amnesia: dissociation of knowing how and knowing that. , 1980, Science.

[20]  Michael A. Arbib,et al.  Towards a neurally-inspired computer architecture , 2003, Natural Computing.

[21]  Perry F. Renshaw,et al.  Functional deficits in basal ganglia of children with attention-deficit/hyperactivity disorder shown with functional magnetic resonance imaging relaxometry , 2000, Nature Medicine.

[22]  Geoffrey E. Hinton Tensor Product Variable Binding and the Representation of Symbolic Structures in Connectionist Systems , 1991 .

[23]  T. M. Mayhew,et al.  Anatomy of the Cortex: Statistics and Geometry. , 1991 .

[24]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[25]  James C. Houk,et al.  Agents of the mind , 2005, Biological Cybernetics.

[26]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[27]  Jennifer A. Mangels,et al.  A Neostriatal Habit Learning System in Humans , 1996, Science.

[28]  G. Arbuthnott,et al.  Computational models of the basal ganglia , 2000, Movement disorders : official journal of the Movement Disorder Society.

[29]  J. Houk,et al.  Model of cortical-basal ganglionic processing: encoding the serial order of sensory events. , 1998, Journal of neurophysiology.

[30]  A. Flaherty,et al.  Input-output organization of the sensorimotor striatum in the squirrel monkey , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[31]  J. Wickens Basal ganglia: structure and computations. , 1997 .

[32]  Edward E. Smith,et al.  Temporal dynamics of brain activation during a working memory task , 1997, Nature.

[33]  Eliot Hazeltine,et al.  Simultaneous dual-task performance reveals parallel response selection after practice. , 2002, Journal of experimental psychology. Human perception and performance.

[34]  Leonardo Fazio,et al.  Polymorphisms in human dopamine D2 receptor gene affect gene expression, splicing, and neuronal activity during working memory , 2007, Proceedings of the National Academy of Sciences.

[35]  Richard Granger,et al.  Engines of the Brain: The Computational Instruction Set of Human Cognition , 2006, AI Mag..

[36]  P. Greengard,et al.  Dopamine and cAMP-Regulated Phosphoprotein 32 kDa Controls Both Striatal Long-Term Depression and Long-Term Potentiation, Opposing Forms of Synaptic Plasticity , 2000, The Journal of Neuroscience.

[37]  W. Schultz,et al.  Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[38]  S. Greenfield,et al.  Synaptic connections between pars compacta and pars reticulata neurones: electrophysiological evidence for functional modules within the substantia nigra , 1994, Brain Research.

[39]  Jonathan D. Cohen,et al.  Imaging valuation models in human choice. , 2006, Annual review of neuroscience.

[40]  John D. E. Gabrieli,et al.  Reduced working memory span in Parkinson's disease: Evidence for the role of frontostriatal system in working and strategic memory. , 1996 .

[41]  Prof. Dr. Valentino Braitenberg,et al.  Anatomy of the Cortex , 1991, Studies of Brain Function.

[42]  M. Hallett,et al.  A functional MRI study of automatic movements in patients with Parkinson's disease. , 2005, Brain : a journal of neurology.

[43]  M. Just,et al.  From the SelectedWorks of Marcel Adam Just 1992 A capacity theory of comprehension : Individual differences in working memory , 2017 .

[44]  Antonio Pisani,et al.  Dopamine D2 Receptor-Mediated Inhibition of Dopaminergic Neurons in Mice Lacking D2L Receptors , 2002, Neuropsychopharmacology.

[45]  R. Dolan,et al.  Dissociation of Mechanisms Underlying Syllogistic Reasoning , 2000, NeuroImage.

[46]  C. I. Connolly,et al.  Building neural representations of habits. , 1999, Science.

[47]  H J Sagar,et al.  Different effects of dopaminergic and anticholinergic therapies on cognitive and motor function in Parkinson's disease. A follow-up study of untreated patients. , 1992, Brain : a journal of neurology.

[48]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[49]  Alan C. Evans,et al.  Planning and Spatial Working Memory: a Positron Emission Tomography Study in Humans , 1996, The European journal of neuroscience.

[50]  Michael J. Frank,et al.  Hippocampus, cortex, and basal ganglia: Insights from computational models of complementary learning systems , 2004, Neurobiology of Learning and Memory.

[51]  M. Just,et al.  From the Selectedworks of Marcel Adam Just the Organization of Thinking: What Functional Brain Imaging Reveals about the Neuroarchitecture of Complex Cognition , 2022 .

[52]  Morteza Moazami-Goudarzi,et al.  Enhanced frontal low and high frequency power and synchronization in the resting EEG of parkinsonian patients , 2008, NeuroImage.

[53]  Geoffrey E. Hinton,et al.  A Distributed Connectionist Production System , 1988, Cogn. Sci..

[54]  M. Just,et al.  Computational modeling of high‐level cognition and brain function , 1999, Human brain mapping.

[55]  Michael J. Frank,et al.  Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia , 2006, Neural Computation.

[56]  Lokendra Shastri,et al.  Rules and Variables in Neural Nets , 1991, Neural Computation.

[57]  Carol A. Seger,et al.  The Roles of the Caudate Nucleus in Human Classification Learning , 2005, The Journal of Neuroscience.

[58]  J. Hollerman,et al.  Reward processing in primate orbitofrontal cortex and basal ganglia. , 2000, Cerebral cortex.

[59]  Walter Schneider,et al.  Controlled & automatic processing: behavior, theory, and biological mechanisms , 2003, Cogn. Sci..

[60]  T. Sejnowski,et al.  A Computational Model of How the Basal Ganglia Produce Sequences , 1998, Journal of Cognitive Neuroscience.

[61]  W. Schultz,et al.  Adaptive Coding of Reward Value by Dopamine Neurons , 2005, Science.

[62]  André Parent,et al.  Comparative neurobiology of the basal ganglia , 1986 .

[63]  J. D. McGaugh,et al.  Inactivation of Hippocampus or Caudate Nucleus with Lidocaine Differentially Affects Expression of Place and Response Learning , 1996, Neurobiology of Learning and Memory.

[64]  John R. Anderson,et al.  A central circuit of the mind , 2008, Trends in Cognitive Sciences.

[65]  L. Henderson,et al.  Serial reaction time learning and Parkinson's disease: Evidence for a procedural learning deficit , 1995, Neuropsychologia.

[66]  Edward E. Smith,et al.  A Parametric Study of Prefrontal Cortex Involvement in Human Working Memory , 1996, NeuroImage.

[67]  A. Canavan,et al.  Associative learning in degenerative neostriatal disorders: Contrasts in explicit and implicit remembering between Parkinson's and huntington's diseases , 1995, Movement disorders : official journal of the Movement Disorder Society.

[68]  Richard Reviewer-Granger Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[69]  John R. Anderson How Can the Human Mind Occur in the Physical Universe , 2007 .

[70]  J. Gabrieli Cognitive neuroscience of human memory. , 1998, Annual review of psychology.

[71]  W. Weiner,et al.  Cognitive impairments associated with early Parkinson's disease , 1989, Neurology.

[72]  J. Hawkins,et al.  On Intelligence , 2004 .

[73]  N. Swindale,et al.  Diffusion tensor fiber tracking shows distinct corticostriatal circuits in humans , 2004, Annals of neurology.

[74]  Dottie M. Clower,et al.  Basal ganglia and cerebellar inputs to 'AIP'. , 2005, Cerebral cortex.

[75]  Jennifer M. Glass,et al.  Virtually Perfect Time Sharing in Dual-Task Performance: Uncorking the Central Cognitive Bottleneck , 2001, Psychological science.

[76]  A. Dagher,et al.  Basal ganglia functional connectivity based on a meta-analysis of 126 positron emission tomography and functional magnetic resonance imaging publications. , 2006, Cerebral cortex.

[77]  Axel Cleeremans,et al.  Striatum forever, despite sequence learning variability: A random effect analysis of PET data , 2000, Human brain mapping.

[78]  J. O'Doherty,et al.  Reward representations and reward-related learning in the human brain: insights from neuroimaging , 2004, Current Opinion in Neurobiology.

[79]  Allen Newell,et al.  Chunking in Soar: The anatomy of a general learning mechanism , 1985, Machine Learning.

[80]  A. Amos A Computational Model of Information Processing in the Frontal Cortex and Basal Ganglia , 2000, Journal of Cognitive Neuroscience.

[81]  Emmanuel Dupoux,et al.  The Role of the Striatum in Processing Language Rules: Evidence from Word Perception in Huntington's Disease , 2006, Journal of Cognitive Neuroscience.

[82]  W. Schultz Getting Formal with Dopamine and Reward , 2002, Neuron.

[83]  Alessandro Treves,et al.  Frontal latching networks: a possible neural basis for infinite recursion , 2005, Cognitive neuropsychology.

[84]  Peter Ford Dominey,et al.  A Model of Corticostriatal Plasticity for Learning Oculomotor Associations and Sequences , 1995, Journal of Cognitive Neuroscience.

[85]  B. Sakmann,et al.  Cortex Is Driven by Weak but Synchronously Active Thalamocortical Synapses , 2006, Science.

[86]  Frank J. Lee,et al.  Production Compilation: A Simple Mechanism to Model Complex Skill Acquisition , 2003, Hum. Factors.

[87]  P. Redgrave,et al.  The basal ganglia: a vertebrate solution to the selection problem? , 1999, Neuroscience.

[88]  F. Velde,et al.  Neural blackboard architectures of combinatorial structures in cognition , 2006 .

[89]  David E. Kieras,et al.  A computational theory of executive cognitive processes and multiple-task performance: Part 2. Accounts of psychological refractory-period phenomena. , 1997 .

[90]  A. Dagher,et al.  The role of the striatum and hippocampus in planning: a PET activation study in Parkinson's disease. , 2001, Brain : a journal of neurology.

[91]  B. Schmand,et al.  Cognitive profile of patients with newly diagnosed Parkinson disease , 2005, Neurology.

[92]  D E Kieras,et al.  A computational theory of executive cognitive processes and multiple-task performance: Part 1. Basic mechanisms. , 1997, Psychological review.

[93]  T. Robbins,et al.  Striatal contributions to working memory: a functional magnetic resonance imaging study in humans , 2004, The European journal of neuroscience.

[94]  Peter Redgrave,et al.  Basal Ganglia , 2020, Encyclopedia of Autism Spectrum Disorders.

[95]  F. van der Velde,et al.  Neural blackboard architectures of combinatorial structures in cognition , 2006, Behavioral and Brain Sciences.

[96]  C. Gerfen The neostriatal mosaic: multiple levels of compartmental organization in the basal ganglia. , 1992, Annual review of neuroscience.

[97]  Cornelis J. Stam,et al.  Increased cortico-cortical functional connectivity in early-stage Parkinson's disease: An MEG study , 2008, NeuroImage.

[98]  J. O'Doherty,et al.  Neural Responses during Anticipation of a Primary Taste Reward , 2002, Neuron.

[99]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[100]  Peter Redgrave,et al.  A computational model of action selection in the basal ganglia. I. A new functional anatomy , 2001, Biological Cybernetics.

[101]  John R. Anderson,et al.  Endogenous Control and Task Representation: An fMRI Study in Algebraic Problem-solving , 2008, Journal of Cognitive Neuroscience.

[102]  C. Carter,et al.  Regional brain activation during concurrent implicit and explicit sequence learning. , 2004, Cerebral cortex.

[103]  T. Robbins,et al.  Cognitive functions and corticostriatal circuits: insights from Huntington's disease , 1998, Trends in Cognitive Sciences.

[104]  John R. Anderson,et al.  A Connectionist Implementation of the ACT-R Production System , 2008 .

[105]  A. Parent,et al.  Functional anatomy of the basal ganglia. I. The cortico-basal ganglia-thalamo-cortical loop , 1995, Brain Research Reviews.

[106]  P. Strick,et al.  The temporal lobe is a target of output from the basal ganglia. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[107]  John D. E. Gabrieli,et al.  Reduced working memory span in Parkinson's disease: Evidence for the role of frontostriatal system in working and strategic memory. , 1996 .

[108]  Enrico Bracci,et al.  Activation of dopamine D1‐like receptors excites LTS interneurons of the striatum , 2002, The European journal of neuroscience.