Computational models of the basal ganglia

Computer simulation studies and mathematical analysis of models of the basal ganglia are being used increasingly to explore theories of basal ganglia function. We review the implications of these new models for a general understanding of basal ganglia function in normal as well as in diseased brains. The focus is on their functional similarities rather than on the details of mathematical methodologies and simulation techniques. Most of the models suggest a vital role for the basal ganglia in learning. Although this interest in learning is partly driven by experimental results associating the acute firing of dopamine cells with reward prediction in monkeys, some of the models have preceded the electrophysiological results. An‐ other common theme of the models is selection. In this case, the striatum is seen as detecting and selecting cortical contexts for access to basal ganglia output. Although the behavioral consequences of this selection are hard to define, the models provide frameworks within which to explore these ideas empirically. This provides a means of refining our understanding of basal ganglia function and to consider dysfunction within the new logical frameworks.

[1]  E. Oja Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[2]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[3]  S. Grossberg,et al.  Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation. , 1988, Psychological review.

[4]  J. Penney,et al.  The functional anatomy of basal ganglia disorders , 1989, Trends in Neurosciences.

[5]  J. Deniau,et al.  Disinhibition as a basic process in the expression of striatal functions , 1990, Trends in Neurosciences.

[6]  H. Kita,et al.  Parvalbumin-immunoreactive neurons in the rat neostriatum: a light and electron microscopic study , 1990, Brain Research.

[7]  Michael I. Jordan Attractor dynamics and parallelism in a connectionist sequential machine , 1990 .

[8]  J. Wickens,et al.  Two dynamic modes of striatal function under dopaminergic‐cholinergic control: Simulation and analysis of a model , 1991, Synapse.

[9]  P. Brotchie,et al.  A neural network model of neural activity in the monkey globus pallidus , 1991, Neuroscience Letters.

[10]  W. Schultz,et al.  Responses of monkey dopamine neurons during learning of behavioral reactions. , 1992, Journal of neurophysiology.

[11]  W. T. Thach,et al.  Basal ganglia intrinsic circuits and their role in behavior , 1993, Current Opinion in Neurobiology.

[12]  J. B. Burns,et al.  A new striatal model and its relationship to basal ganglia diseases , 1993, Neuroscience Research.

[13]  J. Wickens,et al.  The corticostriatal system on computer simulation: an intermediate mechanism for sequencing of actions. , 1993, Progress in brain research.

[14]  Joel L. Davis,et al.  A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement , 1994 .

[15]  W. Schultz,et al.  Importance of unpredictability for reward responses in primate dopamine neurons. , 1994, Journal of neurophysiology.

[16]  Charles J. Wilson,et al.  Surround inhibition among projection neurons is weak or nonexistent in the rat neostriatum. , 1994, Journal of neurophysiology.

[17]  Joel L. Davis,et al.  Modeling the Roles of Basal Ganglia in Timing and Sequencing Saccadic Eye Movements , 1994 .

[18]  Peter Ford Dominey,et al.  A Model of Corticostriatal Plasticity for Learning Oculomotor Associations and Sequences , 1995, Journal of Cognitive Neuroscience.

[19]  A. Barto,et al.  Adaptive Critics and the Basal Ganglia , 1994 .

[20]  Joel L. Davis,et al.  Adaptive Critics and the Basal Ganglia , 1995 .

[21]  C. Pennartz The ascending neuromodulatory systems in learning by reinforcement: comparing computational conjectures with experimental findings , 1995, Brain Research Reviews.

[22]  A. Dickinson,et al.  Reward-related signals carried by dopamine neurons. , 1995 .

[23]  C. Wilson,et al.  Corticostriatal innervation of the patch and matrix in the rat neostriatum , 1996, The Journal of comparative neurology.

[24]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[25]  A. D. Smith,et al.  Synaptic Connections Between Spiny Neurons of the Direct and Indirect Pathways in the Neostriatum of the Rat: Evidence from Dopamine Receptor and Neuropeptide Immunostaining , 1996, The European journal of neuroscience.

[26]  J. Mink THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS , 1996, Progress in Neurobiology.

[27]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[28]  David J. Willshaw,et al.  A Model of the Interactions between the Globus Pallidus and Subthalamic Nucleus , 1997, ICONIP.

[29]  D. Joel,et al.  The connections of the primate subthalamic nucleus: indirect pathways and the open-interconnected scheme of basal ganglia-thalamocortical circuitry , 1997, Brain Research Reviews.

[30]  W. Schultz,et al.  Learning of sequential movements by neural network model with dopamine-like reinforcement signal , 1998, Experimental Brain Research.

[31]  J. Hollerman,et al.  Dopamine neurons report an error in the temporal prediction of reward during learning , 1998, Nature Neuroscience.

[32]  Charles J. Wilson,et al.  Connectivity and Convergence of Single Corticostriatal Axons , 1998, The Journal of Neuroscience.

[33]  T. Sejnowski,et al.  A Computational Model of How the Basal Ganglia Produce Sequences , 1998, Journal of Cognitive Neuroscience.

[34]  A. Parent,et al.  The current model of basal ganglia organization under scrutiny , 1998, Movement disorders : official journal of the Movement Disorder Society.

[35]  F. Piehl,et al.  VAMP‐1 and VAMP‐2 gene expression in rat spinal motoneurones: differential regulation after neuronal injury , 1998, The European journal of neuroscience.

[36]  D. Willshaw,et al.  A massively connected subthalamic nucleus leads to the generation of widespread pulses , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[37]  J. Houk,et al.  Model of cortical-basal ganglionic processing: encoding the serial order of sensory events. , 1998, Journal of neurophysiology.

[38]  Charles J. Wilson,et al.  Regulation of action-potential firing in spiny neurons of the rat neostriatum in vivo. , 1998, Journal of neurophysiology.

[39]  P. Redgrave,et al.  Is the short-latency dopamine response too short to signal reward error? , 1999, Trends in Neurosciences.

[40]  Peter Redgrave,et al.  Layered Control Architectures in Robots and Vertebrates , 1999, Adapt. Behav..

[41]  G. Arbuthnott,et al.  Double anterograde tracing of outputs from adjacent “barrel columns” of rat somatosensory cortex. Neostriatal projection patterns and terminal ultrastructure , 1999, Neuroscience.

[42]  A. Grace,et al.  Alterations in electrophysiological activity and dye coupling of striatal spiny and aspiny neurons in dopamine‐denervated rat striatum recorded in vivo , 1999, Synapse.

[43]  P. Redgrave,et al.  The basal ganglia: a vertebrate solution to the selection problem? , 1999, Neuroscience.

[44]  Tomoki Fukai,et al.  Modeling the interplay of short-term memory and the basal ganglia in sequence processing , 1999, Neurocomputing.

[45]  A. Dickinson,et al.  Neuronal coding of prediction errors. , 2000, Annual review of neuroscience.

[46]  Peter Redgrave,et al.  A computational model of action selection in the basal ganglia. II. Analysis and simulation of behaviour , 2001, Biological Cybernetics.

[47]  Peter Redgrave,et al.  A computational model of action selection in the basal ganglia. I. A new functional anatomy , 2001, Biological Cybernetics.

[48]  Mark D. Humphries,et al.  A pulsed neural network model of bursting in the basal ganglia , 2001, Neural Networks.

[49]  R. Albin End of lines and boxes , 2001, Movement disorders : official journal of the Movement Disorder Society.

[50]  Roland E. Suri,et al.  TD models of reward predictive responses in dopamine neurons , 2002, Neural Networks.