Dynamic Behaviour of a Spiking Model of Action Selection in the Basal Ganglia Neural Structure

A fundamental process for cognition is action selection: choosing a particular action out of the many possible actions available. This process is widely believed to involve the basal ganglia, and we present here a model of action selection that uses spiking neurons and is in accordance with the connectivity and neuron types found in this area. Since the parameters of the model are set by neurological data, we can produce timing predictions for different action selection situations without requiring parameter tweaking. Our results show that, while an action can be selected in 14 milliseconds (or longer for actions with similar utilities), it requires 34­44 milliseconds to go from one simple action to the next. For complex actions (whose effect involves routing information between cortical areas), 59­73 milliseconds are needed. This suggests a change to the standard cognitive modelling approach of requiring 50 milliseconds for all types of actions. The basal ganglia are generally believed by both neuroscientists (e.g. Redgrave et al., 1999) and cognitive scientists (e.g. Anderson et al., 2004) to be responsible for action selection. Action selection consists of choosing one action to perform out of the many actions in an organism's repertoire. Selection is done on the basis of some sort of context­dependent utility signal for each possible action. Actions that are inappropriate for the current context may have low utility, and a task of the basal ganglia is to select the action that currently has the highest utility value. Since such a mechanism forms the core of many cognitive models, including all of those based on production systems (where a single production much be chosen to fire), it is useful to develop a computational model of this process. Here, we develop a detailed spiking neuron model that takes into account a broad range of neurological details about the basal ganglia. Other spiking models of action selection exist, but tend to be organized unlike the basal ganglia (Belavkin & Huyck, 2009) and unconstrained by neural properties (Shouno et al., 2009; see Humphries et al., 2006 for an exception and alternate approach). By directly connecting our model to neuroscientific results, we constrain our parameter values. Every parameter in the model reflects neurological data from the relevant brain areas, resulting in a model that has no free parameters (that affect the results shown here). Furthermore, having a biologically realistic model allows us to make predictions about a wide range of …

[1]  J. Penney,et al.  The functional anatomy of basal ganglia disorders , 1989, Trends in Neurosciences.

[2]  J. Mink THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS , 1996, Progress in Neurobiology.

[3]  P. Redgrave,et al.  The basal ganglia: a vertebrate solution to the selection problem? , 1999, Neuroscience.

[4]  H. Markram,et al.  Organizing principles for a diversity of GABAergic interneurons and synapses in the neocortex. , 2000, Science.

[5]  Peter Redgrave,et al.  A computational model of action selection in the basal ganglia. I. A new functional anatomy , 2001, Biological Cybernetics.

[6]  A. Nambu,et al.  Functional significance of the cortico–subthalamo–pallidal ‘hyperdirect’ pathway , 2002, Neuroscience Research.

[7]  Enrico Bracci,et al.  Dopamine excites fast-spiking interneurons in the striatum. , 2002, Journal of neurophysiology.

[8]  J. Tepper,et al.  Dual Cholinergic Control of Fast-Spiking Interneurons in the Neostriatum , 2002, The Journal of Neuroscience.

[9]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[10]  K. Clark,et al.  The role of the subthalamic nucleus in the response of globus pallidus neurons to stimulation of the prelimbic and agranular frontal cortices in rats , 2004, Experimental Brain Research.

[11]  K. Gurney,et al.  A Physiologically Plausible Model of Action Selection and Oscillatory Activity in the Basal Ganglia , 2006, The Journal of Neuroscience.

[12]  Thomas E. Hazy,et al.  Towards an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[13]  John R. Anderson,et al.  Production System Models of Complex Cognition , 2008 .

[14]  Hiroshi Tsujino,et al.  A Spiking Neuron Model of the Basal Ganglia Circuitry that Can Generate Behavioral Variability , 2009 .

[15]  E. Bracci,et al.  Serotonin excites fast-spiking interneurons in the striatum , 2009, The European journal of neuroscience.

[16]  Christian R. Huyck,et al.  A model of probability matching in a two-choice task based on stochastic control of learning in neural cell-assemblies. , 2009 .

[17]  Terrence C. Stewart,et al.  of the Annual Meeting of the Cognitive Science Society Title Symbolic Reasoning in Spiking Neurons : A Model of the Cortex / Basal Ganglia / Thalamus Loop , 2010 .