A Computational Model of Cortico-Striato-Thalamic Circuits in Goal-Directed Behaviour

A connectionist model of cortico-striato-thalamic loops unifying learning and action selection is proposed. The aim in proposing the connectionist model is to develop a simple model revealing the mechanisms behind the cognitive process of goal directed behaviour rather than merely obtaining a model of neural structures. In the proposed connectionist model, the action selection is realized by a non-linear dynamical system, while learning that modifies the action selection is realized similar to actor-critic model of reinforcement learning. The task of sequence learning is solved with the proposed model to make clear how the model can be implemented.

[1]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[2]  John G. Taylor,et al.  Hard-wired models of working memory and temporal sequence storage and generation , 2000, Neural Networks.

[3]  Nikolaus R. McFarland,et al.  Striatonigrostriatal Pathways in Primates Form an Ascending Spiral from the Shell to the Dorsolateral Striatum , 2000, The Journal of Neuroscience.

[4]  M. Arbib,et al.  Modeling functions of striatal dopamine modulation in learning and planning , 2001, Neuroscience.

[5]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[6]  Peter Redgrave,et al.  A computational model of action selection in the basal ganglia. I. A new functional anatomy , 2001, Biological Cybernetics.

[7]  P. Dayan,et al.  Reward, Motivation, and Reinforcement Learning , 2002, Neuron.

[8]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[9]  Peter Redgrave,et al.  A computational model of action selection in the basal ganglia. II. Analysis and simulation of behaviour , 2001, Biological Cybernetics.

[10]  Ozkan Karabacak,et al.  A dynamical model of a cognitive function: Action selection , 2005 .

[11]  W. Schultz,et al.  Learning of sequential movements by neural network model with dopamine-like reinforcement signal , 1998, Experimental Brain Research.

[12]  Eytan Ruppin,et al.  Actor-critic models of the basal ganglia: new anatomical and computational perspectives , 2002, Neural Networks.

[13]  T. Sejnowski,et al.  A Model of Basal Ganglia Function Unifying Reinforcement Learning and Action Selection , 1994 .

[14]  Mitsuo Kawato,et al.  Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning , 2006, Neural Networks.

[15]  L. Heimer.  A new anatomical framework for neuropsychiatric disorders and drug abuse. , 2003, The American journal of psychiatry.

[16]  K. R. Ridderinkhof,et al.  Neurocognitive mechanisms of cognitive control: The role of prefrontal cortex in action selection, response inhibition, performance monitoring, and reward-based learning , 2004, Brain and Cognition.

[17]  G. E. Alexander,et al.  Basal ganglia-thalamocortical circuits: parallel substrates for motor, oculomotor, "prefrontal" and "limbic" functions. , 1990, Progress in brain research.

[18]  Jonathan D. Cohen,et al.  Computational roles for dopamine in behavioural control , 2004, Nature.

[19]  A. Graybiel.  Neurotransmitters and neuromodulators in the basal ganglia , 1990, Trends in Neurosciences.

[20]  Neslihan Serap Sengör,et al.  A Computational Model for the Effect of Dopamine on Action Selection During Stroop Test , 2006, ICANN.

[21]  G. E. Alexander,et al.  Functional architecture of basal ganglia circuits: neural substrates of parallel processing , 1990, Trends in Neurosciences.

[22]  John G. Taylor,et al.  Analysis of recurrent cortico-basal ganglia-thalamic loops for working memory , 2000, Biological Cybernetics.

[23]  S. Haber,et al.  Reward-Related Cortical Inputs Define a Large Striatal Region in Primates That Interface with Associative Cortical Connections, Providing a Substrate for Incentive-Based Learning , 2006, The Journal of Neuroscience.