Introduction. Modelling natural action selection

Action selection is the task of resolving conflicts between competing behavioural alternatives. This theme issue is dedicated to advancing our understanding of the behavioural patterns and neural substrates supporting action selection in animals, including humans. The scope of problems investigated includes: (i) whether biological action selection is optimal (and, if so, what is optimized), (ii) the neural substrates for action selection in the vertebrate brain, (iii) the role of perceptual selection in decision-making, and (iv) the interaction of group and individual action selection. A second aim of this issue is to advance methodological practice with respect to modelling natural action section. A wide variety of computational modelling techniques are therefore employed ranging from formal mathematical approaches through to computational neuroscience, connectionism and agent-based modelling. The research described has broad implications for both natural and artificial sciences. One example, highlighted here, is its application to medical science where models of the neural substrates for action selection are contributing to the understanding of brain disorders such as Parkinson's disease, schizophrenia and attention deficit/hyperactivity disorder.

[1]  R J HERRNSTEIN,et al.  Relative and absolute strength of response as a function of frequency of reinforcement. , 1961, Journal of the experimental analysis of behavior.

[2]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[3]  W. L. Kilmer,et al.  A model of the vertebrate central command system. , 1969 .

[4]  J. Krebs,et al.  Behavioural Ecology: An Evolutionary Approach , 1978 .

[5]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[6]  V. Braitenberg.  Vehicles, Experiments in Synthetic Psychology , 1984 .

[7]  Van Schaik.  The ecology of social relationships amongst female primates , 1989 .

[8]  A. Newell.  Unified Theories of Cognition , 1990 .

[9]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[10]  James L. McClelland,et al.  On the control of automatic processes: a parallel distributed processing account of the Stroop effect. , 1990, Psychological review.

[11]  R A Brooks,et al.  New Approaches to Robotics , 1991, Science.

[12]  Memory Limits in Sensorimotor Tasks , 1994 .

[13]  Melanie Mitchell,et al.  An introduction to genetic algorithms , 1996 .

[14]  L. Altenberg,et al.  PERSPECTIVE: COMPLEX ADAPTATIONS AND THE EVOLUTION OF EVOLVABILITY , 1996, Evolution; international journal of organic evolution.

[15]  J. Fuster.  The Prefrontal Cortex , 1997 .

[16]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[17]  Peter Redgrave,et al.  Layered Control Architectures in Robots and Vertebrates , 1999, Adapt. Behav..

[18]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[19]  P. Redgrave,et al.  The basal ganglia: a vertebrate solution to the selection problem? , 1999, Neuroscience.

[20]  Charlotte K. Hemelrijk,et al.  Towards the integration of social dominance and spatial structure , 2000, Animal Behaviour.

[21]  Joanna Bryson,et al.  Cross-paradigm analysis of autonomous agent architecture , 2000, J. Exp. Theor. Artif. Intell..

[22]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[23]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[24]  Peter Redgrave,et al.  A computational model of action selection in the basal ganglia. I. A new functional anatomy , 2001, Biological Cybernetics.

[25]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[26]  Charlotte K. Hemelrijk,et al.  Despotic societies, sexual attraction and the emergence of male 'tolerance': An agent-based model , 2002 .

[27]  Sridhar Mahadevan,et al.  Recent Advances in Hierarchical Reinforcement Learning , 2003, Discret. Event Dyn. Syst..

[28]  J. Wickens,et al.  Computational models of the basal ganglia: from robots to membranes , 2004, Trends in Neurosciences.

[29]  Charlotte K. Hemelrijk,et al.  The use of artificial-life models for the study of social organization , 2004 .

[30]  J. Bryson.  Modular Representations of Cognitive Phenomena in AI, Psychology and Neuroscience , 2005 .

[31]  T. Prescott,et al.  The brainstem reticular formation is a small-world, not scale-free, network , 2006, Proceedings of the Royal Society B: Biological Sciences.

[32]  T. Stanford,et al.  Subcortical loops through the basal ganglia , 2005, Trends in Neurosciences.

[33]  Eamonn B. Mallon,et al.  An agent-based model of collective nest choice by the ant Temnothorax albipennis , 2005, Animal Behaviour.

[34]  Michael Laver,et al.  Policy and the Dynamics of Political Competition , 2005, American Political Science Review.

[35]  J. Bryson,et al.  Agent-based Models as Scientific Methodology: a Case Study Analysing Primate Social Behaviour , 2007 .

[36]  Michael J. Frank,et al.  Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia , 2006, Neural Computation.

[37]  W I Sellers,et al.  An agent-based model of group decision making in baboons , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[38]  J C Houk,et al.  Action selection and refinement in subcortical loops through basal ganglia and cerebellum , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[39]  Tony J. Prescott,et al.  Forced Moves or Good Tricks in Design Space? Landmarks in the Evolution of Neural Mechanisms for Action Selection , 2007, Adapt. Behav..

[40]  Paul Cisek,et al.  Cortical mechanisms of action selection: the affordance competition hypothesis , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[41]  Hagen Lehmann,et al.  Agent-based modelling as scientific method: a case study analysing primate social behaviour , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[42]  Michael J. Frank,et al.  Understanding decision-making deficits in neurological conditions: insights from models of natural action selection , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[43]  Michael Laver,et al.  Spatial models of political competition with endogenous political parties , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[44]  T. Stafford,et al.  Modelling Natural Action Selection: Biologically constrained action selection improves cognitive control in a model of the Stroop task , 2011 .

[45]  Frederick L Crabbe,et al.  Compromise strategies for action selection , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[46]  Marius Usher,et al.  Extending a biologically inspired model of choice: multi-alternatives, nonlinearity and value-based multidimensional choice , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[47]  T. Prescott,et al.  Is there a brainstem substrate for action selection? , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[48]  Matthew M Botvinick,et al.  Multilevel structure in behaviour and in the brain: a model of Fuster's hierarchy , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[49]  Thomas E. Hazy,et al.  Towards an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[50]  A. Seth.  The ecology of action selection: insights from artificial life , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[51]  Alasdair I Houston,et al.  Do we expect natural selection to produce rational behaviour? , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.