Distributed Action Selection by a Brainstem Neural Substrate: An Embodied Evaluation

Theoretical approaches to the problem of action selection in autonomous agents often contrast centralised and distributed selection schemes Here we describe a neural substrate for distributed action selection in the vertebrate brain-stem, the medial reticular formation (mRF), which may form a evolutionary precursor to centralised schemes found in the higher brain We evaluate its competence as a selection device for robot control in a simulated resource co-ordination task, and use a genetic algorithm to evolve the mRF's inputs and internal structure Some configurations of the mRF could sufficiently co-ordinate actions to maximise the robot's energy, but this is critically dependent on a high rate of energy acquisition, which leaves an animal (or agent) susceptible to food shortages Thus, the inflexibility of the mRF as a distributed selection mechanism may have provided impetus for the evolution of more complex, centralised, selection mechanisms in the brain.

[1]  W. L. Kilmer,et al.  A model of the vertebrate central command system. , 1969 .

[2]  Mark D. Humphries,et al.  Is There an Integrative Center in the Vertebrate Brain-Stem? A Robotic Evaluation of a Model of the Reticular Formation Viewed as an Action Selection Device , 2005, Adapt. Behav..

[3]  A. Cohen,et al.  Dynamic behavior of a neural network model of locomotor control in the lamprey. , 1996, Journal of neurophysiology.

[4]  L. Jordan,et al.  Mechanism for activation of locomotor centers in the spinal cord by stimulation of the mesencephalic locomotor region. , 2003, Journal of neurophysiology.

[5]  T. Prescott,et al.  The brainstem reticular formation is a small-world, not scale-free, network , 2006, Proceedings of the Royal Society B: Biological Sciences.

[6]  T. Prescott,et al.  Is there a brainstem substrate for action selection? , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[7]  A. Guillot,et al.  A basal ganglia inspired model of action selection evaluated in a robotic survival task. , 2003, Journal of integrative neuroscience.

[8]  H. Grill,et al.  The Neuroanatomical Axis for Control of Energy Balance , 2002, Frontiers in Neuroendocrinology.

[9]  Peter Redgrave,et al.  Layered Control Architectures in Robots and Vertebrates , 1999, Adapt. Behav..

[10]  Gary G. Berntson,et al.  Organization of brainstem behavioral systems , 1976, Brain Research Bulletin.

[11]  Christopher G. Langton,et al.  Artificial Life , 2019, Philosophical Posthumanism.

[12]  P. Redgrave,et al.  The basal ganglia: a vertebrate solution to the selection problem? , 1999, Neuroscience.

[13]  G. Orlovsky,et al.  Encoding and decoding of reticulospinal commands , 2002, Brain Research Reviews.

[14]  Pattie Maes,et al.  Modeling Adaptive Autonomous Agents , 1993, Artificial Life.

[15]  Kevin Gurney,et al.  Action selection in a macroscopic model of the brainstem reticular formation , 2005 .