Is There an Integrative Center in the Vertebrate Brain-Stem? A Robotic Evaluation of a Model of the Reticular Formation Viewed as an Action Selection Device

Neurobehavioral data from intact, decerebrate, and neonatal rats suggests that the reticular formation provides a brainstem substrate for action selection in the vertebrate central nervous system. In this article, Kilmer, McCulloch and Blum’s (1969) landmark reticular formation model (see also Kilmer, 1997) is described and re-evaluated, both in simulation and, for the first time, as a mobile robot con troller. Particular model configurations are found to provide effective action selection mechanisms in a robot survival task using either simulated or physical robots. The model’s competence is dependent on the organization of afferents from model sensory systems, and a genetic algorithm search identi fied a class of afferent configurations which have long survival times. The results support our proposal that the reticular formation evolved to provide effective arbitration between innate behaviors and, with the forebrain basal ganglia, may constitute the integrative, “centrencephalic” core of vertebrate brain architecture. Additionally, the results demonstrate that the Kilmer et al. model provides an alternative form of robot controller to those usually considered in the adaptive behavior literature.

[1]  P. Redgrave,et al.  An embodied model of action selection mechanisms in the vertebrate brain , 2000 .

[2]  D B Newman,et al.  Distinguishing rat brainstem reticulospinal nuclei by their neuronal morphology. II. Pontine and mesencephalic nuclei. , 1985, Journal fur Hirnforschung.

[3]  A. Guillot,et al.  A basal ganglia inspired model of action selection evaluated in a robotic survival task. , 2003, Journal of integrative neuroscience.

[4]  D B Newman,et al.  Distinguishing rat brainstem reticulospinal nuclei by their neuronal morphology. I. Medullary nuclei. , 1985, Journal fur Hirnforschung.

[5]  Newman Db,et al.  Distinguishing rat brainstem reticulospinal nuclei by their neuronal morphology. I. Medullary nuclei. , 1985 .

[6]  J. S. Schneider,et al.  Substantia nigra projection to medullary reticular formation: Relevance to oculomotor and related motor functions in the cat , 1985, Neuroscience Letters.

[7]  Roberto Moreno-Díaz,et al.  A Neurocybernetic Model of Modal Co‐operative Decisions in the Kilmer‐McCulloch Space , 1989 .

[8]  Robert Thompson,et al.  Centrencephalic Theory, the General Learning System, and Subcortical Dementia , 1993, Annals of the New York Academy of Sciences.

[9]  M. Leibetseder,et al.  Are Depressive Persons Capable of Describing Changes in Their Reactions without Being Able to Explain Them? , 2004, Psychopathology.

[10]  W PENFIELD,et al.  Centrencephalic integrating system. , 1958, Brain : a journal of neurology.

[11]  Shigemi Mori,et al.  Distribution of serotonin cells projecting to the pontomedullary reticular formation in the cat , 1994, Neuroscience Research.

[12]  C Cherniak,et al.  Component placement optimization in the brain , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  W. L. Kilmer,et al.  A model of the vertebrate central command system. , 1969 .

[14]  D. Cliff From animals to animats 3 : proceedings of the Third International Conference on Simulation of Adaptive Behavior , 1994 .

[15]  P. Redgrave,et al.  The basal ganglia: a vertebrate solution to the selection problem? , 1999, Neuroscience.

[16]  Joanna Bryson,et al.  Cross-paradigm analysis of autonomous agent architecture , 2000, J. Exp. Theor. Artif. Intell..

[17]  K. Berridge,et al.  Causal Mechanisms of Behavioural Development: The development of action patterns , 1994 .

[18]  Peter Redgrave,et al.  A computational model of action selection in the basal ganglia. II. Analysis and simulation of behaviour , 2001, Biological Cybernetics.

[19]  G. Paxinos The Rat nervous system , 1985 .

[20]  Peter Redgrave,et al.  Layered Control Architectures in Robots and Vertebrates , 1999, Adapt. Behav..

[21]  Johan J. Bolhuis,et al.  Causal Mechanisms of Behavioural Development: Development of cognition , 1994 .

[22]  R. McCarley,et al.  The mechanism of noradrenergic alpha 1 excitatory modulation of pontine reticular formation neurons , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  Pattie Maes,et al.  Modeling Adaptive Autonomous Agents , 1993, Artificial Life.

[24]  W. G. Hall,et al.  Feeding and behavioral activation in infant rats. , 1979, Science.

[25]  A G Barto,et al.  Learning by statistical cooperation of self-interested neuron-like computing elements. , 1985, Human neurobiology.

[26]  F. G. Worden,et al.  The neurosciences : third study program , 1974 .

[27]  Bruce Blumberg,et al.  Action-selection in hamsterdam: lessons from ethology , 1994 .

[28]  William L. Kilmer,et al.  A command computer for complex autonomous systems , 1997, Neurocomputing.

[29]  Peter Redgrave,et al.  A computational model of action selection in the basal ganglia. I. A new functional anatomy , 2001, Biological Cybernetics.

[30]  P. Delwaide,et al.  Projections from basal ganglia to tegmentum: a subcortical route for explaining the pathophysiology of Parkinson’s disease signs? , 2000, Journal of Neurology.

[31]  D Bowsher,et al.  The gigantocellular reticular region and its spinal afferents: a light and electron microscope study in the cat. , 1970, Journal of anatomy.

[32]  Dario Floreano,et al.  From Animals to Animats 2: Proceedings of the Second International Conference on Simulation of Adaptive Behavior , 2000, Journal of Cognitive Neuroscience.

[33]  G. C. Quarton,et al.  The neurosciences : a study program , 1967 .

[34]  Gary G. Berntson,et al.  Organization of brainstem behavioral systems , 1976, Brain Research Bulletin.

[35]  B. J. Yates,et al.  Integration of somatic and visceral inputs by the brainstem Functional considerations , 1998, Experimental Brain Research.

[36]  Toby Tyrrell,et al.  Computational mechanisms for action selection , 1993 .