Automatic Synthesis of Multiple Internal Models Through Active Exploration

An important question in cognitive science is whether internal models are encoded in the brain of higher animals at birth, and are only subsequently refined through experience, or whether models are synthesized over the lifetime of an animal – and if so, how are they formed. A further question is whether animals maintain a single model of a particular body part or tool, or whether multiple competing models are maintained simultaneously. In this paper we describe a co-evolutionary algorithm that automatically synthesizes and maintains multiple candidate models of a behaving robot. These predictive models can then be used to generate new controllers to either elicit some desired behavior under uncertainty (where competing models agree on the resulting behavior); or determine actions that uncover hidden components of the target robot (where models disagree, indicating further model synthesis is required). We demonstrate automated model synthesis from sensor data; model synthesis ‘from scratch’ (little initial knowledge about the robot’s morphology is assumed); and integrated, continued model synthesis and controller design. This new modeling methodology may shed light on how models are acquired and maintained in higher organisms for the purpose of prediction and anticipation.

[1]  Hod Lipson,et al.  Nonlinear system identification using coevolution of models and tests , 2005, IEEE Transactions on Evolutionary Computation.

[2]  Jordan B. Pollack,et al.  Creating High-Level Components with a Generative Representation for Body-Brain Evolution , 2002, Artificial Life.

[3]  Mario Graff,et al.  System Identification Using Genetic Programming and Gene Expression Programming , 2005, ISCIS.

[4]  Hod Lipson,et al.  Automated robot function recovery after unanticipated failure or environmental change using a minimum of hardware trials , 2004, Proceedings. 2004 NASA/DoD Conference on Evolvable Hardware, 2004..

[5]  Dario Floreano,et al.  Neural morphogenesis, synaptic plasticity, and evolution , 2001, Theory in Biosciences.

[6]  Karl Sims,et al.  Evolving 3d morphology and behavior by competition , 1994 .

[7]  Jordi Madrenas,et al.  Evolvable Systems: From Biology to Hardware , 1996, Lecture Notes in Computer Science.

[8]  Adeboyejo A. Thompson,et al.  Artificial Evolution in the Physical World , 1997 .

[9]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[10]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[11]  Hod Lipson,et al.  Active Coevolutionary Learning of Deterministic Finite Automata , 2005, J. Mach. Learn. Res..

[12]  Jordan B. Pollack,et al.  Computer Evolution of Buildable Objects for Evolutionary Design by Computers , 1998 .

[13]  Ian MacInnes,et al.  Visually Guided Physically Simulated Agents with Evolved Morphologies , 2003, ECAL.

[14]  P. Nordin Genetic Programming III - Darwinian Invention and Problem Solving , 1999 .

[15]  Yuehui Chen,et al.  Evolving Additive Tree Models for System Identification , 2005 .

[16]  Francesco Mondada,et al.  Evolutionary neurocontrollers for autonomous mobile robots , 1998, Neural Networks.

[17]  David J. Murray-Smith,et al.  Nonlinear model structure identification using genetic programming , 1998 .

[18]  Peter J. Bentley,et al.  An Evolutionary Approach to Damage Recovery of robot Motion with Muscles , 2003, ECAL.

[19]  R. Llinás I of the Vortex , 2000 .

[20]  J. Winn,et al.  Brain , 1878, The Lancet.

[21]  M. Kawato,et al.  Modular organization of internal models of tools in the human cerebellum , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[22]  Phil Husbands,et al.  Once More Unto the Breach: Co-evolving a robot and its simulator , 2004 .

[23]  Jordan B. Pollack,et al.  Evolutionary Techniques in Physical Robotics , 2000, ICES.

[24]  R. Pfeifer,et al.  Repeated structure and dissociation of genotypic and phenotypic complexity in artificial ontogeny , 2001 .

[25]  P. Fleming,et al.  Genetic programming for dynamic chaotic systems modelling , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[26]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[27]  Akio Ishiguro,et al.  The Effect of Neuromodulations on the Adaptability of Evolved Neurocontrollers , 2001, ECAL.

[28]  Jeffrey L. Krichmar,et al.  Evolutionary robotics: The biology, intelligence, and technology of self-organizing machines , 2001, Complex..

[29]  Di Paolo,et al.  Homeostatic adaptation to inversion of the visual field and other sensorimotor disruptions , 2000 .

[30]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[31]  Nils J. Nilsson,et al.  Principles of Artificial Intelligence , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Pablo Funes Computer Evolution of Buildable Objects , 1997 .

[33]  Nick Jakobi,et al.  Evolutionary Robotics and the Radical Envelope-of-Noise Hypothesis , 1997, Adapt. Behav..