Interactive learning of consensus sequences in genetic programming for evolution of snake-like robot

We discuss an approach of incorporating interactively learned consensus sequences (ILCS) in genetic programming (GP) for efficient evolution of simulated Snakebot situated in a challenging environment. ILCS introduce a biased mutation in GP via probabilistic context sensitive grammar, in which the probabilities of applying the production rules with multiple right-hand side alternatives depend on the grammatical context. The distribution of these probabilities is learned interactively from the syntax of the snakebots, exhibiting behavioral traits that according to the human observer are relevant for the emergence of ability to overcome obstacles. Because at the earlier stages of evolution these behavioral traits are not necessarily pertinent to the best performing (i.e. fastest) snakebots, the user feedback provides the evolution with an additional insight about the promising areas in the fitness landscape. Empirical results verify that employing ILCS improves the efficiency of GP in that the evolved snakebots are faster than those obtained via canonical GP.

[1]  C. Blackstone.  The Neuron: Cell and Molecular Biology , 2003 .

[2]  M. Fujita,et al.  Evolution of dynamic gaits for a robot , 2000, 2000 Digest of Technical Papers. International Conference on Consumer Electronics. Nineteenth in the Series (Cat. No.00CH37102).

[3]  Kazuyuki Ito,et al.  Emergence of adaptive behaviors by redundant robots - robustness to changes environment and failures , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[4]  Lawrence S. Sugiyama.  Evolutionary psychology: The new science of the mind , 2001 .

[5]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[6]  F. Matsuno,et al.  Application of reinforcement learning to hyper-redundant system - Acquisition of locomotion pattern of snake like robot - , 2001 .

[7]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[8]  D. Goldberg,et al.  BOA: the Bayesian optimization algorithm , 1999 .

[9]  Michael O'Neill,et al.  Grammatical evolution - evolutionary automatic programming in an arbitrary language , 2003, Genetic programming.

[10]  Hussein A. Abbass,et al.  Grammar model-based program evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[11]  Hideyuki Takagi,et al.  Interactive evolutionary computation: fusion of the capabilities of EC optimization and human evaluation , 2001, Proc. IEEE.

[12]  Tetsuya Iwasaki,et al.  Serpentine locomotion with robotic snakes , 2002 .

[13]  Hitoshi Iba,et al.  Integration of Genetic Programming and Reinforcement Learning for Real Robots , 2003, GECCO.

[14]  Karl Sims,et al.  Evolving 3D Morphology and Behavior by Competition , 1994, Artificial Life.

[15]  Peter A. N. Bosman,et al.  Learning Probabilistic Tree Grammars for Genetic Programming , 2004, PPSN.

[16]  Hendrik James Antonisse,et al.  A Grammar-Based Genetic Algorithm , 1990, FOGA.

[17]  Una-May O'Reilly,et al.  Genetic Programming II: Automatic Discovery of Reusable Programs. , 1994, Artificial Life.

[18]  Mikhail Prokopenko,et al.  Evolving Spatiotemporal Coordination in a Modular Robotic System , 2006, SAB.

[19]  Shigenobu Kobayashi,et al.  Reinforcement learning of walking behavior for a four-legged robot , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[20]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[21]  山田 祐,et al.  Open Dynamics Engine を用いたスノーボードロボットシミュレータの開発 , 2007 .

[22]  Peter J. Bentley,et al.  Evolving Motion of Robots with Muscles , 2003, EvoWorkshops.

[23]  Thomas S. Ray.  Aesthetically Evolved Virtual Pets , 2001, Leonardo.

[24]  Lynn Helena Caporale.  Darwin in the genome : molecular strategies in biological evolution , 2003 .

[25]  Ivan Tanev,et al.  Exploring the Analogy in the Emergent Properties of Locomotion Gaits of Snakebot Adapted to Challenging Terrain and Partial Damage , 2006 .