Evolved neural network controllers for physically simulated robots that hunt with an artificial visual cortex

Using a rule-based system for growing artificial neural networks, we have evolved controllers for physically simulated robotic "spiders". The controllers take their input from an “artificial retina” that senses other spiders and inanimate barrier objects in the environment, and must provide output to dynamically control the 18 degrees of freedom of the six legs of the robot every time step. We perform evolutionary runs with two species of spider that interact in simulation with each other and with inanimate barrier objects. One species (the "predator") is selectively rewarded for "eating" (by physically colliding with) the other species, and the other (the "prey") is selectively penalized for being caught, and rewarded for "eating" the barriers. The two species evolve complex running gaits, with control inputs coming from their retinas that produce hunting or avoidance behavior. We suggest that predator-prey frequency dependent selection can provide a relatively long-term genetic memory of previously searched regions of phenotype space, enforcing a form of novelty search that may reduce duplicated evolutionary search effort.

[1]  Stefano Nolfi,et al.  Co-evolving predator and prey robots , 2012, Adapt. Behav..

[2]  L. Altenberg,et al.  PERSPECTIVE: COMPLEX ADAPTATIONS AND THE EVOLUTION OF EVOLVABILITY , 1996, Evolution; international journal of organic evolution.

[3]  Stefano Nolfi,et al.  Co-evolving predator and prey robots , 1998, Artificial Life.

[4]  D. Floreano,et al.  Adaptive Behavior in Competing Co-Evolving Species , 2000 .

[5]  Kenneth O. Stanley,et al.  Abandoning Objectives: Evolution Through the Search for Novelty Alone , 2011, Evolutionary Computation.

[6]  Francisco J. Ayala,et al.  Frequency-Dependent Selection , 1974 .

[7]  Tom Ziemke,et al.  Competitive Co-evolution of Predator and Prey Sensory-Motor Systems , 2003, EvoWorkshops.

[8]  Jean-Arcady Meyer,et al.  Evolution and Co Evolution of Computer Programs to Control Independently Acting Agents , 1991 .

[9]  Josh C. Bongard Morphological and environmental scaffolding synergize when evolving robot controllers: artificial life/robotics/evolvable hardware , 2011, GECCO '11.

[10]  Christian Jacob,et al.  Evolution of neural net architectures by a hierarchical grammar-based genetic system , 1993 .

[11]  Günter P. Wagner,et al.  Complex Adaptations and the Evolution of Evolvability , 2005 .

[12]  Tom Ziemke,et al.  Brains, Bodies, and Beyond: Competitive Co-Evolution of Robot Controllers, Morphologies and Environments , 2005, Genetic Programming and Evolvable Machines.

[13]  B. S. Manjunath,et al.  Incremental Evolution in Genetic Programming , 1998 .

[14]  Michael E. Palmer Evolved neurogenesis and synaptogenesis for robotic control: the L-brain model , 2011, GECCO '11.

[15]  S. Gould The evolution of life on the earth. , 1994, Scientific American.

[16]  Egbert J. W. Boers,et al.  Biological metaphors and the design of modular artificial neural networks , 2010 .

[17]  Lawrence J. Fogel,et al.  Evolutionary Programming: Proceedings of the Third Annual Conference , 1994 .

[18]  Gregory S. Hornby,et al.  Body-brain co-evolution using L-systems as a generative encoding , 2001 .

[19]  Karl Sims,et al.  Evolving 3d morphology and behavior by competition , 1994 .