Animal-animat coevolution: using the animal population as fitness function

We show an artificial world where animals (humans) and animats (software agents) interact in a coevolutionary arms race. The two species each use adaptation schemes of their own. Learning through interaction with humans has been out of reach for evolutionary learning techniques because too many iterations are necessary. Our work demonstrates that the Internet is a new environment where this may be possible through an appropriate setup that creates mutualism, a relationship where human and animat species benefit from their interactions with each other.

[1]  Gerald Tesauro,et al.  Neurogammon Wins Computer Olympiad , 1989, Neural Computation.

[2]  Dave Cliff,et al.  Protean behavior in dynamic games: arguments for the co-evolution of pursuit-evasion tactics , 1994 .

[3]  Henry Lieberman,et al.  Autonomous interface agents , 1997, CHI.

[4]  Craig W. Reynolds.  Competition, Coevolution and the Game of Tag , 1994 .

[5]  Francesco Mondada,et al.  Automatic creation of an autonomous agent: genetic evolution of a neural-network driven robot , 1994 .

[6]  Jordan B. Pollack,et al.  Coevolution of a Backgammon Player , 1996 .

[7]  David H. Wolpert,et al.  A Mathematical Theory of Generalization: Part II , 1990, Complex Syst..

[8]  Dave Cliff,et al.  Co-evolution of pursuit and evasion II: Simulation Methods and results , 1996 .

[9]  Ralph R. Martin,et al.  A Sequential Niche Technique for Multimodal Function Optimization , 1993, Evolutionary Computation.

[10]  Arthur L. Samuel,et al.  Some Studies in Machine Learning Using the Game of Checkers , 1967, IBM J. Res. Dev..

[11]  Gerald Tesauro,et al.  Temporal Difference Learning and TD-Gammon , 1995, J. Int. Comput. Games Assoc..

[12]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[13]  Paul J. Darwen,et al.  Co-Evolutionary Learning by Automatic Modularisation with Speciation , 1996 .

[14]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[15]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[16]  Pattie Maes,et al.  Co-evolution of Pursuit and Evasion II: Simulation Methods and Results , 1996 .

[17]  Karl Sims,et al.  Evolving 3D Morphology and Behavior by Competition , 1994, Artificial Life.

[18]  W. Daniel Hillis,et al.  Co-evolving parasites improve simulated evolution as an optimization procedure , 1990 .

[19]  Robin W. Thorp,et al.  Coevolution of Animals and Plants , 1976 .

[20]  Francesco Mondada,et al.  Evolution of homing navigation in a real mobile robot , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[21]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[22]  Richard K. Belew,et al.  Coevolutionary search among adversaries , 1997 .

[23]  Dave Cliff,et al.  Challenges in evolving controllers for physical robots , 1996, Robotics Auton. Syst..

[24]  Jordan B. Pollack,et al.  Co-Evolving Intertwined Spirals , 1996, Evolutionary Programming.

[25]  Pattie Maes,et al.  Dynamics of Co-evolutionary Learning , 1996 .

[26]  Justinian Rosca,et al.  Generality versus size in genetic programming , 1996 .

[27]  Peter Bernhardt,et al.  Coevolution of Animals and Plants. , 1977 .

[28]  Jordan B. Pollack,et al.  Why did TD-Gammon Work? , 1996, NIPS.

[29]  Dave Cliff,et al.  Tracking the Red Queen: Measurements of Adaptive Progress in Co-Evolutionary Simulations , 1995, ECAL.