Intransitivity in Coevolution

We review and investigate the current status of intransitivity as a potential obstacle in coevolution. Pareto-Coevolution avoids intransitivity by translating any standard superiority relation into a transitive Pareto-dominance relation. Even for transitive problems though, cycling is possible. Recently however, algorithms that provide monotonic progress for Pareto-Coevolution have become available. The use of such algorithms avoids cycling, whether caused by intransitivity or not. We investigate this in experiments with two intransitive test problems, and find that the IPCA and LAPCA archive methods establish monotonic progress on both test problems, thereby substantially outperforming the same method without an archive.

[1]  J. Pollack,et al.  Focusing versus Intransitivity Geometrical Aspects of Co-evolution , 2003 .

[2]  V. Rich.  Personal communication , 1989, Nature.

[3]  Jordan B. Pollack,et al.  Focusing versus Intransitivity , 2003, GECCO.

[4]  Dave Cliff,et al.  Tracking the Red Queen: Measurements of Adaptive Progress in Co-Evolutionary Simulations , 1995, ECAL.

[5]  Jordan B. Pollack,et al.  Pareto Optimality in Coevolutionary Learning , 2001, ECAL.

[6]  Jordan B. Pollack,et al.  A Game-Theoretic Approach to the Simple Coevolutionary Algorithm , 2000, PPSN.

[7]  Jordan B. Pollack,et al.  A Game-Theoretic Memory Mechanism for Coevolution , 2003, GECCO.

[8]  Jordan B. Pollack,et al.  Symbiotic Combination as an Alternative to Sexual Recombination in Genetic Algorithms , 2000, PPSN.

[9]  Richard K. Belew,et al.  Coevolutionary search among adversaries , 1997 .

[10]  Robert Axelrod,et al.  The Evolution of Strategies in the Iterated Prisoner's Dilemma , 2001 .

[11]  Stefano Nolfi,et al.  Co-evolving predator and prey robots , 1998, Artificial Life.

[12]  J. Pollack,et al.  Coevolutionary dynamics in a minimal substrate , 2001 .

[13]  Jan Paredis,et al.  Coevolutionary Computation , 1995, Artificial Life.

[14]  Edwin D. de Jong,et al.  The Incremental Pareto-Coevolution Archive , 2004, GECCO.

[15]  W. Daniel Hillis,et al.  Co-evolving parasites improve simulated evolution as an optimization procedure , 1990 .

[16]  Paulien Hogeweg,et al.  Evolutionary Consequences of Coevolving Targets , 1997, Evolutionary Computation.

[17]  Jordan B. Pollack,et al.  Methods for statistical inference: extending the evolutionary computation paradigm , 1999 .

[18]  Nils Aall Barricelli,et al.  Numerical testing of evolution theories , 1963 .

[19]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.

[20]  Edwin D. de Jong,et al.  Ideal Evaluation from Coevolution , 2004, Evolutionary Computation.

[21]  Edwin D. de Jong,et al.  Towards a bounded Pareto-coevolution archive , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).