The dynamics of the best individuals in co-evolution

There continues to be a growing interest in the use of co-evolutionary algorithms to solve difficult computational problems. However, their performance has varied widely from good to disappointing. The main reason for this is that co-evolutionary systems can display quite complex dynamics. Therefore, in order to efficiently use co-evolutionary algorithms for problem solving, one must have a good understanding of their dynamical behavior. To build such understanding, we have constructed a methodology for analyzing co-evolutionary dynamics based on trajectories of best-of-generation individuals. We applied this methodology to gain insights into how to tune certain algorithm parameters in order to improve performance.

[1]  R. Paul Wiegand,et al.  Spatial Embedding and Loss of Gradient in Cooperative Coevolutionary Algorithms , 2004, PPSN.

[2]  J. Yorke,et al.  Chaos: An Introduction to Dynamical Systems , 1997 .

[3]  J. Pollack,et al.  Challenges in coevolutionary learning: arms-race dynamics, open-endedness, and medicocre stable states , 1998 .

[4]  J. Pollack,et al.  Coevolving High-Level Representations , 1993 .

[5]  S. Luke,et al.  When Coevolutionary Algorithms Exhibit Evolutionary Dyna mics , 2002 .

[6]  Josef Hofbauer,et al.  Evolutionary Games and Population Dynamics , 1998 .

[7]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[8]  W. Daniel Hillis,et al.  Co-evolving parasites improve simulated evolution as an optimization procedure , 1990 .

[9]  K.A. De Jong,et al.  Analyzing cooperative coevolution with evolutionary game theory , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[10]  Kenneth A. De Jong,et al.  Understanding cooperative co-evolutionary dynamics via simple fitness landscapes , 2005, GECCO '05.

[11]  Karl Sims,et al.  Evolving 3d morphology and behavior by competition , 1994 .

[12]  J. Pollack,et al.  A game-theoretic investigation of selection methods used in evolutionary algorithms , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[13]  R. Paul Wiegand,et al.  A Sensitivity Analysis of a Cooperative Coevolutionary Algorithm Biased for Optimization , 2004, GECCO.

[14]  Dave Cliff,et al.  Tracking the Red Queen: Measurements of Adaptive Progress in Co-Evolutionary Simulations , 1995, ECAL.

[15]  Christopher G. Langton,et al.  Artificial Life III , 2000 .

[16]  Jeffrey K. Bassett,et al.  An Analysis of Cooperative Coevolutionary Algorithms A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy at George Mason University , 2003 .

[17]  Elena Popovici,et al.  Understanding Competitive Co-Evolutionary Dynamics via Fitness Landscapes , 2004, AAAI Technical Report.

[18]  Richard K. Belew,et al.  Methods for Competitive Co-Evolution: Finding Opponents Worth Beating , 1995, ICGA.

[19]  Melanie Mitchell,et al.  A Comparison of Evolutionary and Coevolutionary Search , 2002, Int. J. Comput. Intell. Appl..

[20]  Kenneth A. De Jong,et al.  Relationships between internal and external metrics in co-evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[21]  Kenneth A. De Jong,et al.  A Dynamical Systems Analysis of Collaboration Methods in Cooperative Co-evolution , 2005, AAAI Fall Symposium: Coevolutionary and Coadaptive Systems.

[22]  J. Pollack,et al.  Order-theoretic Analysis of Coevolution Problems: Coevolutionary Statics , 2007 .