Autonomous Virulence Adaptation Improves Coevolutionary Optimization

A novel approach for the autonomous virulence adaptation (AVA) of competing populations in a coevolutionary optimization framework is presented. Previous work has demonstrated that setting an appropriate virulence, v, of populations accelerates coevolutionary optimization by avoiding detrimental periods of disengagement. However, since the likelihood of disengagement varies both between systems and over time, choosing the ideal value of v is problematic. The AVA technique presented here uses a machine learning approach to continuously tune v as system engagement varies. In a simple, abstract domain, AVA is shown to successfully adapt to the most productive values of v. Further experiments, in more complex domains of sorting networks and maze navigation, demonstrate AVA's efficiency over reduced virulence and the layered Pareto coevolutionary archive.

[1]  J. Pollack,et al.  Focusing versus Intransitivity Geometrical Aspects of Co-evolution , 2003 .

[2]  Björn Olsson,et al.  Co-evolutionary search in asymmetric spaces , 2001, Inf. Sci..

[3]  Malcolm I. Heywood,et al.  Managing team-based problem solving with symbiotic bid-based genetic programming , 2008, GECCO '08.

[4]  Kotaro Hirasawa,et al.  A study of evolutionary multiagent models based on symbiosis , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  W. Daniel Hillis,et al.  Co-evolving parasites improve simulated evolution as an optimization procedure , 1990 .

[6]  Karl Sims,et al.  Evolving 3D Morphology and Behavior by Competition , 1994, Artificial Life.

[7]  Alastair Channon,et al.  The N-Strikes-Out Algorithm: A Steady-State Algorithm for Coevolution , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[8]  S. Kauffman,et al.  Coevolution to the edge of chaos: coupled fitness landscapes, poised states, and coevolutionary avalanches. , 1991, Journal of theoretical biology.

[9]  Daniel A. Ashlock,et al.  Coevolution and Tartarus , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[10]  Joc Cing Tay,et al.  Environmental effects on the coevolution of pursuit and evasion strategies , 2007, Genetic Programming and Evolvable Machines.

[11]  Andrew R. McIntyre,et al.  Toward co-evolutionary training of a multi-class classifier , 2005, 2005 IEEE Congress on Evolutionary Computation.

[12]  Richard A. Watson,et al.  Mutualism, Parasitism, and Evolutionary Adaptation , 2000 .

[13]  Xin Yao,et al.  Every Niching Method has its Niche: Fitness Sharing and Implicit Sharing Compared , 1996, PPSN.

[14]  Seth Bullock,et al.  Caring versus Sharing: How to Maintain Engagement and Diversity in Coevolving Populations , 2003, ECAL.

[15]  Craig W. Reynolds.  Competition, Coevolution and the Game of Tag , 1994 .

[16]  Jonathan L. Shapiro,et al.  Does Data-Model Co-evolution Improve Generalization Performance of Evolving Learners? , 1998, PPSN.

[17]  Edwin D. de Jong,et al.  The Incremental Pareto-Coevolution Archive , 2004, GECCO.

[18]  Stefano Nolfi,et al.  God Save the Red Queen! Competition in Co-Evolutionary Robotics , 1997 .

[19]  John Cartlidge.  Dynamically adapting parasite virulence to combat coevolutionary disengagement , 2008, ALIFE.

[20]  Dave Cliff,et al.  Tracking the Red Queen: Measurements of Adaptive Progress in Co-Evolutionary Simulations , 1995, ECAL.

[21]  Seth Bullock,et al.  Unpicking Tartan CIAO Plots: Understanding Irregular Coevolutionary Cycling , 2004, Adapt. Behav..

[22]  Alan S. Perelson,et al.  Searching for Diverse, Cooperative Populations with Genetic Algorithms , 1993, Evolutionary Computation.

[23]  Hod Lipson,et al.  'Managed challenge' alleviates disengagement in co-evolutionary system identification , 2005, GECCO '05.

[24]  Kalyanmoy Deb,et al.  Comparison of multi-modal optimization algorithms based on evolutionary algorithms , 2006, GECCO.

[25]  Risto Miikkulainen,et al.  Coevolution of neural networks using a layered pareto archive , 2006, GECCO.

[26]  B. R. Levin,et al.  The evolution and maintenance of virulence in microparasites. , 1996, Emerging infectious diseases.

[27]  Seth Bullock,et al.  Learning lessons from the common cold: How reducing parasite virulence improves coevolutionary optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[28]  Jordan B. Pollack,et al.  Focusing versus Intransitivity , 2003, GECCO.

[29]  Edwin D. de Jong,et al.  Ideal Evaluation from Coevolution , 2004, Evolutionary Computation.

[30]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[31]  Herbert F. Jelinek,et al.  Complex systems : from local interactions to global phenomena , 1996 .

[32]  D. Cliff.  Minimal-Intelligence Agents for Bargaining Behaviors in Market-Based Environments , 1997 .

[33]  J. Pollack,et al.  Order-theoretic Analysis of Coevolution Problems: Coevolutionary Statics , 2007 .

[34]  Seth Bullock,et al.  Combating Coevolutionary Disengagement by Reducing Parasite Virulence , 2004, Evolutionary Computation.

[35]  R. Paul Wiegand,et al.  An empirical analysis of collaboration methods in cooperative coevolutionary algorithms , 2001 .

[36]  J. Pollack,et al.  Coevolutionary dynamics in a minimal substrate , 2001 .

[37]  Jordan B. Pollack,et al.  Symbiotic Combination as an Alternative to Sexual Recombination in Genetic Algorithms , 2000, PPSN.

[38]  J. Krebs,et al.  Arms races between and within species , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[39]  Melanie Mitchell,et al.  A Comparison of Evolutionary and Coevolutionary Search , 2002, Int. J. Comput. Intell. Appl..

[40]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[41]  R. Watson,et al.  Pareto coevolution: using performance against coevolved opponents in a game as dimensions for Pareto selection , 2001 .

[42]  L. V. Valen,et al.  A new evolutionary law , 1973 .

[43]  D. Wolpert,et al.  No Free Lunch Theorems for Search , 1995 .

[44]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[45]  J. Pollack,et al.  Challenges in coevolutionary learning: arms-race dynamics, open-endedness, and medicocre stable states , 1998 .

[46]  J. Pollack,et al.  Coevolving the "Ideal" Trainer: Application to the Discovery of Cellular Automata Rules , 1998 .

[47]  Richard K. Belew,et al.  Coevolutionary search among adversaries , 1997 .

[48]  Edwin D. de Jong,et al.  A Monotonic Archive for Pareto-Coevolution , 2007, Evolutionary Computation.

[49]  Hugues Juillé.  Incremental Co-Evolution of Organisms: A New Approach for Optimization and Discovery of Strategies , 1995, ECAL.

[50]  Jordan B. Pollack,et al.  Pareto Optimality in Coevolutionary Learning , 2001, ECAL.

[51]  Jordan B. Pollack,et al.  Co-Evolution in the Successful Learning of Backgammon Strategy , 1998, Machine Learning.

[52]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[53]  Seth Bullock,et al.  Prospects for Computational Steering of Evolutionary Computation , 2002 .

[54]  X. Yao,et al.  How to Make Best Use of Evolutionary Learning , 1996 .

[55]  Samir W. Mahfoud.  Niching methods for genetic algorithms , 1996 .