Evolution of Adaptive Population Control in Multi-agent Systems

Dynamic population management is an important aspect of multi-agent systems. In artificial immune systems, for example, a shortage of agents can lead to undetected threats, while an overabundance of agents can degrade quality of service and if unchecked, even create new vulnerabilities. Unfortunately, designing an effective strategy for population management is complicated by the myriad of possible circumstances and environmental conditions the agents may face after deployment. In this paper, we present the results of a study in applying digital evolution to the population management problem. In digital evolution, populations of self-replicating computer programs evolve in a user-defined computational environment, where they are subject to mutations and natural selection. Our results demonstrate that populations of digital organisms are capable of evolving self-adaptive replication behaviors that respond to attack fluctuations, as well as clever strategies for cooperating to mitigate attacks. This study provides evidence that digital evolution may be a useful tool in the design of self-organizing and self-adaptive agent-based systems.

[1]  Mohamed Bakhouya,et al.  Adaptive Approach for the Regulation of a Mobile Agent Population in a Distributed Network , 2006, 2006 Fifth International Symposium on Parallel and Distributed Computing.

[2]  David B. Knoester,et al.  Directed Evolution of Communication and Cooperation in Digital Organisms , 2007, ECAL.

[3]  Chenyang Lu,et al.  Rapid Development and Flexible Deployment of Adaptive Wireless Sensor Network Applications , 2005, 25th IEEE International Conference on Distributed Computing Systems (ICDCS'05).

[4]  Hamidreza Eskandari,et al.  FastPGA: A Dynamic Population Sizing Approach for Solving Expensive Multiobjective Optimization Problems , 2006, EMO.

[5]  Edith Cohen,et al.  Search and replication in unstructured peer-to-peer networks , 2002, ICS '02.

[6]  Agostinho C. Rosa,et al.  Self-regulated Population Size in Evolutionary Algorithms , 2006, PPSN.

[7]  Ajith Abraham,et al.  Evolving Intrusion Detection Systems , 2006, Genetic Systems Programming.

[8]  David B. Knoester,et al.  Harnessing Digital Evolution , 2008, Computer.

[9]  Tony White,et al.  Mobile agents for network management , 1998, IEEE Communications Surveys & Tutorials.

[10]  C. Holding.  Genome complexity , 2003, Genome Biology.

[11]  Charles Ofria,et al.  Autonomic Software Development Methodology Based on Darwinian Evolution , 2008, 2008 International Conference on Autonomic Computing.

[12]  Eugene H. Spafford,et al.  Defending a Computer System Using Autonomous Agents , 1995 .

[13]  C. Adami,et al.  Evolution of Biological Complexity , 2000, Proc. Natl. Acad. Sci. USA.

[14]  Zbigniew Michalewicz,et al.  GAVaPS-a genetic algorithm with varying population size , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[15]  Stephanie Forrest,et al.  A Machine Learning Evaluation of an Artificial Immune System , 2005, Evolutionary Computation.

[16]  C. Janeway.  Immunobiology: The Immune System in Health and Disease , 1996 .

[17]  C. Adami,et al.  Introduction To Artificial Life , 1997, IEEE Trans. Evol. Comput..

[18]  Charles Ofria,et al.  Selection for group-level efficiency leads to self-regulation of population size , 2008, GECCO '08.

[19]  D. Floreano,et al.  Evolutionary Conditions for the Emergence of Communication in Robots , 2007, Current Biology.

[20]  Charles Ofria,et al.  Evolution of an Adaptive Sleep Response in Digital Organisms , 2007, ECAL.

[21]  David Sloan Wilson,et al.  Introduction: Multilevel Selection Theory Comes of Age , 1997, The American Naturalist.

[22]  David B. Knoester,et al.  Cooperative network construction using digital germlines , 2008, GECCO '08.

[23]  Tony White,et al.  Management of mobile agent systems using social insect metaphors , 2002, 21st IEEE Symposium on Reliable Distributed Systems, 2002. Proceedings..

[24]  Jeffrey O. Kephart,et al.  The Vision of Autonomic Computing , 2003, Computer.

[25]  Vladimir Brusic,et al.  Data cleansing for computer models: a case study from immunology , 1999, ICONIP'99. ANZIIS'99 & ANNES'99 & ACNN'99. 6th International Conference on Neural Information Processing. Proceedings (Cat. No.99EX378).

[26]  Stephanie Forrest,et al.  Infect Recognize Destroy , 1996 .

[27]  Eugene H. Spafford,et al.  An architecture for intrusion detection using autonomous agents , 1998, Proceedings 14th Annual Computer Security Applications Conference (Cat. No.98EX217).

[28]  David B. Knoester,et al.  Evolution of Cooperative Information Gathering in Self-Replicating Digital Organisms , 2007, First International Conference on Self-Adaptive and Self-Organizing Systems (SASO 2007).

[29]  Charles Ofria,et al.  Avida , 2004, Artificial Life.

[30]  Seth Copen Goldstein,et al.  Active Messages: A Mechanism for Integrated Communication and Computation , 1992, [1992] Proceedings the 19th Annual International Symposium on Computer Architecture.

[31]  C. Ofria,et al.  Evolution of digital organisms at high mutation rates leads to survival of the flattest , 2001, Nature.

[32]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[33]  C. Ofria,et al.  Adaptive Radiation from Resource Competition in Digital Organisms , 2004, Science.

[34]  David B. Knoester,et al.  Using group selection to evolve leadership in populations of self-replicating digital organisms , 2007, GECCO '07.

[35]  Cazangi R. Renato,et al.  Stigmergic Autonomous Navigation in Collective Robotics , 2006 .

[36]  C. Ofria,et al.  Genome complexity, robustness and genetic interactions in digital organisms , 1999, Nature.

[37]  Robert T. Pennock,et al.  The evolutionary origin of complex features , 2003, Nature.