Evolution of distributed behavior

In this dissertation, we describe a study in the evolution of distributed behavior, where evolutionary algorithms are used to discover behaviors for distributed computing systems. We define distributed behavior as that in which groups of individuals must both cooperate in working towards a common goal and coordinate their activities in a harmonious fashion. As such, communication among individuals is necessarily a key component of distributed behavior, and we have identified three classes of distributed behavior that require communication: data-driven behaviors, where semantically meaningful data is transmitted between individuals; temporal behaviors, which are based on the relative timing of individuals’ actions; and structural behaviors, which are responsible for maintaining the underlying communication network connecting individuals. Our results demonstrate that evolutionary algorithms can discover groups of individuals that exhibit each of these different classes of distributed behavior, and that these behaviors can be discovered both in isolation (e.g., evolving a purely data-driven algorithm) and in concert (e.g., evolving an algorithm that includes both data-driven and structural behaviors). As part of this research, we show that evolutionary algorithms can discover novel heuristics for distributed computing, and hint at a new class of distributed algorithm enabled by such studies. The majority of this research was conducted with the Avida platform for digital evolution, a system that has been proven to aid researchers in understanding the biological process of evolution by natural selection. For this reason, the results presented in this dissertation provide the foundation for future studies that examine how distributed behaviors evolved in nature. The close relationship between evolutionary biology and evolutionary algorithms thus aids our study of evolving algorithms for the next generation of distributed computing systems.

[1]  Dario Floreano,et al.  Genetic Team Composition and Level of Selection in the Evolution of Cooperation , 2009, IEEE Transactions on Evolutionary Computation.

[2]  Miroslaw Malek,et al.  The consensus problem in fault-tolerant computing , 1993, CSUR.

[3]  J. Andersson,et al.  Lateral gene transfer in eukaryotes , 2005, Cellular and Molecular Life Sciences CMLS.

[4]  S. Salzberg,et al.  Evidence for lateral gene transfer between Archaea and Bacteria from genome sequence of Thermotoga maritima , 1999, Nature.

[5]  Mikhail Prokopenko,et al.  Design vs. Self-organization , 2008, Advances in Applied Self-organizing Systems.

[6]  Jason D. Lohn,et al.  Evolution, Re-evolution, and Prototype of an X-Band Antenna for NASA's Space Technology 5 Mission , 2005, ICES.

[7]  M. Nowak.  Five Rules for the Evolution of Cooperation , 2006, Science.

[8]  Christian List,et al.  Democracy in animal groups: a political science perspective. , 2004, Trends in ecology & evolution.

[9]  Márk Jelasity,et al.  T-Man: Gossip-Based Overlay Topology Management , 2005, Engineering Self-Organising Systems.

[10]  Prithviraj Dasgupta.  Intelligent Agent Enabled Genetic Ant Algorithm for P2P Resource Discovery , 2004, AP2PC.

[11]  J. Strassmann,et al.  KIN SELECTION AND SOCIAL INSECTS , 1998 .

[12]  Charles Ofria,et al.  HybrID: A Hybridization of Indirect and Direct Encodings for Evolutionary Computation , 2009, ECAL.

[13]  J. Lake,et al.  Horizontal gene transfer among genomes: the complexity hypothesis. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Christos G. Cassandras,et al.  Sensor Networks and Cooperative Control , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[15]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[16]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[17]  Petter Ögren,et al.  Cooperative control of mobile sensor networks:Adaptive gradient climbing in a distributed environment , 2004, IEEE Transactions on Automatic Control.

[18]  M. Lessl,et al.  Common mechanisms in bacterial conjugation and Ti-mediated T-DNA transfer to plant cells , 1994, Cell.

[19]  Randal W. Beard,et al.  Distributed Consensus in Multi-vehicle Cooperative Control - Theory and Applications , 2007, Communications and Control Engineering.

[20]  Walter Truszkowski,et al.  NASA's Swarm Missions: The Challenge of Building Autonomous Software , 2004, IT Prof..

[21]  Rachel Greenstadt,et al.  Myconet: A Fungi-Inspired Model for Superpeer-Based Peer-to-Peer Overlay Topologies , 2009, 2009 Third IEEE International Conference on Self-Adaptive and Self-Organizing Systems.

[22]  Stefano Nolfi,et al.  Self-Organizing Sync in a Robotic Swarm: A Dynamical System View , 2009, IEEE Transactions on Evolutionary Computation.

[23]  E. Morton,et al.  Animal Vocal Communication: A New Approach , 1998 .

[24]  Stefano Nolfi,et al.  Distributed Coordination of Simulated Robots Based on Self-Organization , 2006, Artificial Life.

[25]  Sonia Martínez,et al.  Coverage control for mobile sensing networks , 2002, IEEE Transactions on Robotics and Automation.

[26]  N. Franks,et al.  Social Evolution in Ants , 2019 .

[27]  Nancy A. Lynch,et al.  Impossibility of distributed consensus with one faulty process , 1985, JACM.

[28]  M. Nowak,et al.  Evolution of cooperation by multilevel selection. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[29]  Robert T. Pennock,et al.  The evolutionary origin of complex features , 2003, Nature.

[30]  Christoph Adami,et al.  Evolution of genetic organization in digital organisms , 1999, ArXiv.

[31]  Guy Theraulaz,et al.  Self-Organization in Biological Systems , 2001, Princeton studies in complexity.

[32]  Daniel Polani,et al.  Measuring Self-Organization via Observers , 2003, ECAL.

[33]  David B. Knoester,et al.  Using group selection to evolve leadership in populations of self-replicating digital organisms , 2007, GECCO '07.

[34]  Nancy A. Lynch,et al.  Distributed Algorithms , 1992, Lecture Notes in Computer Science.

[35]  K. Frisch.  The dance language and orientation of bees , 1967 .

[36]  David Sloan Wilson,et al.  Introduction: Multilevel Selection Theory Comes of Age , 1997, The American Naturalist.

[37]  Hermann Haken,et al.  Information and Self-Organization: A Macroscopic Approach to Complex Systems , 2010 .

[38]  Dan Yamins,et al.  Towards a theory of "local to global" in distributed multi-agent systems (I) , 2005, AAMAS '05.

[39]  Michael Burrows,et al.  The Chubby Lock Service for Loosely-Coupled Distributed Systems , 2006, OSDI.

[40]  Grant P. Steven,et al.  Optimal design of multiple load case structures using an evolutionary procedure , 1994 .

[41]  Radhika Nagpal,et al.  Desynchronization: The Theory of Self-Organizing Algorithms for Round-Robin Scheduling , 2007, First International Conference on Self-Adaptive and Self-Organizing Systems (SASO 2007).

[42]  Wei Ren,et al.  Information consensus in multivehicle cooperative control , 2007, IEEE Control Systems.

[43]  Gianluca Palermo,et al.  An Evolutionary Approach to Area-Time Optimization of FPGA designs , 2007, 2007 International Conference on Embedded Computer Systems: Architectures, Modeling and Simulation.

[44]  David E. Culler,et al.  The ganglia distributed monitoring system: design, implementation, and experience , 2004, Parallel Comput..

[45]  David B. Knoester,et al.  The Evolution of Division of Labor , 2009, ECAL.

[46]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[47]  Hartmut Schmeck,et al.  Towards a quantitative notion of self-organisation , 2007, 2007 IEEE Congress on Evolutionary Computation.

[48]  Robert Morris,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM 2001.

[49]  D. Floreano,et al.  Evolutionary Conditions for the Emergence of Communication in Robots , 2007, Current Biology.

[50]  D. Quagliarella,et al.  Airfoil and wing design through hybrid optimization strategies , 1998 .

[51]  Charles Ofria,et al.  The sensitivity of HyperNEAT to different geometric representations of a problem , 2009, GECCO.

[52]  Ian T. Foster,et al.  Mapping the Gnutella Network: Macroscopic Properties of Large-Scale Peer-to-Peer Systems , 2002, IPTPS.

[53]  David B. Knoester,et al.  Cooperative network construction using digital germlines , 2008, GECCO '08.

[54]  Robert Haslinger,et al.  Quantifying self-organization with optimal predictors. , 2004, Physical review letters.

[55]  Leslie Lamport,et al.  The part-time parliament , 1998, TOCS.

[56]  Gerhard Weiss,et al.  Multiagent systems: a modern approach to distributed artificial intelligence , 1999 .

[57]  Richard John Anthony,et al.  An autonomic election algorithm based on emergence in natural systems , 2006, Integr. Comput. Aided Eng..

[58]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[59]  J. Pollack,et al.  Kin-Selection: The Rise and Fall of Kin-Cheaters , 2004 .

[60]  Hartmut Schmeck,et al.  Adaptivity and self-organization in organic computing systems , 2010, TAAS.

[61]  Christian F. Tschudin,et al.  Experiments on the Automatic Evolution of Protocols Using Genetic Programming , 2005, WAC.

[62]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[63]  E. Southwick,et al.  Social synchronization of circadian rhythms of metabolism in honeybees (Apis mellifera) , 1987 .

[64]  Dario Floreano,et al.  Evolved swarming without positioning information: an application in aerial communication relay , 2009, Auton. Robots.

[65]  David B. Knoester,et al.  Directed Evolution of Communication and Cooperation in Digital Organisms , 2007, ECAL.

[66]  Francesco Mondada,et al.  Collective and Cooperative Group Behaviors: Biologically Inspired Experiments in Robotics , 1995, ISER.

[67]  Alan C. Schultz,et al.  Heterogeneity in the Coevolved Behaviors of Mobile Robots: The Emergence of Specialists , 2001, IJCAI.

[68]  C. Ofria,et al.  Evolution of digital organisms at high mutation rates leads to survival of the flattest , 2001, Nature.

[69]  Colin Camerer.  Behavioral Game Theory: Experiments in Strategic Interaction , 2003 .

[70]  Jeffrey O. Kephart,et al.  The Vision of Autonomic Computing , 2003, Computer.

[71]  R. Axelrod,et al.  The Further Evolution of Cooperation , 1988, Science.

[72]  R. Dawkins.  The Extended Phenotype , 1982 .

[73]  D. Wilson.  A theory of group selection. , 1975, Proceedings of the National Academy of Sciences of the United States of America.

[74]  David B. Knoester,et al.  Neuroevolution of mobile ad hoc networks , 2010, GECCO '10.

[75]  H. Ochman,et al.  Lateral gene transfer and the nature of bacterial innovation , 2000, Nature.

[76]  David B. Knoester,et al.  Evolution of Probabilistic Consensus in Digital Organisms , 2009, 2009 Third IEEE International Conference on Self-Adaptive and Self-Organizing Systems.

[77]  Kwang Yong. Lim.  A Performance Analysis of an Ad-hoc Ocean Sensor Network , 2006 .

[78]  Luís E. T. Rodrigues,et al.  A genetic algorithm for multicast mapping in publish-subscribe systems , 2003, Second IEEE International Symposium on Network Computing and Applications, 2003. NCA 2003..

[79]  Sean Luke,et al.  Cooperative Multi-Agent Learning: The State of the Art , 2005, Autonomous Agents and Multi-Agent Systems.

[80]  Robert Griesemer,et al.  Paxos made live: an engineering perspective , 2007, PODC '07.

[81]  Philip K. McKinley,et al.  Evolution of Adaptive Population Control in Multi-agent Systems , 2008, 2008 Second IEEE International Conference on Self-Adaptive and Self-Organizing Systems.

[82]  D. Grimaldi,et al.  Evolution of the insects , 2005 .

[83]  Roberto Montemanni,et al.  Design patterns from biology for distributed computing , 2006, TAAS.

[84]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[85]  J. Palva,et al.  Phase Synchrony among Neuronal Oscillations in the Human Cortex , 2005, The Journal of Neuroscience.

[86]  Thomas Bäck,et al.  Evolutionary computation: an overview , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[87]  S. Strogatz,et al.  Synchronization of pulse-coupled biological oscillators , 1990 .

[88]  David B. Knoester,et al.  Evolution of robust data distribution among digital organisms , 2009, GECCO '09.

[89]  C. Pittendrigh,et al.  Circadian rhythms and the circadian organization of living systems. , 1960, Cold Spring Harbor symposia on quantitative biology.

[90]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[91]  Josh C. Bongard,et al.  The impact of jointly evolving robot morphology and control on adaptation rate , 2009, GECCO.

[92]  J. Korb.  Thermoregulation and ventilation of termite mounds , 2003, Naturwissenschaften.

[93]  Luca Maria Gambardella,et al.  SWARM-BOT: A Swarm of Autonomous Mobile Robots with Self-Assembling Capabilities , 2002 .

[94]  Paolo Santi.  Topology control in wireless ad hoc and sensor networks , 2005 .

[95]  Josh C. Bongard,et al.  The Legion System: A Novel Approach to Evolving Hetrogeneity for Collective Problem Solving , 2000, EuroGP.

[96]  S. Ranji Ranjithan,et al.  Multipopulation cooperative coevolutionary programming (MCCP) to enhance design innovation , 2005, GECCO '05.

[97]  J. Hoogland,et al.  Nepotism and alarm calling in the black-tailed prairie dog (Cynomys ludovicianus) , 1983, Animal Behaviour.

[98]  R. Lenski,et al.  Evolution in Action , 2011 .

[99]  J. Kelso,et al.  Social coordination dynamics: Measuring human bonding , 2008, Social neuroscience.

[100]  D. Wilson,et al.  Altruism And Organism: Disentangling The Themes Of Multilevel Selection Theory , 1997, The American Naturalist.

[101]  Douglas E. Comer,et al.  Internetworking with TCP/IP - Principles, Protocols, and Architectures, Fourth Edition , 1988 .

[102]  E. M. Eddy,et al.  The germ line and development. , 1996, Developmental genetics.

[103]  Kenneth O. Stanley,et al.  Generative encoding for multiagent learning , 2008, GECCO '08.

[104]  Thomas D. Seeley,et al.  Honey Bee Colonies are Group‐Level Adaptive Units , 1997, The American Naturalist.

[105]  Risto Miikkulainen,et al.  COOPERATIVE COEVOLUTION OF MULTI-AGENT SYSTEMS , 2001 .

[106]  Vijay Kumar,et al.  Cooperative Control of Robot Formations , 2002 .

[107]  Richard M. Murray,et al.  Information flow and cooperative control of vehicle formations , 2004, IEEE Transactions on Automatic Control.

[108]  Helen Gill,et al.  Cyber-Physical Systems , 2019, 2019 IEEE International Conference on Mechatronics (ICM).

[109]  Hari Balakrishnan,et al.  Resilient overlay networks , 2001, SOSP.

[110]  Alex Kacelnik,et al.  Flock density, social foraging, and scanning: an experiment with starlings , 2004 .

[111]  Deborah Estrin,et al.  Computing aggregates for monitoring wireless sensor networks , 2003, Proceedings of the First IEEE International Workshop on Sensor Network Protocols and Applications, 2003..

[112]  Joel Lehman,et al.  Evolving policy geometry for scalable multiagent learning , 2010, AAMAS.

[113]  B. Bassler,et al.  Quorum sensing: cell-to-cell communication in bacteria. , 2005, Annual review of cell and developmental biology.

[114]  Christian Müller-Schloer,et al.  Quantitative Emergence , 2006, 2006 IEEE Mountain Workshop on Adaptive and Learning Systems.

[115]  D. Helbing,et al.  The outbreak of cooperation among success-driven individuals under noisy conditions , 2009, Proceedings of the National Academy of Sciences.

[116]  Charles Ofria,et al.  Avida , 2004, Artificial Life.

[117]  Gregory S. Hornby,et al.  An Evolved Antenna for Deployment on NASA's Space Technology 5 Mission , 2004 .

[118]  Christian Jacob,et al.  Evolutionary exploration of dynamic swarm behaviour , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[119]  C. Baray,et al.  Evolving cooperation via communication in homogeneous multi-agent systems , 1997, Proceedings Intelligent Information Systems. IIS'97.

[120]  Eörs Szathmáry,et al.  The Major Transitions in Evolution , 1997 .

[121]  Charles Ofria,et al.  Investigating the Emergence of Phenotypic Plasticity in Evolving Digital Organisms , 2007, ECAL.

[122]  Tushar Deepak Chandra.  Polylog randomized wait-free consensus , 1996, PODC '96.

[123]  James A. Reggia,et al.  Progress in the Simulation of Emergent Communication and Language , 2003, Adapt. Behav..

[124]  Naoki Wakamiya,et al.  Reaction-Diffusion Based Topology Self-Organization for Periodic Data Gathering in Wireless Sensor Networks , 2008, 2008 Second IEEE International Conference on Self-Adaptive and Self-Organizing Systems.

[125]  David W. Payton,et al.  Pheromone Robotics , 2001, Auton. Robots.

[126]  C. Ofria,et al.  Genome complexity, robustness and genetic interactions in digital organisms , 1999, Nature.

[127]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[128]  Kyle Wagner,et al.  Cooperative Strategies and the Evolution of Communication , 2000, Artificial Life.