Exploring population structures for locally concurrent and massively parallel Evolutionary Algorithms

In this paper we present the Gossip-based Evolvable Agent Model (GossEvAg) within the context of parallel fine-grained Evolutionary Algorithms (EAs). It extends the Cellular Evolutionary Algorithm (CEA) definition with two novel features designed to work on Peer-to-Peer (P2P) networks: every individual is self-scheduled in a single thread and dynamically self-organizes its neighbourhood via newscasting, a gossip protocol. As a consequence of such multi-threading model, each Evolvable Agent (EvAg) updates asynchronously its state at random depending on the underlying platform scheduler. In order to assess the effects of asynchrony and the gossip protocol, we perform an experimental evaluation of the model for a set of discrete optimization problems. As a baseline for comparison we use two canonical genetic algorithms (GA): A steady-state GA (ssGA) and a generational GA (gGA). We also test two more topologies for the EvAg, a complete graph topology which allows panmixia and a Watts-Strogatz topology which has shown good theoretical and empirical results in related papers. We found that leaving the management of the EvAg to the underlying platform scheduler has an interesting emerging feature: the model is able to scale seamlessly in desktop computers without any effort from the practitioner. We measure how the algorithm speed scales by conducting the experiments in a Single and a Dual-Core Processor architectures.

[1]  Marco Tomassini,et al.  Spatially Structured Evolutionary Algorithms: Artificial Evolution in Space and Time (Natural Computing Series) , 2005 .

[2]  Juan Julián Merelo Guervós,et al.  Exploring selection mechanisms for an agent-based distributed evolutionary algorithm , 2007, GECCO '07.

[3]  O. Antoine,et al.  Theory of Error-correcting Codes , 2022 .

[4]  Márk Jelasity,et al.  Gossip-based aggregation in large dynamic networks , 2005, TOCS.

[5]  Erick Cantú-Paz,et al.  Efficient and Accurate Parallel Genetic Algorithms , 2000, Genetic Algorithms and Evolutionary Computation.

[6]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[7]  Enrique Alba,et al.  Modeling Selection Intensity for Toroidal Cellular Evolutionary Algorithms , 2004, GECCO.

[8]  Marco Tomassini,et al.  Takeover time curves in random and small-world structured populations , 2005, GECCO '05.

[9]  Mike Preuss,et al.  On the Importance of Information Speed in Structured Populations , 2004, PPSN.

[10]  Klaus Wehrle,et al.  What Is This "Peer-to-Peer" About? , 2005, Peer-to-Peer Systems and Applications.

[11]  Erick Cantú-Paz,et al.  Topologies, Migration Rates, and Multi-Population Parallel Genetic Algorithms , 1999, GECCO.

[12]  Kalyanmoy Deb,et al.  Massive Multimodality, Deception, and Genetic Algorithms , 1992, PPSN.

[13]  A. E. Eiben,et al.  Peer-to-peer evolutionary algorithms with adaptive autonomous selection , 2007, GECCO '07.

[14]  Enrique Alba,et al.  Selection intensity in cellular evolutionary algorithms for regular lattices , 2005, IEEE Transactions on Evolutionary Computation.

[15]  Donal O'Mahony,et al.  Overlay Networks: A Scalable Alternative for P2P , 2003, IEEE Internet Comput..

[16]  Márk Jelasity,et al.  A Robust and Scalable Peer-to-Peer Gossiping Protocol , 2003, AP2PC.

[17]  Márk Jelasity,et al.  Large-Scale Newscast Computing on the Internet , 2002 .

[18]  I. Wegener,et al.  Design and Management of Complex Technical Processes and Systems by means of Computational Intelligence Methods A Natural and Simple Function Which is Hard For All Evolutionary Algorithms , 2007 .

[19]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[20]  Marco Tomassini,et al.  Effects of Scale-Free and Small-World Topologies on Binary Coded Self-adaptive CEA , 2006, EvoCOP.

[21]  Enrique Alba,et al.  The influence of grid shape and asynchronicity on cellular evolutionary algorithms , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).