Is there a free lunch for cloud-based evolutionary algorithms?

In this paper we present a distributed evolutionary algorithm that uses exclusively cloud services. This presents certain advantages, such as avoiding the acquisition of expensive resources, but at the same time presents the problem of choice between different services at different levels (infrastructure, platform, software) and, finally the actual scalability that can be achieved in a real distributed evolutionary algorithm. These issues are addressed by creating a pure-cloud version of EvoSpace, a pool-based evolutionary algorithm previously presented by the authors. EvoSpace is tested using the free tier of two services (one for the pool and other for the clients) and also the paying tier, and speedup is measured and its limits assessed. In general, this paper proves that a low-cost distributed evolutionary algorithm system can be created using cloud services that can be set up in very short time, but that major efficiency improvements can be obtained by switching to the non-free tier, giving another twist to the famous phrase “there is no free lunch”. We also show that using a pool-based algorithm allows to use cloud services more efficiently (and dynamically) than a static or synchronous service.

[1]  Kalyan Veeramachaneni,et al.  Flex-GP: Genetic Programming on the Cloud , 2012, EvoApplications.

[2]  Una-May O'Reilly,et al.  A Library to Run Evolutionary Algorithms in the Cloud Using MapReduce , 2012, EvoApplications.

[3]  Juan Julián Merelo Guervós,et al.  Assessing speed-ups in commodity cloud storage services for distributed evolutionary algorithms , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[4]  Kalyan Veeramachaneni,et al.  Cloud Scale Distributed Evolutionary Strategies for High Dimensional Problems , 2013, EvoApplications.

[5]  Juan Julián Merelo Guervós,et al.  Designing and testing a pool-based evolutionary algorithm , 2012, Natural Computing.

[6]  Enrique Alba,et al.  Heterogeneous Computing and Parallel Genetic Algorithms , 2002, J. Parallel Distributed Comput..

[7]  Kenneth A. De Jong,et al.  An Analysis of the Interacting Roles of Population Size and Crossover in Genetic Algorithms , 1990, PPSN.

[8]  Boleslaw K. Szymanski,et al.  Evolutionary Algorithms on Volunteer Computing Platforms: The MilkyWay@Home Project , 2010, Parallel and Distributed Computational Intelligence.

[9]  J. Kennedy,et al.  Matching algorithms to problems: an experimental test of the particle swarm and some genetic algorithms on the multimodal problem generator , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[10]  Rajkumar Buyya,et al.  Multi-Objective Problem Solving With Offspring on Enterprise Clouds , 2009, ArXiv.

[11]  Kenneth A. De Jong,et al.  Using Problem Generators to Explore the Effects of Epistasis , 1997, ICGA.

[12]  Juan Julián Merelo Guervós,et al.  Asynchronous distributed genetic algorithms with Javascript and JSON , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[13]  Filomena Ferrucci,et al.  Towards Migrating Genetic Algorithms for Test Data Generation to the Cloud , 2013 .

[14]  Panagiotis G. Ipeirotis,et al.  Running Experiments on Amazon Mechanical Turk , 2010, Judgment and Decision Making.

[15]  Pedro S. de Souza,et al.  Asynchronous Teams: Cooperation Schemes for Autonomous Agents , 1998, J. Heuristics.

[16]  Juan Julián Merelo Guervós,et al.  EvoSpace: A Distributed Evolutionary Platform Based on the Tuple Space Model , 2013, EvoApplications.

[17]  Juan Julián Merelo Guervós,et al.  Pool-Based Distributed Evolutionary Algorithms Using an Object Database , 2012, EvoApplications.

[18]  Yuan Zhao,et al.  A distributed pool architecture for genetic algorithms , 2009, 2009 IEEE Congress on Evolutionary Computation.

[19]  Marc Parizeau,et al.  DEAP: evolutionary algorithms made easy , 2012, J. Mach. Learn. Res..

[20]  Alessandro Bollini,et al.  Distributed and Persistent Evolutionary Algorithms: A Design Pattern , 1999, EuroGP.

[21]  Juan Julián Merelo Guervós,et al.  EvoSpace-Interactive: A Framework to Develop Distributed Collaborative-Interactive Evolutionary Algorithms for Artistic Design , 2013, EvoMUSART.