A study on the configuration of migratory flows in island model differential evolution

The Island Model (IM) is a well known multi-population approach for Evolutionary Algorithms (EAs). One of the critical parameters for defining a suitable IM is the migration topology. Basically it determines the Migratory Flows (MF) between the islands of the model which are able to improve the rate and pace of convergence observed in the EAs coupled with IMs. Although, it is possible to find a wide number of approaches for the configuration of MFs, there still is a lack of knowledge about the real performance of these approaches in the IM. In order to fill this gap, this paper presents a thorough experimental analysis of the approaches coupled with the state-of-the-art EA Differential Evolution. The experiments on well known benchmark functions show that there is a trade-off between convergence speed and convergence rate among the different approaches. With respect to the computational times, the results indicate that the increase in implementation complexity does not necessarily represent an increase in the overall execution time.

[1]  Darrell Whitley,et al.  The Island Model Genetic Algorithm: On Separability, Population Size and Convergence , 2015, CIT 2015.

[2]  Edgar Brunner,et al.  Rank-based multiple test procedures and simultaneous confidence intervals , 2012 .

[3]  Dario Izzo,et al.  On the impact of the migration topology on the Island Model , 2010, Parallel Comput..

[4]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[5]  Margaret J. Robertson,et al.  Design and Analysis of Experiments , 2006, Handbook of statistics.

[6]  Maolin Tang,et al.  Dynamic optimization of migration topology in internet-based distributed genetic algorithms , 2005, GECCO '05.

[7]  Vipin Kumar,et al.  Introduction to Data Mining, (First Edition) , 2005 .

[8]  O. Kempthorne.  Experimental Designs, 2nd Edition , 1958 .

[9]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[10]  Erick Cantú-Paz,et al.  Migration Policies, Selection Pressure, and Parallel Evolutionary Algorithms , 2001, J. Heuristics.

[11]  Enrique Alba,et al.  Parallel evolutionary algorithms can achieve super-linear performance , 2002, Inf. Process. Lett..

[12]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[13]  David Mark Levine,et al.  A parallel genetic algorithm for the set partitioning problem , 1995 .

[14]  Daniel T. Larose,et al.  Discovering Knowledge in Data: An Introduction to Data Mining , 2005 .

[15]  Lakshmi Rajamani,et al.  IMPROVED SELECTION OPERATOR GA , 2008 .

[16]  Dana S. Richards,et al.  Punctuated Equilibria: A Parallel Genetic Algorithm , 1987, ICGA.

[17]  A. Baron.  Experimental Designs , 1990, The Behavior analyst.

[18]  Victor J. Rayward-Smith,et al.  The Application of K-Medoids and PAM to the Clustering of Rules , 2004, IDEAL.

[19]  Frederico G. Guimarães,et al.  A Multi-agent Approach to the Adaptation of Migration Topology in Island Model Evolutionary Algorithms , 2012, 2012 Brazilian Symposium on Neural Networks.

[20]  Dejan S. Milojicic,et al.  Migration policies , 1999 .

[21]  John J. Grefenstette,et al.  A Parallel Genetic Algorithm , 1987, ICGA.

[22]  John R. Koza,et al.  A Parallel Implementation of Genetic Programming that Achieves Super-Linear Performance , 1998, Inf. Sci..

[23]  Q. Mcnemar.  Note on the sampling error of the difference between correlated proportions or percentages , 1947, Psychometrika.

[24]  Günter Rudolph,et al.  Global Optimization by Means of Distributed Evolution Strategies , 1990, PPSN.

[25]  Godfrey C. Onwubolu,et al.  Scheduling flow shops using differential evolution algorithm , 2006, Eur. J. Oper. Res..

[26]  Ville Tirronen,et al.  Scale factor inheritance mechanism in distributed differential evolution , 2009, Soft Comput..

[27]  Meng Joo Er,et al.  Study of migration topology in island model parallel hybrid-GA for large scale quadratic assignment problems , 2004, ICARCV 2004 8th Control, Automation, Robotics and Vision Conference, 2004..

[28]  Frederico G. Guimarães,et al.  Dynamic selection of migration flows in island model differential evolution , 2013, GECCO.

[29]  Dan Boneh,et al.  On genetic algorithms , 1995, COLT '95.

[30]  Pascal Bouvry,et al.  DESIGN OPTIMIZATION OF INDUCTION MOTORS WITH DIFFERENTIAL EVOLUTION ALGORITHMS WITH AN APPLICATION IN TEXTILE SPINNING , 2012, Appl. Artif. Intell..

[31]  Erick Cantú-Paz,et al.  A Survey of Parallel Genetic Algorithms , 2000 .

[32]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[33]  Enrique Alba,et al.  Parallel Genetic Algorithms , 2011, Studies in Computational Intelligence.

[34]  David E. Goldberg,et al.  Genetic Algorithms, Tournament Selection, and the Effects of Noise , 1995, Complex Syst..

[35]  Nurhan Karaboga,et al.  Digital IIR Filter Design Using Differential Evolution Algorithm , 2005, EURASIP J. Adv. Signal Process..

[36]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[37]  Dimitris K. Tasoulis,et al.  Parallel differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).