Parallel heterogeneous genetic algorithms for continuous optimization

In this paper we address the physical parallelization of a very efficient genetic algorithm (GA) known as gradual distributed real-coded GA (GD-RCGA). This search model naturally provides a set of eight sub-populations residing in a cube topology having two faces for promoting exploration and exploitation. The resulting technique has been shown to yield very accurate results on continuous optimization by using crossover operators tuned to exploit and explore the space inside each sub-population. Here, we encompass the first actual parallelization of the technique, and get deeper into the importance of running a synchronous versus an asynchronous version of the basic GD-RCGA model. Our results indicate that this model maintains a very high level of accuracy for continuous optimization when run in parallel, as well as we show the similarities between the sync and async versions. Finally, we show that async parallelization is really more scalable than the sync one, suggesting future research lines for WAN execution and new models of search based in the two-faced cube of the original model.

[1]  Heinz Mühlenbein,et al.  Strategy Adaption by Competing Subpopulations , 1994, PPSN.

[2]  K. Dejong,et al.  An Analysis Of The Behavior Of A Class Of Genetic Adaptive Systems , 1975 .

[3]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[4]  Erik D. Goodman,et al.  Coarse-grain parallel genetic algorithms: categorization and new approach , 1994, Proceedings of 1994 6th IEEE Symposium on Parallel and Distributed Processing.

[5]  Oliver Vornberger,et al.  An Adaptive Parallel Genetic Algorithm for VLSI-Layout Optimization , 1996, PPSN.

[6]  Francisco Herrera,et al.  Fuzzy connectives based crossover operators to model genetic algorithms population diversity , 1997, Fuzzy Sets Syst..

[7]  Enrique Alba,et al.  Parallelism and evolutionary algorithms , 2002, IEEE Trans. Evol. Comput..

[8]  Enrique Alba,et al.  Parallel evolutionary algorithms can achieve super-linear performance , 2002, Inf. Process. Lett..

[9]  Uwe Aickelin,et al.  Partnering Strategies for Fitness Evaluation in a Pyramidal Evolutionary Algorithm , 2002, GECCO.

[10]  Zbigniew Michalewicz,et al.  Self-Adaptive Genetic Algorithm for Numeric Functions , 1996, PPSN.

[11]  Ju-Jang Lee,et al.  A new distributed evolutionary algorithm for optimization in nonstationary environments , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[12]  Heinz Mühlenbein,et al.  Adaptation of population sizes by competing subpopulations , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[13]  A. Griewank.  Generalized descent for global optimization , 1981 .

[14]  Enrique Alba,et al.  Parallel heterogeneous genetic algorithms for continuous optimization , 2004, Parallel Comput..

[15]  Enrique Alba,et al.  Influence of the Migration Policy in Parallel Distributed GAs with Structured and Panmictic Populations , 2000, Applied Intelligence.

[16]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[17]  L. Darrell Whitley,et al.  Test driving three 1995 genetic algorithms: New test functions and geometric matching , 1995, J. Heuristics.

[18]  Mourad Sefrioui,et al.  A Hierarchical Genetic Algorithm Using Multiple Models for Optimization , 2000, PPSN.

[19]  Keith E. Mathias,et al.  Convergence Controlled Variation , 1996, FOGA.

[20]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[21]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[22]  Tomoyuki Hiroyasu,et al.  A parallel genetic algorithm with distributed environment scheme , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[23]  Tomoyuki Hiroyasu,et al.  Distributed genetic algorithms with randomized migration rate , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[24]  Surya B. Yadav,et al.  The Development and Evaluation of an Improved Genetic Algorithm Based on Migration and Artificial Selection , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[25]  Hans-Paul Schwefel,et al.  Numerical Optimization of Computer Models , 1982 .

[26]  Francisco Herrera,et al.  Gradual distributed real-coded genetic algorithms , 2000, IEEE Trans. Evol. Comput..

[27]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[28]  Enrique Alba,et al.  .NET as a Platform for Implementing Concurrent Objects (Research Note) , 2002, Euro-Par.

[29]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[30]  Erik D. Goodman,et al.  The hierarchical fair competition (HFC) model for parallel evolutionary algorithms , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[31]  Zoran Obradovic,et al.  Cooperative Genetic Algorithm for Optimization Problems in Distributed Computer Systems , 1993 .

[32]  James E. Baker,et al.  Adaptive Selection Methods for Genetic Algorithms , 1985, International Conference on Genetic Algorithms.

[33]  Enrique Alba,et al.  Heterogeneous Computing and Parallel Genetic Algorithms , 2002, J. Parallel Distributed Comput..

[34]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[35]  Enrique Alba,et al.  Analyzing synchronous and asynchronous parallel distributed genetic algorithms , 2001, Future Gener. Comput. Syst..

[36]  Weilie Yi,et al.  Dynamic distributed genetic algorithms , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[37]  Thomas Bck,et al.  Self-adaptation in genetic algorithms , 1991 .

[38]  F. Herrera,et al.  Heterogeneous distributed genetic algorithms based on the crossover operator , 1997 .

[39]  Ben Paechter,et al.  A Framework for Distributed Evolutionary Algorithms , 2002, PPSN.

[40]  Enrique Alba,et al.  A survey of parallel distributed genetic algorithms , 1999, Complex..

[41]  Dirk Schlierkamp Voosen.  Strategy Adaptation by Competing Subpopulations , 1994 .

[42]  Francisco Herrera,et al.  Hybrid Distributed Real-Coded Genetic Algorithms , 1998, PPSN.

[43]  Vassilios Petridis,et al.  Co-operating Populations with Different Evolution Behaviours , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[44]  Erick Cantú-Paz,et al.  A Summary of Research on Parallel Genetic Algorithms , 1995 .

[45]  Shigeyoshi Tsutsui,et al.  Forking Genetic Algorithm with Blocking and Shrinking Modes (fGA) , 1993, ICGA.

[46]  Vassilios Petridis,et al.  On Modelling Evolutionary Algorithm Implementations through Co-operating Populations , 2002, PPSN.

[47]  Aimo A. Törn,et al.  Global Optimization , 1999, Science.

[48]  James E. Baker,et al.  Reducing Bias and Inefficienry in the Selection Algorithm , 1987, ICGA.

[49]  Alan H. Karp,et al.  Measuring parallel processor performance , 1990, CACM.