Distributed mixed variant differential evolution algorithms for unconstrained global optimization

This paper proposes a novel distributed differential evolution algorithm called Distributed Mixed Variant Differential Evolution (dmvDE). To alleviate the time consuming trial-and-error selection of appropriate Differential Evolution (DE) variant to solve a given optimization problem, dmvDE proposes to mix effective DE variants with diverse characteristics in a distributed framework. The novelty of dmvDEs lies in mixing different DE variants in an island based distributed framework. The 19 dmvDE algorithms, discussed in this paper, constitute various proportions and combinations of four DE variants (DE/rand/1/bin, DE/rand/2/bin, DE/best/2/bin and DE/rand-to-best/1/bin) as subpopulations with each variant evolving independently but also exchanging information amongst others to co-operatively enhance the efficacy of the distributed DE as a whole. The dmvDE algorithms have been run on a set of test problems and compared to the distributed versions of the constituent DE variants. Simulation results show that dmvDEs display a consistent overall improvement in performance than that of distributed DEs. The best of dmvDE algorithms has also been benchmarked against five distributed differential evolution algorithms. Simulation results reiterate the superior performance of the mixing of the DE variants in a distributed frame work. The best of dmvDE algorithms outperforms, on average, all five algorithms considered.

[1]  Shigeyoshi Tsutsui,et al.  Advances in evolutionary computing: theory and applications , 2003 .

[2]  Ville Tirronen,et al.  Two algorithmic enhancements for the parallel differential evolution , 2011 .

[3]  Liang Gao,et al.  A differential evolution algorithm with self-adapting strategy and control parameters , 2011, Comput. Oper. Res..

[4]  Vitaliy Feoktistov.  Differential Evolution: In Search of Solutions , 2006 .

[5]  Ville Tirronen,et al.  A study on scale factor in distributed differential evolution , 2011, Inf. Sci..

[6]  Ville Tirronen,et al.  A study on scale factor/crossover interaction in distributed differential evolution , 2011, Artificial Intelligence Review.

[7]  V.P. Plagianakos,et al.  Spiking neural network training using evolutionary algorithms , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[8]  G. Leguizamon,et al.  Island Based Distributed Differential Evolution: An Experimental Study on Hybrid Testbeds , 2008, 2008 Eighth International Conference on Hybrid Intelligent Systems.

[9]  Dimitris K. Tasoulis,et al.  Parallel differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[10]  Shengwu Xiong,et al.  Self-adaptive Hybrid differential evolution with simulated annealing algorithm for numerical optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[11]  Ivanoe De Falco,et al.  Distributed Differential Evolution for the Registration of Remotely Sensed Images , 2007, 15th EUROMICRO International Conference on Parallel, Distributed and Network-Based Processing (PDP'07).

[12]  Ganesh K. Venayagamoorthy,et al.  Evolving Digital Circuits Using Hybrid Particle Swarm Optimization and Differential Evolution , 2006, Int. J. Neural Syst..

[13]  Amit Konar,et al.  Annealed Differential Evolution , 2007, 2007 IEEE Congress on Evolutionary Computation.

[14]  Ivanoe De Falco,et al.  A Distributed Differential Evolution Approach for Mapping in a Grid Environment , 2007, 15th EUROMICRO International Conference on Parallel, Distributed and Network-Based Processing (PDP'07).

[15]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[16]  C. Shunmuga Velayutham,et al.  An empirical comparison of Differential Evolution variants on different classes of unconstrained global optimization problems , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[17]  Kenneth V. Price,et al.  An introduction to differential evolution , 1999 .

[18]  Fabrice Heitz,et al.  Parallel Differential Evolution: Application to 3-D Medical Image Registration , 2005 .

[19]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[20]  Ville Tirronen,et al.  Distributed differential evolution with explorative–exploitative population families , 2009, Genetic Programming and Evolvable Machines.

[21]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[22]  René Thomsen,et al.  A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[23]  Haibin Duan,et al.  DEACO: Hybrid Ant Colony Optimization with Differential Evolution , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[24]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[25]  Ji-Pyng Chiou,et al.  Ant direction hybrid differential evolution for solving large capacitor placement problems , 2004 .

[26]  G. Ruxton.  The unequal variance t-test is an underused alternative to Student's t-test and the Mann–Whitney U test , 2006 .

[27]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[28]  C. Shunmuga Velayutham,et al.  An Empirical Performance Analysis of Differential Evolution Variants on Unconstrained Global Optimization Problems , 2010, CISIM 2010.

[29]  N. P. Padhy,et al.  Application of particle swarm optimization technique and its variants to generation expansion planning problem , 2004 .

[30]  Francisco Herrera,et al.  Gradual distributed real-coded genetic algorithms , 2000, IEEE Trans. Evol. Comput..

[31]  X. Yao,et al.  Fast evolutionary algorithms , 2003 .

[32]  Andries Petrus Engelbrecht,et al.  Bare bones differential evolution , 2009, Eur. J. Oper. Res..

[33]  Ville Tirronen,et al.  Scale factor inheritance mechanism in distributed differential evolution , 2009, Soft Comput..

[34]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[35]  C. Shunmuga Velayutham,et al.  Empirical Study on Migration Topologies and Migration Policies for Island Based Distributed Differential Evolution Variants , 2010, SEMCCO.

[36]  Krzysztof Bandurski,et al.  A Parallel Differential Evolution Algorithm A Parallel Differential Evolution Algorithm , 2006, PARELEC.

[37]  Nikolaus Hansen,et al.  Compilation of Results on the 2005 CEC Benchmark Function Set , 2005 .

[38]  Lin Han,et al.  A novel binary differential evolution algorithm based on artificial immune system , 2007, 2007 IEEE Congress on Evolutionary Computation.

[39]  Tim Hendtlass,et al.  A Combined Swarm Differential Evolution Algorithm for Optimization Problems , 2001, IEA/AIE.

[40]  Ivanoe De Falco,et al.  Satellite Image Registration by Distributed Differential Evolution , 2007, EvoWorkshops.