Distributed heterogeneous mixing of differential and dynamic differential evolution variants for unconstrained global optimization

This paper proposes a novel distributed differential evolution framework called distributed mixed variants (dynamic) differential evolution ($$dmvD^{2}E)$$dmvD2E). This novel framework is a heterogeneous mix of effective differential evolution (DE) and dynamic differential evolution (DDE) variants with diverse characteristics in a distributed framework to result in $$dmvD^{2}E$$dmvD2E. The $$dmvD^{2}E$$dmvD2E, discussed in this paper, constitute various proportions and combinations of DE/best/2/bin and DDE/best/2/bin as subpopulations with each variant evolving independently but also exchanging information amongst others to co-operatively enhance the efficacy of $$dmvD^{2}E$$dmvD2E as whole. The $$dmvD^{2}E$$dmvD2E variants have been run on 14 test problems of 30 dimensions to display their competitive performance over the distributed classical and dynamic versions of the constituent variants. The $$dmvD^{2}E$$dmvD2E, when benchmarked on a different 13 test problems of 500 as well as 1,000 dimensions, scaled well and outperformed, on an average, five existing distributed differential evolution algorithms.

[1]  Ivanoe De Falco,et al.  Satellite Image Registration by Distributed Differential Evolution , 2007, EvoWorkshops.

[2]  Fabrice Heitz,et al.  Parallel Differential Evolution: Application to 3-D Medical Image Registration , 2005 .

[3]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[4]  Vitaliy Feoktistov,et al.  Differential Evolution: In Search of Solutions (Springer Optimization and Its Applications) , 2006 .

[5]  V.P. Plagianakos,et al.  Spiking neural network training using evolutionary algorithms , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[6]  Anyong Qing,et al.  Dynamic differential evolution strategy and applications in electromagnetic inverse scattering problems , 2006, IEEE Trans. Geosci. Remote. Sens..

[7]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[8]  G Jeyakumar,et al.  An Empirical Comparative Performance Analysis of Differential Evolution, Distributed and Mixed-Variants Distributed Differential Evolution Variants , 2010 .

[9]  Ville Tirronen,et al.  Scale factor inheritance mechanism in distributed differential evolution , 2009, Soft Comput..

[10]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[11]  G Jeyakumar,et al.  Differential evolution and dynamic differential evolution variants for unconstrained global optimization – An Empirical Comparative Study , 2012 .

[12]  Shigeyoshi Tsutsui,et al.  Advances in evolutionary computing: theory and applications , 2003 .

[13]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[14]  Ville Tirronen,et al.  Distributed differential evolution with explorative–exploitative population families , 2009, Genetic Programming and Evolvable Machines.

[15]  Ville Tirronen,et al.  Two algorithmic enhancements for the parallel differential evolution , 2011 .

[16]  Ivanoe De Falco,et al.  A Distributed Differential Evolution Approach for Mapping in a Grid Environment , 2007, 15th EUROMICRO International Conference on Parallel, Distributed and Network-Based Processing (PDP'07).

[17]  X. Yao,et al.  Fast evolutionary algorithms , 2003 .

[18]  C. Shunmuga Velayutham,et al.  A comparative performance analysis of Differential Evolution and Dynamic Differential Evolution variants , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[19]  C. Shunmuga Velayutham,et al.  An Empirical Performance Analysis of Differential Evolution Variants on Unconstrained Global Optimization Problems , 2010, CISIM 2010.

[20]  René Thomsen,et al.  A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[21]  W. E. Larson,et al.  Nato Advanced Research Workshop , 1989 .

[22]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[23]  Riccardo Poli,et al.  New ideas in optimization , 1999 .

[24]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[25]  Krzysztof Bandurski,et al.  A Parallel Differential Evolution Algorithm A Parallel Differential Evolution Algorithm , 2006, PARELEC.

[26]  Nikolaus Hansen,et al.  Compilation of Results on the 2005 CEC Benchmark Function Set , 2005 .

[27]  Qingfu Zhang,et al.  Enhancing the search ability of differential evolution through orthogonal crossover , 2012, Inf. Sci..

[28]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[29]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[30]  C. Shunmuga Velayutham,et al.  Empirical Study on Migration Topologies and Migration Policies for Island Based Distributed Differential Evolution Variants , 2010, SEMCCO.

[31]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[32]  Ivanoe De Falco,et al.  Distributed Differential Evolution for the Registration of Remotely Sensed Images , 2007, 15th EUROMICRO International Conference on Parallel, Distributed and Network-Based Processing (PDP'07).

[33]  Kenneth V. Price,et al.  An introduction to differential evolution , 1999 .

[34]  G. Leguizamon,et al.  Island Based Distributed Differential Evolution: An Experimental Study on Hybrid Testbeds , 2008, 2008 Eighth International Conference on Hybrid Intelligent Systems.

[35]  G. Ruxton The unequal variance t-test is an underused alternative to Student's t-test and the Mann–Whitney U test , 2006 .

[36]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[37]  C. Shunmuga Velayutham,et al.  An empirical comparison of Differential Evolution variants on different classes of unconstrained global optimization problems , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[38]  Dimitris K. Tasoulis,et al.  Parallel differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[39]  Liang Gao,et al.  A differential evolution algorithm with self-adapting strategy and control parameters , 2011, Comput. Oper. Res..

[40]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[41]  Vitaliy Feoktistov Differential Evolution: In Search of Solutions , 2006 .

[42]  Ville Tirronen,et al.  A study on scale factor in distributed differential evolution , 2011, Inf. Sci..

[43]  Ville Tirronen,et al.  A study on scale factor/crossover interaction in distributed differential evolution , 2011, Artificial Intelligence Review.