Empirical evaluation of distributed Differential Evolution on standard benchmarks

This paper presents a new distributed Differential Evolution (dDE) algorithm and provides an exhaustive evaluation of it by using two standard benchmarks. One of them was proposed in the special session of Real-Parameter Optimization of CEC’05, and the other was proposed in the special session of Large Scale Global Optimization of CEC’08. We statistically validate and compare our results versus all other techniques presented in these special sessions. This means that more than 25 problems, with different dimensions: 30, 50, 100, and 500 variables, are evaluated; and 15 algorithms are compared in the experiments. Our dDE is simple, accurate, and competitive when applied to a wide variety of problems, with scaling dimensions, and different function features: noisy, non-separable, multimodal, rotated, etc.

[1]  Pedro J. Ballester,et al.  Real-parameter optimization performance study on the CEC-2005 benchmark with SPC-PNX , 2005, 2005 IEEE Congress on Evolutionary Computation.

[2]  Alberto Montresor,et al.  Gossiping Differential Evolution: A Decentralized Heuristic for Function Optimization in P2P Networks , 2010, 2010 IEEE 16th International Conference on Parallel and Distributed Systems.

[3]  Petr Bujok,et al.  Parallel Migration Models Applied to Competitive Differential Evolution , 2011, 2011 13th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing.

[4]  Janez Brest,et al.  High-dimensional real-parameter optimization using Self-Adaptive Differential Evolution algorithm with population size reduction , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[5]  Institute of Physics , 1936, Nature.

[6]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[7]  Ivanoe De Falco,et al.  Satellite Image Registration by Distributed Differential Evolution , 2007, EvoWorkshops.

[8]  Janez Brest,et al.  Large Scale Global Optimization using Differential Evolution with self-adaptation and cooperative co-evolution , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[9]  Ville Tirronen,et al.  Shuffle or update parallel differential evolution for large-scale optimization , 2011, Soft Comput..

[10]  Zbigniew Michalewicz,et al.  Handbook of Evolutionary Computation , 1997 .

[11]  HerreraFrancisco,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms' behaviour , 2009 .

[12]  Carlos García-Martínez,et al.  Hybrid real-coded genetic algorithms with female and male differentiation , 2005, 2005 IEEE Congress on Evolutionary Computation.

[13]  G. Leguizamon,et al.  Island Based Distributed Differential Evolution: An Experimental Study on Hybrid Testbeds , 2008, 2008 Eighth International Conference on Hybrid Intelligent Systems.

[14]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[15]  Francisco Herrera,et al.  Adaptive local search parameters for real-coded memetic algorithms , 2005, 2005 IEEE Congress on Evolutionary Computation.

[16]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer with local search for Large Scale Global Optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[17]  Rand R. Wilcox,et al.  New Statistical Procedures for the Social Sciences. , 1989 .

[18]  Saku Kukkonen,et al.  Real-parameter optimization with differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[19]  Ponnuthurai Nagaratnam Suganthan,et al.  Benchmark Functions for the CEC'2013 Special Session and Competition on Large-Scale Global Optimization , 2008 .

[20]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[21]  Ivanoe De Falco,et al.  A Distributed Differential Evolution Approach for Mapping in a Grid Environment , 2007, 15th EUROMICRO International Conference on Parallel, Distributed and Network-Based Processing (PDP'07).

[22]  Anne Auger,et al.  Impacts of invariance in search: When CMA-ES and PSO face ill-conditioned and non-separable problems , 2011, Appl. Soft Comput..

[23]  Dario Izzo,et al.  Parallel global optimisation meta-heuristics using an asynchronous island-model , 2009, 2009 IEEE Congress on Evolutionary Computation.

[24]  Ke Chen,et al.  Applied Mathematics and Computation , 2022 .

[25]  Christian Blum,et al.  Metaheuristics in combinatorial optimization: Overview and conceptual comparison , 2003, CSUR.

[26]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[27]  Mehmet Fatih Tasgetiren,et al.  An ensemble of discrete differential evolution algorithms for solving the generalized traveling salesman problem , 2010, Appl. Math. Comput..

[28]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[29]  Ville Tirronen,et al.  Scale factor inheritance mechanism in distributed differential evolution , 2009, Soft Comput..

[30]  Anne Auger,et al.  Performance evaluation of an advanced local search evolutionary algorithm , 2005, 2005 IEEE Congress on Evolutionary Computation.

[31]  Maliha S. Nash,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 2001, Technometrics.

[32]  Shang-Jeng Tsai,et al.  Solving large scale global optimization using improved Particle Swarm Optimizer , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[33]  D. Petcu,et al.  Parallel implementation of multi-population differential evolution , 2004 .

[34]  Enrique Alba,et al.  MALLBA: A Library of Skeletons for Combinatorial Optimisation (Research Note) , 2002, Euro-Par.

[35]  Ville Tirronen,et al.  Distributed differential evolution with explorative–exploitative population families , 2009, Genetic Programming and Evolvable Machines.

[36]  Chun Chen,et al.  Multiple trajectory search for Large Scale Global Optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[37]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[38]  Pascal Bouvry,et al.  Improving Classical and Decentralized Differential Evolution With New Mutation Operator and Population Topologies , 2011, IEEE Transactions on Evolutionary Computation.

[39]  Dimitris K. Tasoulis,et al.  Parallel differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[40]  Enrique Alba,et al.  Parallel Metaheuristics: A New Class of Algorithms , 2005 .

[41]  Xin Yao,et al.  Multilevel cooperative coevolution for large scale optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[42]  Kalyanmoy Deb,et al.  A population-based, steady-state procedure for real-parameter optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[43]  Nikolaus Hansen,et al.  A restart CMA evolution strategy with increasing population size , 2005, 2005 IEEE Congress on Evolutionary Computation.

[44]  A. F. Ioffe,et al.  NEW MIGRATION SCHEME FOR PARALLEL DIFFERENTIAL EVOLUTION , 2006 .

[45]  Bin Li,et al.  A restart univariate estimation of distribution algorithm: sampling under mixed Gaussian and Lévy probability distribution , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[46]  Petr Posík,et al.  Real-parameter optimization using the mutation step co-evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.