Multi-population differential evolution with balanced ensemble of mutation strategies for large-scale global optimization

Differential evolution (DE) is a simple, yet very effective, population-based search technique. However, it is challenging to maintain a balance between exploration and exploitation behaviors of the DE algorithm. In this paper, we boost the population diversity while preserving simplicity by introducing a multi-population DE to solve large-scale global optimization problems. In the proposed algorithm, called mDE-bES, the population is divided into independent subgroups, each with different mutation and update strategies. A novel mutation strategy that uses information from either the best individual or a randomly selected one is used to produce quality solutions to balance exploration and exploitation. Selection of individuals for some of the tested mutation strategies utilizes fitness-based ranks of these individuals. Function evaluations are divided into epochs. At the end of each epoch, individuals between the subgroups are exchanged to facilitate information exchange at a slow pace. The performance of the algorithm is evaluated on a set of 19 large-scale continuous optimization problems. A comparative study is carried out with other state-of-the-art optimization techniques. The results show that mDE-bES has a competitive performance and scalability behavior compared to the contestant algorithms.

[1]  Francisco Gortázar,et al.  Path relinking for large-scale global optimization , 2011, Soft Comput..

[2]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[3]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[4]  Jing J. Liang,et al.  Niching particle swarm optimization with local search for multi-modal optimization , 2012, Inf. Sci..

[5]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[6]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[7]  Arnold Neumaier,et al.  VXQR: derivative-free unconstrained optimization based on QR factorizations , 2011, Soft Comput..

[8]  Haiping Ma,et al.  An analysis of the equilibrium of migration models for biogeography-based optimization , 2010, Inf. Sci..

[9]  Xin Lu,et al.  Ranking Based Selection Genetic Algorithm for Capacity Flow Assignments , 2010, ISICA.

[10]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer with local search for Large Scale Global Optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[11]  G. Leguizamon,et al.  Island Based Distributed Differential Evolution: An Experimental Study on Hybrid Testbeds , 2008, 2008 Eighth International Conference on Hybrid Intelligent Systems.

[12]  Ponnuthurai N. Suganthan,et al.  Self-adaptive differential evolution with multi-trajectory search for large-scale optimization , 2011, Soft Comput..

[13]  O. J. Dunn Multiple Comparisons among Means , 1961 .

[14]  P. Gill,et al.  Quasi-Newton Methods for Unconstrained Optimization , 1972 .

[15]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[16]  Ponnuthurai N. Suganthan,et al.  Modified differential evolution with local search algorithm for real world optimization , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[17]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[18]  HerreraFrancisco,et al.  Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining , 2010 .

[19]  Dimitris K. Tasoulis,et al.  Parallel differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[20]  Fred W. Glover,et al.  EM323: a line search based algorithm for solving high-dimensional continuous non-linear optimization problems , 2011, Soft Comput..

[21]  Ponnuthurai N. Suganthan,et al.  Differential Evolution Algorithm with Ensemble of Parameters and Mutation and Crossover Strategies , 2010, SEMCCO.

[22]  Nikolaus Hansen,et al.  A restart CMA evolution strategy with increasing population size , 2005, 2005 IEEE Congress on Evolutionary Computation.

[23]  Antonio LaTorre,et al.  A MOS-based dynamic memetic differential evolution algorithm for continuous optimization: a scalability test , 2011, Soft Comput..

[24]  Francisco Herrera,et al.  Memetic algorithms based on local search chains for large scale continuous optimisation problems: MA-SSW-Chains , 2011, Soft Comput..

[25]  Lothar Thiele,et al.  A Comparison of Selection Schemes Used in Evolutionary Algorithms , 1996, Evolutionary Computation.

[26]  Francisco Herrera,et al.  Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power , 2010, Inf. Sci..

[27]  A. Kai Qin,et al.  Self-adaptive Differential Evolution Algorithm for Constrained Real-Parameter Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[28]  Janez Brest,et al.  Self-adaptive differential evolution algorithm using population size reduction and three strategies , 2011, Soft Comput..

[29]  Wenyin Gong,et al.  Differential Evolution With Ranking-Based Mutation Operators , 2013, IEEE Transactions on Cybernetics.

[30]  Xin Yao,et al.  Scalability of generalized adaptive differential evolution for large-scale continuous optimization , 2010, Soft Comput..

[31]  Ville Tirronen,et al.  Scale factor inheritance mechanism in distributed differential evolution , 2009, Soft Comput..

[32]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[33]  Arthur C. Sanderson,et al.  Differential evolution for discrete optimization: An experimental study on Combinatorial Auction problems , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[34]  Xiaodong Li,et al.  Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[35]  Enrique Alba,et al.  Restart particle swarm optimization with velocity modulation: a scalability test , 2011, Soft Comput..

[36]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[37]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[38]  Fred W. Glover,et al.  Future paths for integer programming and links to artificial intelligence , 1986, Comput. Oper. Res..

[39]  Thomas Stützle,et al.  An incremental particle swarm for large-scale continuous optimization problems: an example of tuning-in-the-loop (re)design of optimization algorithms , 2011, Soft Comput..

[40]  Ville Tirronen,et al.  Distributed differential evolution with explorative–exploitative population families , 2009, Genetic Programming and Evolvable Machines.

[41]  Chun Chen,et al.  Multiple trajectory search for Large Scale Global Optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[42]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[43]  Janez Brest,et al.  Self-Adaptive Differential Evolution Algorithm in Constrained Real-Parameter Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[44]  Xin Yao,et al.  Self-adaptive differential evolution with neighborhood search , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[45]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[46]  Bin Li,et al.  Estimation of distribution and differential evolution cooperation for large scale economic load dispatch optimization of power systems , 2010, Inf. Sci..

[47]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[48]  R. Storn,et al.  On the usage of differential evolution for function optimization , 1996, Proceedings of North American Fuzzy Information Processing.

[49]  Zhijian Wu,et al.  Enhanced opposition-based differential evolution for solving high-dimensional continuous optimization problems , 2011, Soft Comput..

[50]  S. García,et al.  An Extension on "Statistical Comparisons of Classifiers over Multiple Data Sets" for all Pairwise Comparisons , 2008 .

[51]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer with local search , 2005, 2005 IEEE Congress on Evolutionary Computation.

[52]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[53]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[54]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[55]  Ville Tirronen,et al.  A study on scale factor in distributed differential evolution , 2011, Inf. Sci..

[56]  Fred W. Glover,et al.  Unidimensional Search for Solving Continuous High-Dimensional Optimization Problems , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.

[57]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[58]  Francisco J. Rodríguez,et al.  Role differentiation and malleable mating for differential evolution: an analysis on large-scale optimisation , 2011, Soft Comput..

[59]  Ville Tirronen,et al.  Shuffle or update parallel differential evolution for large-scale optimization , 2011, Soft Comput..

[60]  Dan Simon,et al.  Biogeography-Based Optimization , 2022 .

[61]  Jing Tang,et al.  Diversity-adaptive parallel memetic algorithm for solving large scale combinatorial optimization problems , 2006, Soft Comput..

[62]  Zhenyu Yang,et al.  Large-Scale Global Optimization Using Cooperative Coevolution with Variable Interaction Learning , 2010, PPSN.

[63]  Francisco Herrera,et al.  Editorial scalability of evolutionary algorithms and other metaheuristics for large-scale continuous optimization problems , 2011, Soft Comput..

[64]  Jingqiao Zhang,et al.  Evolutionary optimization of transition probability matrices for credit decision-making , 2010, Eur. J. Oper. Res..

[65]  Arthur C. Sanderson,et al.  Minimal representation multisensor fusion using differential evolution , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[66]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[67]  Giovanni Iacca,et al.  Disturbed Exploitation compact Differential Evolution for limited memory optimization problems , 2011, Inf. Sci..

[68]  Xiaodong Li,et al.  Cooperative Co-evolution for large scale optimization through more frequent random grouping , 2010, IEEE Congress on Evolutionary Computation.