Adaptive multiple-elites-guided composite differential evolution algorithm with a shift mechanism

Abstract The performance of differential evolution (DE) has been significantly influenced by trial vector generation strategies and control parameters. Various powerful trial vector generation strategies with adaptive parameter adjustment methods such that the population generation is guided by the elites have been proposed. This paper aims to strengthen the performance of DE by compositing these powerful trial vector generation strategies, making it possible to obtain the guidance of each individual from multiple elites concurrently and independently. In this manner, the deleterious behavior in which an individual is misguided by various local optimal solutions into unpromising areas could be restrained to a certain extent. An adaptive multiple-elites-guided composite differential evolution algorithm with a shift mechanism (abbreviated as AMECoDEs) has been proposed in this paper. This algorithm concurrently employs two elites-guided trial vector generation strategies for each individual to generate two candidate solutions accordingly, and the best one is adopted to participate in the selection. Moreover, a novel shift mechanism is established to handle stagnation and premature convergence issues. AMECoDEs has been tested on the CEC2014 benchmark functions. Experimental results show that AMECoDEs outperforms various classic state-of-the-art DE variants and is better than or at least comparable to various recently proposed DE methods.

[1]  Ruhul A. Sarker,et al.  Training and testing a self-adaptive multi-operator evolutionary algorithm for constrained optimization , 2015, Appl. Soft Comput..

[2]  Ming Yang,et al.  Differential Evolution With Auto-Enhanced Population Diversity , 2015, IEEE Transactions on Cybernetics.

[3]  Laizhong Cui,et al.  Adaptive differential evolution algorithm with novel mutation strategies in multiple sub-populations , 2016, Comput. Oper. Res..

[4]  Yilong Yin,et al.  A Hybrid Evolutionary Immune Algorithm for Multiobjective Optimization Problems , 2016, IEEE Transactions on Evolutionary Computation.

[5]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[6]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[7]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[8]  Konstantinos E. Parsopoulos,et al.  Particle swarm optimization with neighborhood-based budget allocation , 2016, Int. J. Mach. Learn. Cybern..

[9]  Laizhong Cui,et al.  A novel artificial bee colony algorithm with depth-first search framework and elite-guided search equation , 2016, Inf. Sci..

[10]  Xiaoqi Yang,et al.  A Subgradient Method Based on Gradient Sampling for Solving Convex Optimization Problems , 2015 .

[11]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[12]  Wenyin Gong,et al.  DE/BBO: a hybrid differential evolution with biogeography-based optimization for global numerical optimization , 2010, Soft Comput..

[13]  Janez Brest,et al.  Self-adaptive control parameters' randomization frequency and propagations in differential evolution , 2015, Swarm Evol. Comput..

[14]  Aimin Zhou,et al.  A multiobjective cellular genetic algorithm based on 3D structure and cosine crowding measurement , 2014, International Journal of Machine Learning and Cybernetics.

[15]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[16]  Yang Wang,et al.  Repairing the crossover rate in adaptive differential evolution , 2014, Appl. Soft Comput..

[17]  Oscar Castillo,et al.  A hybrid optimization method with PSO and GA to automatically design Type-1 and Type-2 fuzzy logic controllers , 2015, Int. J. Mach. Learn. Cybern..

[18]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[19]  Qingfu Zhang,et al.  Multiobjective differential evolution algorithm based on decomposition for a type of multiobjective bilevel programming problems , 2016, Knowl. Based Syst..

[20]  Ponnuthurai N. Suganthan,et al.  Differential Evolution Algorithm with Ensemble of Parameters and Mutation and Crossover Strategies , 2010, SEMCCO.

[21]  Choi-Hong Lai,et al.  Simultaneous estimation of nonlinear parameters in parabolic partial differential equation using quantum-behaved particle swarm optimization with Gaussian mutation , 2014, International Journal of Machine Learning and Cybernetics.

[22]  Xiaodong Li,et al.  Solving Rotated Multi-objective Optimization Problems Using Differential Evolution , 2004, Australian Conference on Artificial Intelligence.

[23]  Jouni Lampinen,et al.  A Trigonometric Mutation Operation to Differential Evolution , 2003, J. Glob. Optim..

[24]  Ju-Jang Lee,et al.  Stochastic Opposition-Based Learning Using a Beta Distribution in Differential Evolution , 2016, IEEE Transactions on Cybernetics.

[25]  Ponnuthurai N. Suganthan,et al.  A Differential Covariance Matrix Adaptation Evolutionary Algorithm for real parameter optimization , 2012, Inf. Sci..

[26]  Guohua Wu,et al.  Differential evolution with multi-population based ensemble of mutation strategies , 2016, Inf. Sci..

[27]  Laizhong Cui,et al.  A novel hybrid differential evolution algorithm with modified CoDE and JADE , 2016, Appl. Soft Comput..

[28]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[29]  Rung Ching Chen,et al.  An artificial bee colony algorithm for data collection path planning in sparse wireless sensor networks , 2013, International Journal of Machine Learning and Cybernetics.

[30]  MengChu Zhou,et al.  Composite Particle Swarm Optimizer With Historical Memory for Function Optimization , 2015, IEEE Transactions on Cybernetics.

[31]  Laizhong Cui,et al.  Artificial bee colony algorithm with gene recombination for numerical function optimization , 2017, Appl. Soft Comput..

[32]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[33]  Meie Shen,et al.  Differential Evolution With Two-Level Parameter Adaptation , 2014, IEEE Transactions on Cybernetics.

[34]  Yuhui Shi,et al.  Particle Swarm Optimization With Interswarm Interactive Learning Strategy , 2016, IEEE Transactions on Cybernetics.

[35]  Saku Kukkonen,et al.  Real-parameter optimization with differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[36]  Wenyin Gong,et al.  Differential Evolution With Ranking-Based Mutation Operators , 2013, IEEE Transactions on Cybernetics.

[37]  Andries Petrus Engelbrecht,et al.  Self-adaptive Differential Evolution , 2005, CIS.

[38]  Fei Peng,et al.  Multi-start JADE with knowledge transfer for numerical optimization , 2009, IEEE Congress on Evolutionary Computation.

[39]  Alex S. Fukunaga,et al.  Improving the search performance of SHADE using linear population size reduction , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[40]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[41]  Xuefeng Yan,et al.  Self-Adaptive Differential Evolution Algorithm With Zoning Evolution of Control Parameters and Adaptive Mutation Strategies , 2016, IEEE Transactions on Cybernetics.

[42]  Ponnuthurai N. Suganthan,et al.  Recent advances in differential evolution - An updated survey , 2016, Swarm Evol. Comput..

[43]  Lixin Tang,et al.  Differential Evolution With an Individual-Dependent Mechanism , 2015, IEEE Transactions on Evolutionary Computation.

[44]  M. M. Ali,et al.  Differential evolution algorithms using hybrid mutation , 2007, Comput. Optim. Appl..

[45]  Janez Brest,et al.  Structured Population Size Reduction Differential Evolution with Multiple Mutation Strategies on CEC 2013 real parameter optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[46]  Ponnuthurai N. Suganthan,et al.  An Adaptive Differential Evolution Algorithm With Novel Mutation and Crossover Strategies for Global Numerical Optimization , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[47]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.