TPDE: A tri-population differential evolution based on zonal-constraint stepped division mechanism and multiple adaptive guided mutation strategies

Abstract Differential evolution (DE) has been recognized as one of the most effective algorithms for solving numerical optimization problems. In this paper, we propose a tri-population differential evolution (TPDE) to further enhance the search capability of DE. More specifically, the parent population is partitioned into three sub-populations with different emphasises at each iteration based on a newly proposed zonal-constraint stepped division (ZSD) mechanism, which determines the size of each sub-population according to not only individual’s fitness value but also the evolutionary process. To make the best of information provided by elite individuals and play their leading role on other individuals, three elite-guided mutation strategies are presented for each sub-population. Moreover, three sets of adaptive control parameters including the scale factor F and crossover rate CR are configured for three mutations according to Gaussian distribution model, Cauchy distribution model and a triangular wave function respectively. The design of mutation strategies and control parameters for each sub-population is based on the principle of balancing the global exploration and local exploitation capabilities. To evaluate the performance of TPDE, comparative experiments are conducted based on 59 benchmark functions from CEC2014 and CEC2017 test suites. The results indicate that the proposed TPDE is significantly better than, or at least comparable to the recent nine state-of-the-art DE variants.

[1]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[2]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[3]  Cheng Wang,et al.  Adaptive differential evolution with directional strategy and cloud model , 2014, Applied Intelligence.

[4]  Gui-Jun Zhang,et al.  Differential Evolution With Underestimation-Based Multimutation Strategy , 2019, IEEE Transactions on Cybernetics.

[5]  Hui Wang,et al.  Gaussian Bare-Bones Differential Evolution , 2013, IEEE Transactions on Cybernetics.

[6]  Ali Wagdy Mohamed,et al.  Real-parameter unconstrained optimization based on enhanced fitness-adaptive differential evolution algorithm with novel mutation , 2017, Soft Computing.

[7]  Ville Tirronen,et al.  Scale factor inheritance mechanism in distributed differential evolution , 2009, Soft Comput..

[8]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[9]  Ali Wagdy Mohamed,et al.  Real-Parameter Unconstrained Optimization Based on Enhanced AGDE Algorithm , 2018, Machine Learning Paradigms.

[10]  Ville Tirronen,et al.  A study on scale factor/crossover interaction in distributed differential evolution , 2011, Artificial Intelligence Review.

[11]  Guohua Wu,et al.  Differential evolution with multi-population based ensemble of mutation strategies , 2016, Inf. Sci..

[12]  P. N. Suganthan,et al.  Multi-population differential evolution with balanced ensemble of mutation strategies for large-scale global optimization , 2015, Appl. Soft Comput..

[13]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[14]  Ville Tirronen,et al.  Differential Evolution with Fitness Diversity Self-adaptation , 2009, Nature-Inspired Algorithms for Optimisation.

[15]  Liang Gao,et al.  Adaptive Differential Evolution With Sorting Crossover Rate for Continuous Optimization Problems , 2017, IEEE Transactions on Cybernetics.

[16]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[17]  Weili Wang,et al.  Differential evolution algorithm with strategy adaptation and knowledge-based control parameters , 2017, Artificial Intelligence Review.

[18]  Bin Xu,et al.  Differential evolution with adaptive trial vector generation strategy and cluster-replacement-based feasibility rule for constrained optimization , 2018, Inf. Sci..

[19]  Feng Qian,et al.  Self-adaptive differential evolution with multiple strategies for dynamic optimization of chemical processes , 2019, Neural Computing and Applications.

[20]  Amer Draa,et al.  A sinusoidal differential evolution algorithm for numerical optimisation , 2015, Appl. Soft Comput..

[21]  Ville Tirronen,et al.  Recent advances in differential evolution: a survey and experimental analysis , 2010, Artificial Intelligence Review.

[22]  Ponnuthurai N. Suganthan,et al.  An efficient Differential Evolution algorithm for stochastic OPF based active-reactive power dispatch problem considering renewable generators , 2019, Appl. Soft Comput..

[23]  Lin Li,et al.  Task scheduling in cloud computing based on hybrid moth search algorithm and differential evolution , 2019, Knowl. Based Syst..

[24]  Rawaa Dawoud Al-Dabbagh,et al.  Algorithmic design issues in adaptive differential evolution schemes: Review and taxonomy , 2018, Swarm Evol. Comput..

[25]  Rammohan Mallipeddi,et al.  An evolving surrogate model-based differential evolution algorithm , 2015, Appl. Soft Comput..

[26]  Swagatam Das,et al.  The spherical search algorithm for bound-constrained global optimization problems , 2019, Appl. Soft Comput..

[27]  Ferrante Neri,et al.  An Adaptive Multimeme Algorithm for Designing HIV Multidrug Therapies , 2007, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[28]  Hong-Bo Wang,et al.  APDDE: self-adaptive parameter dynamics differential evolution algorithm , 2018, Soft Comput..

[29]  Jeng-Shyang Pan,et al.  Parameters with Adaptive Learning Mechanism (PALM) for the enhancement of Differential Evolution , 2018, Knowl. Based Syst..

[30]  Nan Jiang,et al.  A simple differential evolution with time-varying strategy for continuous optimization , 2020, Soft Comput..

[31]  Ville Tirronen,et al.  A study on scale factor in distributed differential evolution , 2011, Inf. Sci..

[32]  Wei Luo,et al.  Adaptive direction information in differential evolution for numerical optimization , 2016, Soft Comput..

[33]  Anas A. Hadi,et al.  Novel mutation strategy for enhancing SHADE and LSHADE algorithms for global numerical optimization , 2019, Swarm Evol. Comput..

[34]  Ville Tirronen,et al.  Distributed differential evolution with explorative–exploitative population families , 2009, Genetic Programming and Evolvable Machines.

[35]  Yulong Bai,et al.  A self-adaptive multi-population differential evolution algorithm , 2019, Natural Computing.

[36]  Yiqiao Cai,et al.  Differential Evolution With Neighborhood and Direction Information for Numerical Optimization , 2013, IEEE Transactions on Cybernetics.

[37]  Jeng-Shyang Pan,et al.  PaDE: An enhanced Differential Evolution algorithm with novel control parameter adaptation schemes for numerical optimization , 2019, Knowl. Based Syst..

[38]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[39]  Ali Wagdy Mohamed,et al.  Adaptive guided differential evolution algorithm with novel mutation for numerical optimization , 2017, International Journal of Machine Learning and Cybernetics.

[40]  Zhi-Hui Zhan,et al.  Adaptive Distributed Differential Evolution , 2020, IEEE Transactions on Cybernetics.

[41]  Kouichi Sakurai,et al.  Attacking convolutional neural network using differential evolution , 2018, IPSJ Transactions on Computer Vision and Applications.