Insights into the effects of control parameters and mutation strategy on self-adaptive ensemble-based differential evolution

Abstract This work explores the challenges in identifying appropriate and significant parameter configurations in differential evolution (DE) under the influence of population diversity and dimension size. For most DE algorithms, the configuration of control parameters is a vital prerequisite for balancing exploration and exploitation within the confinement of a search space. This study investigates the implementation of various adaptive parameter setting configurations on benchmark functions via the proposal of an algorithmic scheme called self-adaptive ensemble-based DE (SAEDE). This algorithm uses self-adaptive and ensemble mechanisms to set the relevant parameters for each generation. SAEDE is compared with two other ensemble-based DEs, and their performance is evaluated using 34 benchmark functions consisting of 20 low dimensions and 14 high dimensions. Furthermore, the convergence of these DEs is tested by using Q-measure. Experimental results indicate that SAEDE achieves the highest frequency of maximum success rate in 28 out of the 34 benchmark functions. SAEDE also achieves the lowest Q-measure of 4237318. These findings show the competitiveness and efficiency of SAEDE in locating optimal solutions while avoiding exhaustive searches of suitable parameters by users in terms of achieving optimization while minimizing the dependency on user setting.

[1]  Theam Foo Ng,et al.  Self-adapting approach in parameter tuning for differential evolution , 2015, 2015 Conference on Technologies and Applications of Artificial Intelligence (TAAI).

[2]  Alex S. Fukunaga,et al.  Improving the search performance of SHADE using linear population size reduction , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[3]  Amin Nobakhti,et al.  A simple self-adaptive Differential Evolution algorithm with application on the ALSTOM gasifier , 2008, Appl. Soft Comput..

[4]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[5]  Jingming Yang,et al.  A differential evolution algorithm with self-adaptive strategy and control parameters based on symmetric Latin hypercube design for unconstrained optimization problems , 2016, Eur. J. Oper. Res..

[6]  Andries Petrus Engelbrecht,et al.  Self-adaptive Differential Evolution , 2005, CIS.

[7]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[8]  Yang Chen,et al.  Association rule mining based parameter adaptive strategy for differential evolution algorithms , 2019, Expert Syst. Appl..

[9]  Michal Pluhacek,et al.  Distance based parameter adaptation for Success-History based Differential Evolution , 2019, Swarm Evol. Comput..

[10]  Ponnuthurai N. Suganthan,et al.  Ensemble strategies in Compact Differential Evolution , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[11]  Pushpendra Singh,et al.  Optimum load shedding based on sensitivity to enhance static voltage stability using DE , 2012, Swarm Evol. Comput..

[12]  Ponnuthurai N. Suganthan,et al.  Ensemble of parameters in a sinusoidal differential evolution with niching-based population reduction , 2017, Swarm Evol. Comput..

[13]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[14]  Hussein A. Abbass,et al.  Mebra: multiobjective evolutionary-based risk assessment , 2009, IEEE Computational Intelligence Magazine.

[15]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[16]  Daniela Zaharie,et al.  Influence of crossover on the behavior of Differential Evolution Algorithms , 2009, Appl. Soft Comput..

[17]  Janez Brest,et al.  Self-adaptive control parameters' randomization frequency and propagations in differential evolution , 2015, Swarm Evol. Comput..

[18]  Gang Liu,et al.  Self-adaptive differential evolution with global neighborhood search , 2017, Soft Comput..

[19]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[20]  Xuefeng Yan,et al.  An Immune Self-adaptive Differential Evolution Algorithm with Application to Estimate Kinetic Parameters for Homogeneous Mercury Oxidation , 2009 .

[21]  S. Miruna Joe Amali,et al.  Diversity Controlled Self Adaptive Differential Evolution based design of non-fragile multivariable PI controller , 2015, Eng. Appl. Artif. Intell..

[22]  Laizhong Cui,et al.  Adaptive differential evolution algorithm with novel mutation strategies in multiple sub-populations , 2016, Comput. Oper. Res..

[23]  Jing J. Liang,et al.  Novel composition test functions for numerical global optimization , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[24]  Jeng-Shyang Pan,et al.  PaDE: An enhanced Differential Evolution algorithm with novel control parameter adaptation schemes for numerical optimization , 2019, Knowl. Based Syst..

[25]  G. Jeyakumar C. Shanmugavelayutham Convergence Analysis of Differential Evolution Variants on Unconstrained Global Optimization Functions , 2011 .

[26]  Yang Tang,et al.  Adaptive population tuning scheme for differential evolution , 2013, Inf. Sci..

[27]  Adam P. Piotrowski,et al.  Comparison of evolutionary computation techniques for noise injected neural network training to estimate longitudinal dispersion coefficients in rivers , 2012, Expert Syst. Appl..

[28]  Haifeng Li,et al.  Ensemble of differential evolution variants , 2018, Inf. Sci..

[29]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[30]  Qingfu Zhang,et al.  Enhancing the search ability of differential evolution through orthogonal crossover , 2012, Inf. Sci..

[31]  H. Abbass The self-adaptive Pareto differential evolution algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[32]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[33]  Janez Brest,et al.  Constrained Real-Parameter Optimization with ε -Self-Adaptive Differential Evolution , 2009 .

[34]  Sha Wang,et al.  DE-RCO: Rotating Crossover Operator With Multiangle Searching Strategy for Adaptive Differential Evolution , 2018, IEEE Access.

[35]  Jason Sheng-Hong Tsai,et al.  Improving Differential Evolution With a Successful-Parent-Selecting Framework , 2015, IEEE Transactions on Evolutionary Computation.

[36]  Jason Teo,et al.  Self-adaptive population sizing for a tune-free differential evolution , 2009, Soft Comput..

[37]  Ruhul A. Sarker,et al.  Self-adaptive differential evolution incorporating a heuristic mixing of operators , 2013, Comput. Optim. Appl..

[38]  Fei Yu,et al.  A multi-role based differential evolution , 2019, Swarm Evol. Comput..

[39]  Ponnuthurai N. Suganthan,et al.  Self-adaptive differential evolution with multi-trajectory search for large-scale optimization , 2011, Soft Comput..

[40]  Dirk Helbing,et al.  Saving Human Lives: What Complexity Science and Information Systems can Contribute , 2014, Journal of statistical physics.

[41]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[42]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[43]  Ponnuthurai N. Suganthan,et al.  Ensemble differential evolution algorithm for CEC2011 problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[44]  Theam Foo Ng,et al.  Self-adaptive Ensemble Based Differential Evolution , 2018 .

[45]  Xiaodong Li,et al.  Solving Rotated Multi-objective Optimization Problems Using Differential Evolution , 2004, Australian Conference on Artificial Intelligence.

[46]  Alex Fukunaga,et al.  Reviewing and Benchmarking Parameter Control Methods in Differential Evolution , 2020, IEEE Transactions on Cybernetics.

[47]  Ponnuthurai N. Suganthan,et al.  Recent advances in differential evolution - An updated survey , 2016, Swarm Evol. Comput..

[48]  Iztok Fister,et al.  Artificial neural network regression as a local search heuristic for ensemble strategies in differential evolution , 2015, Nonlinear Dynamics.