Generalized Lehmer Mean for Success History based Adaptive Differential Evolution

The Differential Evolution (DE) is a highly competitive numerical optimization algorithm, with a small number of control parameters. However, it is highly sensitive to the setting of these parameters, which inspired many researchers to develop adaptation strategies. One of them is the popular Success-History based Adaptation (SHA) mechanism, which significantly improves the DE performance. In this study, the focus is on the choice of the metaparameters of the SHA, namely the settings of the Lehmer mean coefficients for scaling factor and crossover rate memory cells update. The experiments are performed on the LSHADE algorithm and the Congress on Evolutionary Computation competition on numerical optimization functions set. The results demonstrate that for larger dimensions the SHA mechanism with modified Lehmer mean allows a significant improvement of the algorithm efficiency. The theoretical considerations of the generalized Lehmer mean could be also applied to other adaptive mechanisms.

[1]  Eugene Semenkin,et al.  LSHADE Algorithm with Rank-Based Selective Pressure Strategy for Solving CEC 2017 Benchmark Problems , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[2]  Janez Brest,et al.  Single objective real-parameter optimization: Algorithm jSO , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[3]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[4]  Ponnuthurai N. Suganthan,et al.  Recent advances in differential evolution - An updated survey , 2016, Swarm Evol. Comput..

[5]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[6]  Rawaa Dawoud Al-Dabbagh,et al.  Algorithmic design issues in adaptive differential evolution schemes: Review and taxonomy , 2018, Swarm Evol. Comput..

[7]  Fei Peng,et al.  Multi-start JADE with knowledge transfer for numerical optimization , 2009, IEEE Congress on Evolutionary Computation.

[8]  Alex S. Fukunaga,et al.  Improving the search performance of SHADE using linear population size reduction , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[9]  Fabio Caraffini,et al.  Infeasibility and structural bias in Differential Evolution - Extended Results , 2019 .

[10]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[11]  P. Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2010 Competition on Constrained Real- Parameter Optimization , 2010 .