An adaptive differential evolution with adaptive archive selection and hill-valley detection

Differential Evolution (DE) has been successfully applied to various optimization problems. The performance of DE is affected by algorithm parameters such as a scaling factor F and a crossover rate CR. Many studies have been done to control the parameters adaptively. One of the most successful studies on parameter control is JADE. In JADE, the two parameter values are generated according to two probability density functions which are learned by the parameter values in success cases, where the child is better than the parent. Also, an optional external archive which consists of defeated parents is introduced to keep diversity. However, the effect of the archive much depends on the optimization problems. In this study, an adaptive method for using the archive is proposed where probability for selecting an operation with the archive or an operation without the archive is adaptively controlled based on the success probability of the operations. Also, hills and valleys in an objective function are detected in order to improve the performance of JADE. The efficiency and robustness of search process can be improved by detecting valleys and hills in search points and by adopting a small F for valley points and a large F for hill points because an optimal solution exists near valleys and far from hills in minimization problems. Valley points and hill points are detected by creating a proximity graph from search points and by selecting valley/hill points that are smaller/greater than neighbor points. The effect of the proposed method is shown by solving thirteen benchmark problems.

[1]  Yun Shang,et al.  A Note on the Extended Rosenbrock Function , 2006 .

[2]  R. Sokal,et al.  A New Statistical Approach to Geographic Variation Analysis , 1969 .

[3]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[4]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[5]  Tetsuyuki Takahama,et al.  Differential evolution with dynamic strategy and parameter selection by detecting landscape modality , 2012, 2012 IEEE Congress on Evolutionary Computation.

[6]  Tetsuyuki Takahama,et al.  Large scale optimization by differential evolution with landscape modality detection and a diversity archive , 2012, 2012 IEEE Congress on Evolutionary Computation.

[7]  Jason Teo,et al.  Exploring dynamic self-adaptive populations in differential evolution , 2006, Soft Comput..

[8]  Godfried T. Toussaint,et al.  The relative neighbourhood graph of a finite planar set , 1980, Pattern Recognit..

[9]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[10]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[11]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[12]  X. Yao,et al.  Fast evolutionary algorithms , 2003 .

[13]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[14]  D. Kirkpatrick,et al.  A Framework for Computational Morphology , 1985 .

[15]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[16]  Tetsuyuki Takahama,et al.  An adaptive differential evolution considering correlation of two algorithm parameters , 2014, 2014 Joint 7th International Conference on Soft Computing and Intelligent Systems (SCIS) and 15th International Symposium on Advanced Intelligent Systems (ISIS).

[17]  Tetsuyuki Takahama,et al.  Fuzzy c-means clustering and partition entropy for species-best strategy and search mode selection in nonlinear optimization by differential evolution , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[18]  Ponnuthurai N. Suganthan,et al.  An Adaptive Differential Evolution Algorithm With Novel Mutation and Crossover Strategies for Global Numerical Optimization , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[19]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[20]  Tetsuyuki Takahama,et al.  Improving an adaptive differential evolution using hill-valley detection , 2016, Int. J. Hybrid Intell. Syst..

[21]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .