Surrogate model assisted ensemble differential evolution algorithm

Differential Evolution (DE) is a simple and effective approach for solving numerical optimization problems. However, the performance of DE is sensitive to the choice of the mutation and crossover strategies and their associated control parameters. Therefore, to obtain optimal performance, time consuming parameter tuning is necessary. In DE, different mutation and crossover strategies with different parameter settings can be appropriate during different stages of the evolution. Therefore, to obtain optimal performance using DE, various adaptation and self-adaptation techniques have been proposed. Recently, a DE algorithm with an ensemble of parameters and strategies (EPSDE) was proposed. In EPSDE, a pool of distinct mutation and crossover strategies along with a pool of values for each control parameter coexists throughout the evolution process and competes to produce offspring. The performance of EPSDE degrades if the population members get struck with a combination of strategies and parameters values that produce successful offspring but lead to premature convergence in the due course of the evolution. In this paper, we try to improve the performance of the EPSDE algorithm with the help of a surrogate model that assists in generating competitive trial vectors corresponding to each parent in every generation of the evolution. The proposed algorithm is referred to as surrogate model assisted EPSDE (SMA-EPSDE) and employs a simple Kriging model to construct the surrogate. The performance of EPSDE is evaluated on a set of 17 bound-constrained problems and is compared with state-of-the-art algorithms.

[1]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[2]  Daniela Zaharie,et al.  Influence of crossover on the behavior of Differential Evolution Algorithms , 2009, Appl. Soft Comput..

[3]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[4]  Wilfrido Gómez-Flores,et al.  On the selection of surrogate models in evolutionary optimization algorithms , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[5]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[6]  Kenneth V. Price,et al.  An introduction to differential evolution , 1999 .

[7]  Yaochu Jin,et al.  A comprehensive survey of fitness approximation in evolutionary computation , 2005, Soft Comput..

[8]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[9]  Bu-Sung Lee,et al.  Memetic algorithm using multi-surrogates for computationally expensive optimization problems , 2007, Soft Comput..

[10]  Carlos A. Coello Coello,et al.  Modified Differential Evolution for Constrained Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[11]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[12]  Jason Teo,et al.  Exploring dynamic self-adaptive populations in differential evolution , 2006, Soft Comput..

[13]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[14]  Ponnuthurai N. Suganthan,et al.  Differential Evolution Algorithm with Ensemble of Parameters and Mutation and Crossover Strategies , 2010, SEMCCO.

[15]  Shiu Yin Yuen,et al.  An Evolutionary Algorithm That Makes Decision Based on the Entire Previous Search History , 2011, IEEE Transactions on Evolutionary Computation.

[16]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[17]  Amit Konar,et al.  Two improved differential evolution schemes for faster global search , 2005, GECCO '05.

[18]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[19]  Amit Konar,et al.  Differential Evolution with Local Neighborhood , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[20]  H. Abbass The self-adaptive Pareto differential evolution algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[21]  Xin Yao,et al.  Self-adaptive differential evolution with neighborhood search , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[22]  Josef Tvrdík Adaptation in differential evolution: A numerical comparison , 2009, Appl. Soft Comput..

[23]  Saku Kukkonen,et al.  Real-parameter optimization with differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[24]  Dana Petcu,et al.  Adaptive Pareto Differential Evolution and Its Parallelization , 2003, PPAM.

[25]  Arthur C. Sanderson,et al.  DE-AEC: A differential evolution algorithm based on adaptive evolution control , 2007, 2007 IEEE Congress on Evolutionary Computation.

[26]  Xiaodong Li,et al.  Solving Rotated Multi-objective Optimization Problems Using Differential Evolution , 2004, Australian Conference on Artificial Intelligence.

[27]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[28]  Ponnuthurai Nagaratnam Suganthan,et al.  Fiber Bragg grating sensor array interrogation using differential evolution , 2008 .

[29]  Ponnuthurai N. Suganthan,et al.  Self-adaptive differential evolution with multi-trajectory search for large-scale optimization , 2011, Soft Comput..

[30]  Ivan Zelinka,et al.  ON STAGNATION OF THE DIFFERENTIAL EVOLUTION ALGORITHM , 2000 .

[31]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.