A new self-adaptation scheme for differential evolution

The performance of Differential Evolution (DE) largely depends on the choice of trial vector generation strategy and the values of its control parameters. In the past years, quite a few DE variants have been developed to adaptively adjust the strategy and control parameters during the search process. However, these variants may not perform satisfactorily when coping with computationally expensive problems (CEPs) for which a satisfying solution needs to be obtained with very limited fitness evaluations (FEs). In this paper, we demonstrate that not only can surrogate models be used to approximate the fitness function, they can also provide a good alternative method to adapt the strategy and control parameters of DE, and thus propose a framework called DE with Surrogate-assisted Self-Adaptation (DESSA). DESSA generates multiple trial vectors using different trial vector generation strategies and parameter settings, and then employs a surrogate model to identify the potentially best trial vector to undergo real fitness evaluation. As each trial vector corresponds to a unique combination of strategy and parameter setting, the surrogate model acts like a strategy/parameter setting selector that aims to identify the most suitable strategy and parameter setting for each target vector. Since DESSA can be easily combined with different DE variants, three concrete DE variants, namely DESSA-CoDE, DESSA-SaDE, and DESSA-CoDE*, are proposed. Comprehensive empirical studies demonstrate that DESSA can lead to superior performance over the compared adaptive DE variants. More importantly, it is shown that DESSA has the potential of accommodating more search strategies, which may lead to novel DE variants with even more competitive performance.

[1]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[2]  Jan K. Sykulski,et al.  Comparative study of evolution strategies combined with approximation techniques for practical electromagnetic optimization problems , 2001 .

[3]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[4]  Eduardo Krempser Differential Evolution Assisted by Surrogate Models for Structural Optimization Problems , 2012 .

[5]  Fei Peng,et al.  Population-Based Algorithm Portfolios for Numerical Optimization , 2010, IEEE Transactions on Evolutionary Computation.

[6]  A. Keane,et al.  Evolutionary Optimization of Computationally Expensive Problems via Surrogate Modeling , 2003 .

[7]  Michèle Sebag,et al.  Toward comparison-based adaptive operator selection , 2010, GECCO '10.

[8]  Kok Wai Wong,et al.  Surrogate-Assisted Evolutionary Optimization Frameworks for High-Fidelity Engineering Design Problems , 2005 .

[9]  Xin Yao,et al.  Classification-assisted Differential Evolution for computationally expensive problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[10]  Michèle Sebag,et al.  Comparison-Based Optimizers Need Comparison-Based Surrogates , 2010, PPSN.

[11]  Ke Tang,et al.  Classification- and Regression-Assisted Differential Evolution for Computationally Expensive Problems , 2012, Journal of Computer Science and Technology.

[12]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[13]  Arthur C. Sanderson,et al.  DE-AEC: A differential evolution algorithm based on adaptive evolution control , 2007, 2007 IEEE Congress on Evolutionary Computation.

[14]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[15]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[16]  Arthur C. Sanderson,et al.  Surrogate Model-Based Differential Evolution , 2009 .

[17]  Edmund K. Burke,et al.  Parallel Problem Solving from Nature - PPSN IX: 9th International Conference, Reykjavik, Iceland, September 9-13, 2006, Proceedings , 2006, PPSN.

[18]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2004 .

[19]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[20]  Huang Hou-kuan Self-adapting control parameters in differential evolution , 2012 .

[21]  Andries Petrus Engelbrecht,et al.  Self-adaptive Differential Evolution , 2005, CIS.

[22]  Yaochu Jin,et al.  Managing approximate models in evolutionary aerodynamic design optimization , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[23]  Thomas Philip Runarsson Ordinal Regression in Evolutionary Computation , 2006, PPSN.

[24]  Michèle Sebag,et al.  Comparison-Based Adaptive Strategy Selection with Bandits in Differential Evolution , 2010, PPSN.

[25]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[26]  Xin Yao,et al.  Scalability of generalized adaptive differential evolution for large-scale continuous optimization , 2010, Soft Comput..

[27]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[28]  Xin Yao,et al.  Self-adaptive differential evolution with neighborhood search , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[29]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[30]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[31]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[32]  Álvaro Fialho,et al.  Adaptive strategy selection in differential evolution , 2010, GECCO '10.

[33]  Xin Yao,et al.  Target shape design optimization by evolving splines , 2007, 2007 IEEE Congress on Evolutionary Computation.

[34]  Aravind Srinivasan,et al.  Innovization: Discovery of Innovative Design Principles Through Multiobjective Evolutionary Optimization , 2008, Multiobjective Problem Solving from Nature.

[35]  Jongsoo Lee,et al.  Genetic algorithms in multidisciplinary rotor blade design , 1995 .

[36]  Hitoshi Iba,et al.  Accelerating Differential Evolution Using an Adaptive Local Search , 2008, IEEE Transactions on Evolutionary Computation.

[37]  Minho Lee,et al.  Surrogate model assisted ensemble differential evolution algorithm , 2012, 2012 IEEE Congress on Evolutionary Computation.

[38]  Xiaodong Li,et al.  Solving Rotated Multi-objective Optimization Problems Using Differential Evolution , 2004, Australian Conference on Artificial Intelligence.

[39]  R. Storn,et al.  On the usage of differential evolution for function optimization , 1996, Proceedings of North American Fuzzy Information Processing.

[40]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.