A robust optimization approach using Kriging metamodels for robustness approximation in the CMA-ES

This paper presents a study for using Kriging metamodeling in combination with Covariance Matrix Adaptation Evolution Strategies (CMA-ES) to find robust solutions. A general, archive based, framework is proposed for integrating Kriging within CMA-ES, including a method to utilize the covariance matrix of the CMA-ES in a straightforward way to improve the accuracy of the Kriging predictions without introducing much additional computational cost. Moreover, it adopts an elegant way to select appropriate archive points for building a local metamodel. The study shows that this Kriging metamodeling scheme for finding robust solutions outperforms common, straightforward approaches and is very useful when there is a limited budget of function evaluations. Though using the covariance matrix can improve the prediction quality, it has no significant effect on the overall quality of the optimization results.

[1]  Thomas J. Santner,et al.  Design and analysis of computer experiments , 1998 .

[2]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[3]  Bernhard Sendhoff,et al.  Evolution Strategies for Robust Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[4]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[5]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[6]  Petros Koumoutsakos,et al.  Accelerating evolutionary algorithms with Gaussian process fitness function models , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[7]  Petros Koumoutsakos,et al.  Local Meta-models for Optimization Using Evolution Strategies , 2006, PPSN.

[8]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[9]  Shigeyoshi Tsutsui,et al.  A comparative study on the effects of adding perturbations to phenotypic parameters in genetic algorithms with a robust solution searching scheme , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[10]  J. Branke.  Reducing the sampling variance when searching for robust solutions , 2001 .

[11]  S. Tsutsui,et al.  Effects of adding perturbations to phenotypic parameters in genetic algorithms for searching robust solutions , 2003 .

[12]  Kai-Yew Lum,et al.  Max-min surrogate-assisted evolutionary algorithm for robust design , 2006, IEEE Transactions on Evolutionary Computation.

[13]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[14]  Bernhard Sendhoff,et al.  Robust Optimization - A Comprehensive Survey , 2007 .

[15]  Thomas Bäck,et al.  Robust design of multilayer optical coatings by means of evolutionary algorithms , 1998, IEEE Trans. Evol. Comput..

[16]  Shigeyoshi Tsutsui,et al.  Genetic algorithms with a robust solution searching scheme , 1997, IEEE Trans. Evol. Comput..

[17]  Jürgen Branke,et al.  Creating Robust Solutions by Means of Evolutionary Algorithms , 1998, PPSN.

[18]  P. Mahalanobis.  On the generalized distance in statistics , 1936 .

[19]  Jürgen Branke,et al.  Efficient search for robust solutions by means of evolutionary algorithms and fitness approximation , 2006, IEEE Transactions on Evolutionary Computation.