Toward a Steady-State Analysis of an Evolution Strategy on a Robust Optimization Problem With Noise-Induced Multimodality

A steady state analysis of the optimization quality of a classical self-adaptive evolution strategy (ES) on a class of robust optimization problems is presented. A novel technique for calculating progress rates for nonquadratic noisy fitness landscapes is presented. This technique yields asymptotically exact results in the infinite population size limit. This technique is applied to a class of functions with noise-induced multimodality. The resulting progress rate formulas are compared with high-precision experiments. The influence of fitness resampling is considered and the steady state behavior of the ES is derived and compared with simulations. The questions whether one should sample and average fitness values and how to choose the truncation ratio are discussed giving rise to further research perspectives.

[1]  Bernhard Sendhoff,et al.  Evolution Strategies for Robust Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[2]  Nikolaus Hansen,et al.  Adapting arbitrary normal mutation distributions in evolution strategies: the covariance matrix adaptation , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[3]  Shigeyoshi Tsutsui,et al.  Genetic algorithms with a robust solution searching scheme , 1997, IEEE Trans. Evol. Comput..

[4]  Jürgen Branke,et al.  Efficient search for robust solutions by means of evolutionary algorithms and fitness approximation , 2006, IEEE Transactions on Evolutionary Computation.

[5]  Silja Meyer-Nieberg,et al.  Self-adaptation in evolution strategies , 2008 .

[6]  Jürgen Branke,et al.  Creating Robust Solutions by Means of Evolutionary Algorithms , 1998, PPSN.

[7]  Bernhard Sendhoff,et al.  Evolutionary Algorithms in the Presence of Noise: To Sample or Not to Sample , 2007, 2007 IEEE Symposium on Foundations of Computational Intelligence.

[8]  Shigeyoshi Tsutsui,et al.  A Robust Solution Searching Scheme in Genetic Search , 1996, PPSN.

[9]  Tae Hee Lee,et al.  Robust Design: An Overview , 2006 .

[10]  Bernhard Sendhoff,et al.  Functions with noise-induced multimodality: a test for evolutionary robust Optimization-properties and performance analysis , 2006, IEEE Transactions on Evolutionary Computation.

[11]  Bernhard Sendhoff,et al.  On the Behavior of (μ/μ1, λ)-ES Optimizing Functions Disturbed by Generalized Noise , 2002, FOGA.

[12]  Bernhard Sendhoff,et al.  Robust Optimization - A Comprehensive Survey , 2007 .

[13]  Bernhard Sendhoff,et al.  The Influence of stochastic Quality Functions on Evolutionary Search , 2002, SEAL.

[14]  Hans-Georg Beyer,et al.  The Dynamical Systems Approach - Progress Measures and Convergence Properties , 2012, Handbook of Natural Computing.