How Comma Selection Helps with the Escape from Local Optima

We investigate (1,λ) ESs using isotropic mutations for optimization in ℝn by means of a theoretical runtime analysis. In particular, a constant offspring-population size λ will be of interest. We start off by considering an adaptation-less (1,2) ES minimizing a linear function. Subsequently, a piecewise linear function with a jump/cliff is considered, where a (1+λ) ES gets trapped, i.e., (at least) an exponential (in n) number of steps are necessary to escape the local-optimum region. The (1,2) ES, however, manages to overcome the cliff in an almost unnoticeable number of steps. Finally, we outline (because of the page limit) how the reasoning and the calculations can be extended to the scenario where a (1,λ) ES using Gaussian mutations minimizes Cliff, a bimodal, spherically symmetric function already considered in the literature, which is merely Sphere with a jump in the function value at a certain distance from the minimum. For λ a constant large enough, the (1,λ) ES manages to conquer the global-optimum region – in contrast to (1+λ) ESs which get trapped.

[1]  Jens Jägersküpper,et al.  Analysis of a Simple Evolutionary Algorithm for Minimization in Euclidean Spaces , 2003, ICALP.

[2]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[3]  Jens Jägersküpper,et al.  Rigorous runtime analysis of a (μ+1)ES for the sphere function , 2005, GECCO '05.

[4]  Jens Jägersküpper Probabilistic runtime analysis of (1 +loverg, lambda), ES using isotropic mutations. , 2006 .

[5]  Jens Jägersküpper On the complexity of overcoming gaps with isotropic mutations and elitist selection , 2005, Congress on Evolutionary Computation.

[6]  W. Hoeffding Probability Inequalities for sums of Bounded Random Variables , 1963 .

[7]  Robin Milner,et al.  On Observing Nondeterminism and Concurrency , 1980, ICALP.

[8]  Dirk V. Arnold,et al.  Noisy Optimization With Evolution Strategies , 2002, Genetic Algorithms and Evolutionary Computation.

[9]  H. Beyer,et al.  Noisy Local Optimization with Evolution Strategies , 2002 .

[10]  Kenneth A. De Jong,et al.  Design and Management of Complex Technical Processes and Systems by Means of Computational Intelligence Methods on the Choice of the Offspring Population Size in Evolutionary Algorithms on the Choice of the Offspring Population Size in Evolutionary Algorithms , 2004 .

[11]  Jens Jägersküpper,et al.  Probabilistic runtime analysis of (1 +, λ),ES using isotropic mutations , 2006, GECCO '06.

[12]  Hans-Paul Schwefel,et al.  Evolution and Optimum Seeking: The Sixth Generation , 1993 .

[13]  Julian F. Miller,et al.  Genetic and Evolutionary Computation — GECCO 2003 , 2003, Lecture Notes in Computer Science.