The ($$1+\lambda $$1+λ) Evolutionary Algorithm with Self-Adjusting Mutation Rate

We propose a new way to self-adjust the mutation rate in population-based evolutionary algorithms in discrete search spaces. Roughly speaking, it consists of creating half the offspring with a mutation rate that is twice the current mutation rate and the other half with half the current rate. The mutation rate is then updated to the rate used in that subpopulation which contains the best offspring. We analyze how the $$(1+\lambda )$$(1+λ) evolutionary algorithm with this self-adjusting mutation rate optimizes the OneMax test function. We prove that this dynamic version of the $$(1+\lambda )$$(1+λ) EA finds the optimum in an expected optimization time (number of fitness evaluations) of $$O(n\lambda /\log \lambda +n\log n)$$O(nλ/logλ+nlogn). This time is asymptotically smaller than the optimization time of the classic $$(1+\lambda )$$(1+λ) EA. Previous work shows that this performance is best-possible among all $$\lambda $$λ-parallel mutation-based unbiased black-box algorithms. This result shows that the new way of adjusting the mutation rate can find optimal dynamic parameter values on the fly. Since our adjustment mechanism is simpler than the ones previously used for adjusting the mutation rate and does not have parameters itself, we are optimistic that it will find other applications.

[1]  Per Kristian Lehre,et al.  Unbiased Black-Box Complexity of Parallel Search , 2014, PPSN.

[2]  Per Kristian Lehre,et al.  Theoretical analysis of rank-based mutation - combining exploration and exploitation , 2009, 2009 IEEE Congress on Evolutionary Computation.

[3]  Carsten Witt,et al.  (1+1) EA on Generalized Dynamic OneMax , 2015, FOGA.

[4]  Duc-Cuong Dang,et al.  Self-adaptation of Mutation Rates in Non-elitist Populations , 2016, PPSN.

[5]  Benjamin Doerr,et al.  An Elementary Analysis of the Probability That a Binomial Random Variable Exceeds Its Expectation , 2017, Statistics & Probability Letters.

[6]  Anne Auger,et al.  Theory of Randomized Search Heuristics , 2012, Algorithmica.

[7]  Benjamin Doerr,et al.  The (1+λ) evolutionary algorithm with self-adjusting mutation rate , 2017, GECCO.

[8]  Benjamin Doerr,et al.  Optimal Parameter Settings for the (1 + λ, λ) Genetic Algorithm , 2016, GECCO.

[9]  Thomas Jansen,et al.  Analyzing Evolutionary Algorithms: The Computer Science Perspective , 2012 .

[10]  Ingo Wegener,et al.  Randomized local search, evolutionary algorithms, and the minimum spanning tree problem , 2004, Theor. Comput. Sci..

[11]  Benjamin Doerr,et al.  Runtime Analysis for Self-adaptive Mutation Rates , 2018, Algorithmica.

[12]  Pietro Simone Oliveto,et al.  On the runtime analysis of selection hyper-heuristics with adaptive learning periods , 2018, GECCO.

[13]  Dirk Sudholt,et al.  A New Method for Lower Bounds on the Running Time of Evolutionary Algorithms , 2011, IEEE Transactions on Evolutionary Computation.

[14]  Per Kristian Lehre,et al.  Runtime analysis of selection hyper-heuristics with classical learning mechanisms , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[15]  Hsien-Kuei Hwang,et al.  Probabilistic Analysis of the (1+1)-Evolutionary Algorithm , 2014, Evolutionary Computation.

[16]  Benjamin Doerr,et al.  Analyzing Randomized Search Heuristics: Tools from Probability Theory , 2011, Theory of Randomized Search Heuristics.

[17]  Marc Schoenauer,et al.  Rigorous Hitting Times for Binary Mutations , 1999, Evolutionary Computation.

[18]  Thomas Jansen,et al.  On the analysis of the (1+1) evolutionary algorithm , 2002, Theor. Comput. Sci..

[19]  Benjamin Doerr,et al.  The Right Mutation Strength for Multi-Valued Decision Variables , 2016, GECCO.

[20]  H. Robbins A Remark on Stirling’s Formula , 1955 .

[21]  Benjamin Doerr,et al.  Provably Optimal Self-adjusting Step Sizes for Multi-valued Decision Variables , 2016, PPSN.

[22]  Ingo Wegener,et al.  Simulated Annealing Beats Metropolis in Combinatorial Optimization , 2005, ICALP.

[23]  Mahmoud Fouz,et al.  Sharp bounds by probability-generating functions and variable drift , 2011, GECCO '11.

[24]  R. Kaas,et al.  Mean, Median and Mode in Binomial Distributions , 1980 .

[25]  Pietro Simone Oliveto,et al.  On the runtime analysis of generalised selection hyper-heuristics for pseudo-boolean optimisation , 2017, GECCO.

[26]  Carsten Witt,et al.  The Interplay of Population Size and Mutation Probability in the ($$1+\lambda $$1+λ) EA on OneMax , 2016, Algorithmica.

[27]  Mahmoud Fouz,et al.  Quasirandom evolutionary algorithms , 2010, GECCO '10.

[28]  Thomas Jansen,et al.  On the analysis of a dynamic evolutionary algorithm , 2006, J. Discrete Algorithms.

[29]  Frank Neumann,et al.  Bioinspired computation in combinatorial optimization: algorithms and their computational complexity , 2012, GECCO '12.

[30]  Zhi-Hua Zhou,et al.  Selection Hyper-heuristics Can Provably Be Helpful in Evolutionary Multi-objective Optimization , 2016, PPSN.

[31]  Per Kristian Lehre,et al.  Non-uniform mutation rates for problems with unknown solution lengths , 2011, FOGA '11.

[32]  Benjamin Doerr,et al.  From black-box complexity to designing new genetic algorithms , 2015, Theor. Comput. Sci..

[33]  Kenneth A. De Jong,et al.  Design and Management of Complex Technical Processes and Systems by Means of Computational Intelligence Methods on the Choice of the Offspring Population Size in Evolutionary Algorithms on the Choice of the Offspring Population Size in Evolutionary Algorithms , 2004 .

[34]  Marvin Künnemann,et al.  Optimizing linear functions with the (1+λ) evolutionary algorithm - Different asymptotic runtimes for different instances , 2015, Theor. Comput. Sci..

[35]  Frank Neumann,et al.  Optimal Fixed and Adaptive Mutation Rates for the LeadingOnes Problem , 2010, PPSN.

[36]  Daniel Johannsen,et al.  Random combinatorial structures and randomized search heuristics , 2010 .

[37]  Carsten Witt,et al.  The Interplay of Population Size and Mutation Probability in the (1+λ) EA on OneMax , 2017, Algorithmica.

[38]  Benjamin Doerr,et al.  Optimal Parameter Choices Through Self-Adjustment: Applying the 1/5-th Rule in Discrete Settings , 2015, GECCO.

[39]  Anne Auger,et al.  Theory of Randomized Search Heuristics: Foundations and Recent Developments , 2011, Theory of Randomized Search Heuristics.

[40]  Christine Zarges,et al.  On the utility of the population size for inversely fitness proportional mutation rates , 2009, FOGA '09.

[41]  Christopher R. Stephens,et al.  Rank based variation operators for genetic algorithms , 2008, GECCO '08.

[42]  Martin Dietzfelbinger,et al.  Tight Bounds for Blind Search on the Integers and the Reals , 2010, Comb. Probab. Comput..

[43]  Benjamin Doerr,et al.  Unknown solution length problems with no asymptotically optimal run time , 2017, GECCO.

[44]  Per Kristian Lehre,et al.  Concentrated Hitting Times of Randomized Search Heuristics with Variable Drift , 2014, ISAAC.

[45]  Jonathan E. Rowe,et al.  Theoretical analysis of local search strategies to optimize network communication subject to preserving the total number of links , 2009, Int. J. Intell. Comput. Cybern..

[46]  Benjamin Doerr,et al.  Optimal Parameter Choices via Precise Black-Box Analysis , 2016, GECCO.

[47]  Benjamin Doerr,et al.  A tight runtime analysis for the (μ + λ) EA , 2018, GECCO.

[48]  Benjamin Doerr,et al.  Fast genetic algorithms , 2017, GECCO.

[49]  Ingo Wegener,et al.  Evolutionary Algorithms and the Maximum Matching Problem , 2003, STACS.

[50]  Benjamin Doerr,et al.  Multiplicative drift analysis , 2010, GECCO.

[51]  Benjamin Doerr,et al.  k-Bit Mutation with Self-Adjusting k Outperforms Standard Bit Mutation , 2016, PPSN.

[52]  Thomas Jansen,et al.  Analyzing Evolutionary Algorithms , 2015, Natural Computing Series.

[53]  Per Kristian Lehre,et al.  A runtime analysis of simple hyper-heuristics: to mix or not to mix operators , 2013, FOGA XII '13.

[54]  Christine Zarges,et al.  Rigorous Runtime Analysis of Inversely Fitness Proportional Mutation Rates , 2008, PPSN.

[55]  Dirk Sudholt,et al.  Adaptive population models for offspring populations and parallel evolutionary algorithms , 2011, FOGA '11.

[56]  Heinz Mühlenbein,et al.  How Genetic Algorithms Really Work: Mutation and Hillclimbing , 1992, PPSN.

[57]  Benjamin Doerr,et al.  Runtime analysis of the (1 + (λ, λ)) genetic algorithm on random satisfiable 3-CNF formulas , 2017, GECCO.

[58]  Zbigniew Michalewicz,et al.  Parameter Control in Evolutionary Algorithms , 2007, Parameter Setting in Evolutionary Algorithms.