Lower Bounds for Non-Elitist Evolutionary Algorithms via Negative Multiplicative Drift

Abstract A decent number of lower bounds for non-elitist population-based evolutionary algorithms has been shown by now. Most of them are technically demanding due to the (hard to avoid) use of negative drift theorems—general results which translate an expected movement away from the target into a high hitting time. We propose a simple negative drift theorem for multiplicative drift scenarios and show that it can simplify existing analyses. We discuss in more detail Lehre's (2010) negative drift in populations method, one of the most general tools to prove lower bounds on the runtime of non-elitist mutation-based evolutionary algorithms for discrete search spaces. Together with other arguments, we obtain an alternative and simpler proof of this result, which also strengthens and simplifies this method. In particular, now only three of the five technical conditions of the previous result have to be verified. The lower bounds we obtain are explicit instead of only asymptotic. This allows us to compute concrete lower bounds for concrete algorithms, but also enables us to show that super-polynomial runtimes appear already when the reproduction rate is only a (1-ω(n-1/2)) factor below the threshold. For the special case of algorithms using standard bit mutation with a random mutation rate (called uniform mixing in the language of hyper-heuristics), we prove the result stated by Dang and Lehre (2016b) and extend it to mutation rates other than Θ(1/n), which includes the heavy-tailed mutation operator proposed by Doerr et al. (2017). We finally use our method and a novel domination argument to show an exponential lower bound for the runtime of the mutation-only simple genetic algorithm on OneMax for arbitrary population size.

[1]  Benjamin Doerr,et al.  Runtime Analysis of Evolutionary Algorithms via Symmetry Arguments , 2020, Inf. Process. Lett..

[2]  Markus Wagner,et al.  Evolutionary algorithms and submodular functions: benefits of heavy-tailed mutations , 2018, Natural Computing.

[3]  Thomas Bäck,et al.  Benchmarking a (μ +λ ) Genetic Algorithm with Configurable Crossover Probability , 2020, PPSN.

[4]  Benjamin Doerr,et al.  First Steps Towards a Runtime Analysis When Starting With a Good Solution , 2020, PPSN.

[5]  Benjamin Doerr,et al.  Runtime Analysis of a Heavy-Tailed (1+(λ, λ)) Genetic Algorithm on Jump Functions , 2020, PPSN.

[6]  Benjamin Doerr,et al.  Fixed-Target Runtime Analysis , 2020, Algorithmica.

[7]  Benjamin Doerr,et al.  Exponential Upper Bounds for the Runtime of Randomized Search Heuristics , 2020, PPSN.

[8]  Benjamin Doerr Does Comma Selection Help to Cope with Local Optima? , 2020, GECCO.

[9]  Andrew M. Sutton,et al.  Lower Bounds on the Runtime of Crossover-Based Algorithms via Decoupling and Family Graphs , 2019, Algorithmica.

[10]  Benjamin Doerr,et al.  The Runtime of the Compact Genetic Algorithm on Jump Functions , 2019, Algorithmica.

[11]  Benjamin Doerr,et al.  Multiplicative Up-Drift , 2019, Algorithmica.

[12]  Benjamin Doerr,et al.  Probabilistic Tools for the Analysis of Randomized Optimization Heuristics , 2018, Theory of Evolutionary Computation.

[13]  Johannes Lengler,et al.  Drift Analysis , 2017, Theory of Evolutionary Computation.

[14]  Thomas Bäck,et al.  Theory of Evolutionary Computation: Recent Developments in Discrete Optimization , 2020, Theory of Evolutionary Computation.

[15]  Benjamin Doerr,et al.  The efficiency threshold for the offspring population size of the (µ, λ) EA , 2019, GECCO.

[16]  Benjamin Doerr,et al.  Analyzing randomized search heuristics via stochastic domination , 2019, Theor. Comput. Sci..

[17]  Benjamin Doerr,et al.  The Efficiency Threshold for the Offspring Population Size of the ($\mu$, $\lambda$) EA , 2019, 1904.06981.

[18]  Markus Wagner,et al.  Heavy-Tailed Mutation Operators in Single-Objective Combinatorial Optimization , 2018, PPSN.

[19]  Chao Qian,et al.  Dynamic Mutation Based Pareto Optimization for Subset Selection , 2018, ICIC.

[20]  Markus Wagner,et al.  Escaping large deceptive basins of attraction with heavy-tailed mutation operators , 2018, GECCO.

[21]  Benjamin Doerr,et al.  A tight runtime analysis for the (μ + λ) EA , 2018, GECCO.

[22]  Carsten Witt,et al.  Upper Bounds on the Running Time of the Univariate Marginal Distribution Algorithm on OneMax , 2018, Algorithmica.

[23]  Angelika Steger,et al.  Drift Analysis and Evolutionary Algorithms Revisited , 2016, Combinatorics, Probability and Computing.

[24]  Maxim Buzdalov,et al.  Evaluation of heavy-tailed mutation operator on maximum flow test generation problem , 2017, GECCO.

[25]  Benjamin Doerr,et al.  Fast genetic algorithms , 2017, GECCO.

[26]  Duc-Cuong Dang,et al.  Self-adaptation of Mutation Rates in Non-elitist Populations , 2016, PPSN.

[27]  Duc-Cuong Dang,et al.  Level-Based Analysis of Genetic Algorithms and Other Search Processes , 2014, bioRxiv.

[28]  Duc-Cuong Dang,et al.  Runtime Analysis of Non-elitist Populations: From Classical Optimisation to Partial Information , 2016, Algorithmica.

[29]  Pietro Simone Oliveto,et al.  Improved time complexity analysis of the Simple Genetic Algorithm , 2015, Theor. Comput. Sci..

[30]  Timo Kötzing,et al.  Concentration of First Hitting Times Under Additive Drift , 2014, Algorithmica.

[31]  Pietro Simone Oliveto,et al.  On the runtime analysis of the Simple Genetic Algorithm , 2014, Theor. Comput. Sci..

[32]  Dirk Sudholt,et al.  The choice of the offspring population size in the (1, λ) evolutionary algorithm , 2014, Theor. Comput. Sci..

[33]  Carsten Witt,et al.  Tight Bounds on the Optimization Time of a Randomized Search Heuristic on Linear Functions† , 2013, Combinatorics, Probability and Computing.

[34]  Pietro Simone Oliveto,et al.  On the analysis of the simple genetic algorithm , 2012, GECCO '12.

[35]  Benjamin Doerr,et al.  Tight Analysis of the (1+1)-EA for the Single Source Shortest Path Problem , 2011, Evolutionary Computation.

[36]  Per Kristian Lehre,et al.  Fitness-levels for non-elitist populations , 2011, GECCO '11.

[37]  Leslie Ann Goldberg,et al.  Adaptive Drift Analysis , 2011, Algorithmica.

[38]  Per Kristian Lehre,et al.  Negative Drift in Populations , 2010, PPSN.

[39]  Benjamin Doerr,et al.  Multiplicative Drift Analysis , 2010, GECCO '10.

[40]  Pietro Simone Oliveto,et al.  Simplified Drift Analysis for Proving Lower Bounds in Evolutionary Computation , 2008, Algorithmica.

[41]  Daniel Johannsen,et al.  Random combinatorial structures and randomized search heuristics , 2010 .

[42]  Xin Yao,et al.  A New Approach for Analyzing Average Time Complexity of Population-Based Evolutionary Algorithms on Unimodal Problems , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[43]  Pietro Simone Oliveto,et al.  Theoretical analysis of fitness-proportional selection: landscapes and efficiency , 2009, GECCO.

[44]  Benjamin Doerr,et al.  Improved analysis methods for crossover-based algorithms , 2009, GECCO.

[45]  Jonathan E. Rowe,et al.  Theoretical analysis of local search strategies to optimize network communication subject to preserving the total number of links , 2009, Int. J. Intell. Comput. Cybern..

[46]  Jens Jägersküpper,et al.  A Blend of Markov-Chain and Drift Analysis , 2008, PPSN.

[47]  Frank Neumann,et al.  Rigorous analyses of fitness-proportional selection for optimizing linear functions , 2008, GECCO '08.

[48]  Jens Jägersküpper,et al.  When the Plus Strategy Outperforms the Comma Strategyand When Not , 2007, 2007 IEEE Symposium on Foundations of Computational Intelligence.

[49]  Carsten Witt,et al.  Runtime Analysis of the ( μ +1) EA on Simple Pseudo-Boolean Functions , 2006 .

[50]  Carsten Witt,et al.  Runtime Analysis of the ( + 1) EA on Simple Pseudo-Boolean Functions , 2006, Evolutionary Computation.

[51]  Thomas Jansen,et al.  On the analysis of the (1+1) evolutionary algorithm , 2002, Theor. Comput. Sci..

[52]  Xin Yao,et al.  Drift analysis and average time complexity of evolutionary algorithms , 2001, Artif. Intell..

[53]  I. Wegener,et al.  Design and Management of Complex Technical Processes and Systems by means of Computational Intelligence Methods A Natural and Simple Function Which is Hard For All Evolutionary Algorithms , 2007 .

[54]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[55]  B. Hajek Hitting-time and occupation-time bounds implied by drift analysis with applications , 1982, Advances in Applied Probability.