Improved Runtime Results for Simple Randomised Search Heuristics on Linear Functions with a Uniform Constraint

In the last decade remarkable progress has been made in development of suitable proof techniques for analysing randomised search heuristics. The theoretical investigation of these algorithms on classes of functions is essential to the understanding of the underlying stochastic process. Linear functions have been traditionally studied in this area resulting in tight bounds on the expected optimisation time of simple randomised search algorithms for this class of problems. Recently, the constrained version of this problem has gained attention and some theoretical results have also been obtained on this class of problems. In this paper we study the class of linear functions under uniform constraint and investigate the expected optimisation time of Randomised Local Search (RLS) and a simple evolutionary algorithm called (1+1) EA. We prove a tight bound of Θ(n2) for RLS and improve the previously best known bound of (1+1) EA from O(n2 log(Bwmax)) to O(n2 log B) in expectation and to O(n2 log n) with high probability, where wmax and B are the maximum weight of the linear objective function and the bound of the uniform constraint, respectively.

[1]  Thomas Jansen,et al.  Analyzing Evolutionary Algorithms , 2015, Natural Computing Series.

[2]  B. Hajek Hitting-time and occupation-time bounds implied by drift analysis with applications , 1982, Advances in Applied Probability.

[3]  Anne Auger,et al.  Theory of Randomized Search Heuristics: Foundations and Recent Developments , 2011, Theory of Randomized Search Heuristics.

[4]  Benjamin Doerr,et al.  Multiplicative Drift Analysis , 2010, GECCO '10.

[5]  Martin Skutella,et al.  On the size of weights in randomized search heuristics , 2009, FOGA '09.

[6]  Thomas Jansen,et al.  Analyzing Evolutionary Algorithms: The Computer Science Perspective , 2012 .

[7]  Ingo Wegener,et al.  Randomized local search, evolutionary algorithms, and the minimum spanning tree problem , 2004, Theor. Comput. Sci..

[8]  Carsten Witt,et al.  Revised analysis of the (1+1) ea for the minimum spanning tree problem , 2014, GECCO.

[9]  Ingo Wegener,et al.  Methods for the Analysis of Evolutionary Algorithms on Pseudo-Boolean Functions , 2003 .

[10]  Per Kristian Lehre,et al.  Concentrated Hitting Times of Randomized Search Heuristics with Variable Drift , 2014, ISAAC.

[11]  Jonathan E. Rowe,et al.  Theoretical analysis of local search strategies to optimize network communication subject to preserving the total number of links , 2009, Int. J. Intell. Comput. Cybern..

[12]  Carsten Witt,et al.  Tight Bounds on the Optimization Time of a Randomized Search Heuristic on Linear Functions† , 2013, Combinatorics, Probability and Computing.

[13]  Jens Jägersküpper,et al.  Combining Markov-Chain Analysis and Drift Analysis , 2011, Algorithmica.

[14]  Mojgan Pourhassan,et al.  Improved Runtime Results for Simple Randomised Search Heuristics on Linear Functions with a Uniform Constraint , 2021, Algorithmica.

[15]  Frank Neumann,et al.  Analysis of the (1+1) EA on Subclasses of Linear Functions under Uniform and Linear Constraints , 2017, FOGA '17.

[16]  Jens Jägersküpper,et al.  A Blend of Markov-Chain and Drift Analysis , 2008, PPSN.

[17]  Dirk Sudholt,et al.  The choice of the offspring population size in the (1,λ) EA , 2012, GECCO '12.

[18]  Leslie Ann Goldberg,et al.  Adaptive Drift Analysis , 2010, PPSN.

[19]  Timo Kötzing,et al.  Analysis of the (1 + 1) EA on subclasses of linear functions under uniform and linear constraints , 2020, Theor. Comput. Sci..

[20]  Frank Neumann,et al.  Computing Minimum Cuts by Randomized Search Heuristics , 2008, GECCO '08.

[21]  Dirk Sudholt,et al.  When do evolutionary algorithms optimize separable functions in parallel? , 2013, FOGA XII '13.

[22]  Xin Yao,et al.  A study of drift analysis for estimating computation time of evolutionary algorithms , 2004, Natural Computing.

[23]  Benjamin Doerr,et al.  Run-time analysis of the (1+1) evolutionary algorithm optimizing linear functions over a finite alphabet , 2012, GECCO '12.

[24]  Daniel Johannsen,et al.  Random combinatorial structures and randomized search heuristics , 2010 .

[25]  Benjamin Doerr,et al.  Drift analysis and linear functions revisited , 2010, IEEE Congress on Evolutionary Computation.

[26]  Martin Skutella,et al.  Evolutionary Algorithms and Matroid Optimization Problems , 2007, GECCO '07.

[27]  Thomas Jansen,et al.  On the analysis of the (1+1) evolutionary algorithm , 2002, Theor. Comput. Sci..