The linear hidden subset problem for the (1 + 1) EA with scheduled and adaptive mutation rates

Abstract We study unbiased ( 1 + 1 ) evolutionary algorithms on linear functions with an unknown number n of bits with non-zero weight. Static algorithms achieve an optimal runtime of O ( n ( ln ⁡ n ) 2 + e ) , however, it remained unclear whether more dynamic parameter policies could yield better runtime guarantees. We consider two setups: one where the mutation rate follows a fixed schedule, and one where it may be adapted depending on the history of the run. For the first setup, we give a schedule that achieves a runtime of ( 1 ± o ( 1 ) ) β n ln ⁡ n , where β ≈ 3.552 , which is an asymptotic improvement over the runtime of the static setup. Moreover, we show that no schedule admits a better runtime guarantee and that the optimal schedule is essentially unique. For the second setup, we show that the runtime can be further improved to ( 1 ± o ( 1 ) ) e n ln ⁡ n , which matches the performance of algorithms that know n in advance. Finally, we study the related model of initial segment uncertainty with static position-dependent mutation rates, and derive asymptotically optimal lower bounds. This answers a question by Doerr, Doerr, and Kotzing.

[1]  Per Kristian Lehre,et al.  Non-uniform mutation rates for problems with unknown solution lengths , 2011, FOGA '11.

[2]  Carsten Witt,et al.  Optimizing Linear Functions with Randomized Search Heuristics - The Robustness of Mutation , 2012, STACS.

[3]  Benjamin Doerr,et al.  Unknown solution length problems with no asymptotically optimal run time , 2017, GECCO.

[4]  Carsten Witt,et al.  Tight Bounds on the Optimization Time of a Randomized Search Heuristic on Linear Functions† , 2013, Combinatorics, Probability and Computing.

[5]  Tim Roughgarden,et al.  How bad is selfish routing? , 2002, JACM.

[6]  Carola Doerr,et al.  OneMax in Black-Box Models with Several Restrictions , 2015, Algorithmica.

[7]  Zbigniew Michalewicz,et al.  Parameter control in evolutionary algorithms , 1999, IEEE Trans. Evol. Comput..

[8]  Per Kristian Lehre,et al.  Runtime analysis of the (1 + 1) EA on computing unique input output sequences , 2014, Inf. Sci..

[9]  Alessandro Panconesi,et al.  Concentration of Measure for the Analysis of Randomized Algorithms , 2009 .

[10]  Christos H. Papadimitriou,et al.  Worst-case equilibria , 1999 .

[11]  Angelika Steger,et al.  The linear hidden subset problem for the (1 + 1) EA with scheduled and adaptive mutation rates , 2018, GECCO.

[12]  Benjamin Doerr,et al.  Bounding bloat in genetic programming , 2017, GECCO.

[13]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[14]  Mark Hoogendoorn,et al.  Parameter Control in Evolutionary Algorithms: Trends and Challenges , 2015, IEEE Transactions on Evolutionary Computation.