Runtime Analysis of Restricted Tournament Selection for Bimodal Optimisation

Niching methods have been developed to maintain the population diversity, to investigate many peaks in parallel, and to reduce the effect of genetic drift. We present the first rigorous runtime analyses of restricted tournament selection (RTS), embedded in a (μ+1) EA, and analyse its effectiveness at finding both optima of the bimodal function TwoMax. In RTS, an offspring competes against the closest individual, with respect to some distance measure, amongst w (window size) population members (chosen uniformly at random with replacement), to encourage competition within the same niche. We prove that RTS finds both optima on TwoMax efficiently if the window size w is large enough. However, if w is too small, RTS fails to find both optima even in exponential time, with high probability. We further consider a variant of RTS selecting individuals for the tournament without replacement. It yields a more diverse tournament and is more effective at preventing one niche from taking over the other. However, this comes at the expense of a slower progress towards optima when a niche collapses to a single individual. Our theoretical results are accompanied by experimental studies that shed light on parameters not covered by the theoretical results and support a conjectured lower runtime bound.

[1]  Dirk Sudholt,et al.  On the benefits and risks of using fitness sharing for multimodal optimisation , 2019, Theor. Comput. Sci..

[2]  Benjamin Doerr,et al.  Probabilistic Tools for the Analysis of Randomized Optimization Heuristics , 2018, Theory of Evolutionary Computation.

[3]  Dirk Sudholt,et al.  Empirical Analysis of Diversity-Preserving Mechanisms on Example Landscapes for Multimodal Optimisation , 2018, PPSN.

[4]  V. Climenhaga Markov chains and mixing times , 2013 .

[5]  Dirk Sudholt,et al.  Runtime Analysis of Crowding Mechanisms for Multimodal Optimization , 2020, IEEE Transactions on Evolutionary Computation.

[6]  Ole J. Mengshoel,et al.  Generalized crowding for genetic algorithms , 2010, GECCO '10.

[7]  Bruno Sareni,et al.  Fitness sharing and niching methods revisited , 1998, IEEE Trans. Evol. Comput..

[8]  Leslie Ann Goldberg,et al.  Drift Analysis with Tail Bounds , 2010, PPSN.

[9]  Marjan Mernik,et al.  Exploration and exploitation in evolutionary algorithms: A survey , 2013, CSUR.

[10]  Leslie Ann Goldberg,et al.  Adaptive Drift Analysis , 2011, Algorithmica.

[11]  Kalyanmoy Deb,et al.  Comparison of multi-modal optimization algorithms based on evolutionary algorithms , 2006, GECCO.

[12]  N. N. Glibovets,et al.  A Review of Niching Genetic Algorithms for Multimodal Function Optimization , 2013 .

[13]  Dirk Sudholt,et al.  A tight lower bound on the expected runtime of standard steady state genetic algorithms , 2020, GECCO.

[14]  Stelios Tsafarakis,et al.  Redesigning product lines in a period of economic crisis: a hybrid simulated annealing algorithm with crossover , 2016, Ann. Oper. Res..

[15]  Dirk Sudholt,et al.  Runtime analysis of probabilistic crowding and restricted tournament selection for bimodal optimisation , 2018, GECCO.

[16]  Giovanni Squillero,et al.  Divergence of character and premature convergence: A survey of methodologies for promoting diversity in evolutionary optimization , 2016, Inf. Sci..

[17]  David E. Goldberg,et al.  Probabilistic Crowding: Deterministic Crowding with Probabilistic Replacement , 1999 .

[18]  Andrew M. Sutton,et al.  Lower Bounds on the Runtime of Crossover-Based Algorithms via Decoupling and Family Graphs , 2019, Algorithmica.

[19]  Dirk Sudholt,et al.  On the Runtime Analysis of the Clearing Diversity-Preserving Mechanism , 2018, Evolutionary Computation.

[20]  Dirk Sudholt,et al.  The Benefits of Population Diversity in Evolutionary Algorithms: A Survey of Rigorous Runtime Analyses , 2018, Theory of Evolutionary Computation.

[21]  Henri Pierreval,et al.  A novel hybrid evolutionary approach for capturing decision maker knowledge into the unequal area facility layout problem , 2015, Expert Syst. Appl..

[22]  Georges R. Harik,et al.  Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[23]  Ofer M. Shir,et al.  Niching in Evolutionary Algorithms , 2012, Handbook of Natural Computing.

[24]  Ponnuthurai N. Suganthan,et al.  Novel multimodal problems and differential evolution with ensemble of restricted tournament selection , 2010, IEEE Congress on Evolutionary Computation.

[25]  Carlos García-Martínez,et al.  A simulated annealing method based on a specialised evolutionary algorithm , 2012, Appl. Soft Comput..

[26]  Pietro Simone Oliveto,et al.  Analysis of Diversity-Preserving Mechanisms for Global Exploration , 2009, Evolutionary Computation.