On the Choice of the Parent Population Size

Evolutionary algorithms (EAs) are population-based randomized search heuristics that often solve problems successfully. Here the focus is on the possible effects of changing the parent population size in a simple, but still realistic, mutation-based EA. It preserves diversity by avoiding duplicates in its population. On the one hand its behavior on well-known pseudo-Boolean example functions is investigated by means of a rigorous runtime analysis. A comparison with the expected runtime of the algorithm's variant that does not avoid duplicates demonstrates the strengths and weaknesses of maintaining diversity. On the other hand, newly developed functions are presented for which the optimizer considered that even a decrease of the population size by a single increment leads from efficient optimization to enormous runtime and overwhelming probability. This is proven for all feasible population sizes and thereby this result forms a hierarchy theorem. In order to obtain all these results new methods for the analysis of the EA are developed.

[1]  Carsten Witt,et al.  Runtime Analysis of the ( μ +1) EA on Simple Pseudo-Boolean Functions , 2006 .

[2]  Tobias Storch,et al.  Finding large cliques in sparse semi-random graphs by simple randomized search heuristics , 2007, Theor. Comput. Sci..

[3]  Carsten Witt,et al.  Runtime Analysis of the ( + 1) EA on Simple Pseudo-Boolean Functions , 2006, Evolutionary Computation.

[4]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[5]  Jens Jägersküpper,et al.  When the Plus Strategy Outperforms the Comma Strategyand When Not , 2007, 2007 IEEE Symposium on Foundations of Computational Intelligence.

[6]  Thomas Jansen,et al.  Design and Management of Complex Technical Processes and Systems by means of Computational Intelligence Methods Evolutionary Algorithms-How to Cope With Plateaus of Constant Fitness and When to Reject Strings of the Same Fitness , 2001 .

[7]  Ingo Wegener,et al.  Methods for the Analysis of Evolutionary Algorithms on Pseudo-Boolean Functions , 2003 .

[8]  Donald E. Knuth,et al.  The Art of Computer Programming, Volume 4, Fascicle 2: Generating All Tuples and Permutations (Art of Computer Programming) , 2005 .

[9]  Tobias Storch,et al.  On the impact of objective function transformations on evolutionary and black-box algorithms , 2005, GECCO '05.

[10]  Günter Rudolph,et al.  How Mutation and Selection Solve Long-Path Problems in Polynomial Expected Time , 1996, Evolutionary Computation.

[11]  Kalyanmoy Deb,et al.  Long Path Problems , 1994, PPSN.

[12]  Ingo Wegener,et al.  On the utility of populations in evolutionary algorithms , 2001 .

[13]  Per Kristian Lehre,et al.  On the effect of populations in evolutionary multi-objective optimization , 2006, GECCO.

[14]  Jens Jägersküpper,et al.  Rigorous runtime analysis of a (μ+1)ES for the sphere function , 2005, GECCO '05.

[15]  Tobias Storch,et al.  On the Choice of the Population Size , 2004, GECCO.

[16]  C. Witt Population Size vs . Runtime of a Simple Evolutionary Algorithm , 2003 .

[17]  Kenneth A. De Jong,et al.  Design and Management of Complex Technical Processes and Systems by Means of Computational Intelligence Methods on the Choice of the Offspring Population Size in Evolutionary Algorithms on the Choice of the Offspring Population Size in Evolutionary Algorithms , 2004 .

[18]  Dirk Sudholt,et al.  On the analysis of the (1+1) memetic algorithm , 2006, GECCO.

[19]  Frank Neumann,et al.  Rigorous analyses of simple diversity mechanisms , 2007, GECCO '07.

[20]  Thomas Jansen,et al.  On the analysis of the (1+1) evolutionary algorithm , 2002, Theor. Comput. Sci..

[21]  Rajeev Motwani,et al.  Randomized Algorithms , 1995, SIGA.

[22]  Donald E. Knuth,et al.  Generating all tuples and permutations , 2005 .

[23]  Zbigniew Michalewicz,et al.  Handbook of Evolutionary Computation , 1997 .

[24]  Hans-Paul Schwefel,et al.  Evolution and Optimum Seeking: The Sixth Generation , 1993 .

[25]  C. Witt Population size vs. runtime of a simple EA , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..