The Role of Population Size in Rate of Evolution in Genetic Programming

Population size is a critical parameter that affects the performance of an Evolutionary Computation model. A variable population size scheme is considered potentially beneficial to improve the quality of solutions and to accelerate fitness progression. In this contribution, we discuss the relationship between population size and the rate of evolution in Genetic Programming. We distinguish between the rate of fitness progression and the rate of genetic substitutions , which capture two different aspects of a GP evolutionary process. We suggest a new indicator for population size adjustment during an evolutionary process by measuring the rate of genetic substitutions. This provides a separate feedback channel for evolutionary process control, derived from concepts of population genetics. We observe that such a strategy can stabilize the rate of genetic substitutions and effectively accelerate fitness progression. A test with the Mackey-Glass time series prediction verifies our observations.

[1]  R. A. Fisher,et al.  The Genetical Theory of Natural Selection , 1931 .

[2]  Richard Mark Downing,et al.  On Population Size and Neutrality: Facilitating the Evolution of Evolvability , 2007, EuroGP.

[3]  Cláudio F. Lima,et al.  A review of adaptive population sizing schemes in genetic algorithms , 2005, GECCO '05.

[4]  Ziheng Yang,et al.  Statistical methods for detecting molecular adaptation , 2000, Trends in Ecology & Evolution.

[5]  R. Punnett,et al.  The Genetical Theory of Natural Selection , 1930, Nature.

[6]  U. Aickelin,et al.  The Application of Bayesian Optimization and Classifier Systems in Nurse Scheduling , 2004, PPSN.

[7]  Zbigniew Michalewicz,et al.  GAVaPS-a genetic algorithm with varying population size , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[8]  Ting Hu,et al.  Nonsynonymous to Synonymous Substitution Ratio ka/ks: Measurement for Rate of Evolution in Evolutionary Computation , 2008, PPSN.

[9]  Thomas Bäck,et al.  An Empirical Study on GAs "Without Parameters" , 2000, PPSN.

[10]  Leonardo Vanneschi,et al.  A new technique for dynamic size populations in genetic programming , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[11]  Edmund K. Burke,et al.  Parallel Problem Solving from Nature - PPSN IX: 9th International Conference, Reykjavik, Iceland, September 9-13, 2006, Proceedings , 2006, PPSN.

[12]  Howard Oakley,et al.  Two scientific applications of genetic programming: Stack filters and non-linear equation fitting to , 1994 .

[13]  Terence Soule,et al.  Genetic Programming: Theory and Practice , 2003 .

[14]  J H Gillespie,et al.  The role of population size in molecular evolution. , 1999, Theoretical population biology.

[15]  T. Ohta.  Population size and rate of evolution , 1972, Journal of Molecular Evolution.

[16]  Simon M. Lucas,et al.  Parallel Problem Solving from Nature - PPSN X, 10th International Conference Dortmund, Germany, September 13-17, 2008, Proceedings , 2008, PPSN.

[17]  J. David Schaffer,et al.  Proceedings of the third international conference on Genetic algorithms , 1989 .

[18]  David C. Wedge,et al.  Rapid prediction of optimum population size in genetic programming using a novel genotype -: fitness correlation , 2008, GECCO '08.

[19]  Lindell Bromham,et al.  Population size and molecular evolution on islands , 2005, Proceedings of the Royal Society B: Biological Sciences.

[20]  Robert K. Moyzis,et al.  Recent acceleration of human adaptive evolution , 2007, Proceedings of the National Academy of Sciences.

[21]  Agostinho C. Rosa,et al.  Self-regulated Population Size in Evolutionary Algorithms , 2006, PPSN.

[22]  David E. Goldberg,et al.  Sizing Populations for Serial and Parallel Genetic Algorithms , 1989, ICGA.

[23]  J. K. Kinnear,et al.  Advances in Genetic Programming , 1994 .

[24]  Riccardo Poli,et al.  The impact of population size on code growth in GP: analysis and empirical validation , 2008, GECCO '08.

[25]  Kalyanmoy Deb,et al.  Genetic Algorithms, Noise, and the Sizing of Populations , 1992, Complex Syst..

[26]  Elena Marchiori,et al.  Evolutionary Algorithms with On-the-Fly Population Size Adjustment , 2004, PPSN.

[27]  David E. Goldberg,et al.  Population Sizing for Genetic Programming Based Upon Decision Making , 2005, ArXiv.

[28]  Fernando G. Lobo,et al.  A parameter-less genetic algorithm , 1999, GECCO.

[29]  Xin Yao,et al.  Parallel Problem Solving from Nature PPSN VI , 2000, Lecture Notes in Computer Science.

[30]  T. Ohta.  THE NEARLY NEUTRAL THEORY OF MOLECULAR EVOLUTION , 1992 .