How Well Does A Single-Point Crossover Mix Building Blocks with Tight Linkage?

Ensuring building-block (BB) mixing is critical to the success of genetic and evolutionary algorithms. This study develops facetwise models to predict the BB mixing time and the population sizing dictated by BB mixing for single-point crossover. Empirical results are used to validate these models. The population-sizing model suggests that for moderate-to-large problems, BB mixing—instead of BB decision making and BB supply—bounds the population size required to obtain a solution of constant quality. Furthermore, the population sizing for singlepoint crossover scales as O ( 2m ) , where k is the BB size and m is the number of BBs.

[1]  Heinz Mühlenbein,et al.  Predictive Models for the Breeder Genetic Algorithm I. Continuous Parameter Optimization , 1993, Evolutionary Computation.

[2]  D. E. Goldberg,et al.  Simple Genetic Algorithms and the Minimal, Deceptive Problem , 1987 .

[3]  F. B. Christiansen.  5. The Effect Of Population Subdivision On Multiple Loci Without Selection , 1989 .

[4]  Kalyanmoy Deb,et al.  Genetic Algorithms, Noise, and the Sizing of Populations , 1992, Complex Syst..

[5]  Lee Altenberg,et al.  The Schema Theorem and Price's Theorem , 1994, FOGA.

[6]  Kenneth A. De Jong,et al.  An Analysis of Multi-Point Crossover , 1990, FOGA.

[7]  David E. Goldberg,et al.  An Analysis of Reproduction and Crossover in a Binary-Coded Genetic Algorithm , 1987, ICGA.

[8]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[9]  Larry J. Eshelman,et al.  Productive Recombination and Propagating and Preserving Schemata , 1994, FOGA.

[10]  David E. Goldberg,et al.  The Race, the Hurdle, and the Sweet Spot , 1998 .

[11]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[12]  Kenneth A. De Jong,et al.  A formal analysis of the role of multi-point crossover in genetic algorithms , 1992, Annals of Mathematics and Artificial Intelligence.

[13]  Michael D. Vose,et al.  Modeling genetic algorithms with Markov chains , 1992, Annals of Mathematics and Artificial Intelligence.

[14]  D. Goldberg,et al.  A practical schema theorem for genetic algorithm design and tuning , 2001 .

[15]  Gunar E. Liepins,et al.  Punctuated Equilibria in Genetic Search , 1991, Complex Syst..

[16]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[17]  Soraya B. Rana.  The distributional biases of crossover operators , 1999 .

[18]  John Daniel. Bagley,et al.  The behavior of adaptive systems which employ genetic and correlation algorithms : technical report , 1967 .

[19]  David E. Goldberg,et al.  Finite Markov Chain Analysis of Genetic Algorithms , 1987, ICGA.

[20]  Gilbert Syswerda,et al.  Uniform Crossover in Genetic Algorithms , 1989, ICGA.

[21]  Prügel-Bennett,et al.  Analysis of genetic algorithms using statistical mechanics. , 1994, Physical review letters.

[22]  David E. Goldberg,et al.  The Design of Innovation: Lessons from and for Competent Genetic Algorithms , 2002 .

[23]  E. Cantu-Paz,et al.  The Gambler's Ruin Problem, Genetic Algorithms, and the Sizing of Populations , 1997, Evolutionary Computation.

[24]  Kenneth A. De Jong,et al.  An Analysis of the Interacting Roles of Population Size and Crossover in Genetic Algorithms , 1990, PPSN.

[25]  Adam Prügel-Bennett,et al.  The Mixing Rate of Different Crossover Operators , 2000, FOGA.

[26]  R. B. Robbins.  Some Applications of Mathematics to Breeding Problems III. , 1917, Genetics.

[27]  H. Geiringer.  On the Probability Theory of Linkage in Mendelian Heredity , 1944 .

[28]  R. B. Robbins.  Some Applications of Mathematics to Breeding Problems. , 1917, Genetics.

[29]  Daniel Raymond Frantz,et al.  Nonlinearities in genetic adaptive search. , 1972 .

[30]  Larry J. Eshelman,et al.  The CHC Adaptive Search Algorithm: How to Have Safe Search When Engaging in Nontraditional Genetic Recombination , 1990, FOGA.

[31]  Larry J. Eshelman,et al.  Biases in the Crossover Landscape , 1989, ICGA.

[32]  Dirk Thierens.  Dimensional Analysis of Allele-Wise Mixing Revisited , 1996, PPSN.

[33]  M. McPeek.  An Introduction to Recombination and Linkage Analysis , 1996 .

[34]  Dirk Thierens,et al.  Toward a Better Understanding of Mixing in Genetic Algorithms , 1993 .

[35]  D. E. Goldberg,et al.  An analysis of a reordering operator on a GA-hard problem , 1990, Biological Cybernetics.

[36]  M. Rattray.  Modelling the dynamics of genetic algorithms using statistical mechanics , 1996 .

[37]  David E. Goldberg,et al.  Genetic Algorithms and Walsh Functions: Part II, Deception and Its Analysis , 1989, Complex Syst..

[38]  N. Bailey.  Introduction to the mathematical theory of genetic linkage. , 1963 .

[39]  Kalyanmoy Deb,et al.  Analyzing Deception in Trap Functions , 1992, FOGA.

[40]  Kalyanmoy Deb,et al.  Messy Genetic Algorithms: Motivation, Analysis, and First Results , 1989, Complex Syst..

[41]  Christopher R. Stephens,et al.  Schemata Evolution and Building Blocks , 1999, Evolutionary Computation.

[42]  M. G. Bulmer,et al.  Introduction to the mathematical theory of genetic linkage , 1962 .

[43]  Cedric A. B. Smith,et al.  Introduction to Quantitative Genetics , 1960 .

[44]  Dirk Thierens,et al.  Mixing in Genetic Algorithms , 1993, ICGA.

[45]  Lashon B. Booker,et al.  Recombination Distributions for Genetic Algorithms , 1992, FOGA.

[46]  Dirk Thierens,et al.  Scalability Problems of Simple Genetic Algorithms , 1999, Evolutionary Computation.

[47]  Thomas Bäck,et al.  Selective Pressure in Evolutionary Algorithms: A Characterization of Selection Mechanisms , 1994, International Conference on Evolutionary Computation.

[48]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[49]  Yuval Rabani,et al.  A computational view of population genetics , 1995, STOC '95.

[50]  Kalyanmoy Deb,et al.  A Comparative Analysis of Selection Schemes Used in Genetic Algorithms , 1990, FOGA.

[51]  R. Elston.  The mathematical theory of quantitative genetics , 1982 .