Estimating the Ratios of the Stationary Distribution Values for Markov Chains Modeling Evolutionary Algorithms

The evolutionary algorithm stochastic process is well-known to be Markovian. These have been under investigation in much of the theoretical evolutionary computing research. When the mutation rate is positive, the Markov chain modeling of an evolutionary algorithm is irreducible and, therefore, has a unique stationary distribution. Rather little is known about the stationary distribution. In fact, the only quantitative facts established so far tell us that the stationary distributions of Markov chains modeling evolutionary algorithms concentrate on uniform populations (i.e., those populations consisting of a repeated copy of the same individual). At the same time, knowing the stationary distribution may provide some information about the expected time it takes for the algorithm to reach a certain solution, assessment of the biases due to recombination and selection, and is of importance in population genetics to assess what is called a genetic load (see the introduction for more details). In the recent joint works of the first author, some bounds have been established on the rates at which the stationary distribution concentrates on the uniform populations. The primary tool used in these papers is the quotient construction method. It turns out that the quotient construction method can be exploited to derive much more informative bounds on ratios of the stationary distribution values of various subsets of the state space. In fact, some of the bounds obtained in the current work are expressed in terms of the parameters involved in all the three main stages of an evolutionary algorithm: namely, selection, recombination, and mutation.

[1]  Lothar M. Schmitt,et al.  Theory of genetic algorithms , 2001, Theor. Comput. Sci..

[2]  Nicholas Freitag McPhee,et al.  The effects of crossover and mutation operators on variable length linear structures , 2001 .

[3]  D. Vere-Jones Markov Chains , 1972, Nature.

[4]  Jonathan E. Rowe,et al.  A Reduced Markov Model of GAs Without the Exact Transition Matrix , 2004, PPSN.

[5]  Alden H. Wright,et al.  Exploiting Quotients of Markov Chains to Derive Properties of the Stationary Distribution of the Markov Chain Associated to an Evolutionary Algorithm , 2006, SEAL.

[6]  P. Buchholz Exact and ordinary lumpability in finite Markov chains , 1994, Journal of Applied Probability.

[7]  Joe Suzuki,et al.  On the stationary distribution of GAs with fixed crossover probability , 2005, GECCO '05.

[8]  H. Geiringer On the Probability Theory of Linkage in Mendelian Heredity , 1944 .

[9]  David J. Aldous,et al.  Lower bounds for covering times for reversible Markov chains and random walks on graphs , 1989 .

[10]  Yang Zhao,et al.  Weighted Markov chains for forecasting and analysis in Incidence of infectious diseases in jiangsu Province, China , 2010, Journal of biomedical research.

[11]  Jim Antonisse,et al.  A New Interpretation of Schema Notation that Overtums the Binary Encoding Constraint , 1989, ICGA.

[12]  Riccardo Poli,et al.  A Schema Theory Analysis of the Evolution of Size in Genetic Programming with Linear Representations , 2001, EuroGP.

[13]  Jonathan E. Rowe,et al.  A Schema-Based Version of Geiringer's Theorem for Nonlinear Genetic Programming with Homologous Crossover , 2005, FOGA.

[14]  B. E. Ellison Limit theorems for random mating in infinite populations , 1966 .

[15]  Riccardo Poli,et al.  Using Schema Theory To Explore Interactions Of Multiple Operators , 2002, GECCO.

[16]  Yuval Rabani,et al.  A computational view of population genetics , 1995, STOC '95.

[17]  Jonathan E. Rowe,et al.  Some results about the Markov chains associated to GPs and general EAs , 2006, Theor. Comput. Sci..

[18]  P. WHITTLE,et al.  Markov Processes and Their Applications , 1962, Nature.

[19]  W. Stewart,et al.  Quasi Lumpability, Lower-Bounding Coupling Matrices, and Nearly Completely Decomposable Markov Chains , 1997 .

[20]  P L Pearson,et al.  Towards an understanding of the genetics of human male infertility: lessons from flies. , 2000, Trends in genetics : TIG.

[21]  Lothar M. Schmitt,et al.  Theory of Genetic Algorithms II: models for genetic operators over the string-tensor representation of populations and convergence to global optima for arbitrary fitness function under scaling , 2004, Theor. Comput. Sci..

[22]  J H Bennett,et al.  Panmixia with Tetrasomic and Hexasomic Inheritance. , 1954, Genetics.

[23]  Kenneth A. De Jong,et al.  Analyzing GAs Using Markov Models with Semantically Ordered and Lumped States , 1996, FOGA.

[24]  D. Cooke,et al.  Finite Markov Processes and Their Applications , 1981 .

[25]  Jonathan E. Rowe,et al.  An Extension of Geiringer's Theorem for a Wide Class of Evolutionary Search Algorithms , 2006, Evolutionary Computation.

[26]  Boris Mitavskiy Crossover Invariant Subsets of the Search Space for Evolutionary Algorithms , 2004, Evolutionary Computation.

[27]  Zhikang Li,et al.  Heavy genetic load associated with the subspecific differentiation of japonica rice (Oryza sativa ssp. japonica L.). , 2006, Journal of experimental botany.

[28]  Jonathan E. Rowe,et al.  Population aggregation based on fitness , 2004, Natural Computing.

[29]  Joe Suzuki,et al.  A Further Result on the Markov Chain Model of Genetic Algorithms and Its Application to a Simulated Annealing-like Strategy , 1998, FOGA.

[30]  J. B. S. Haldane,et al.  The cost of natural selection , 1957, Journal of Genetics.

[31]  Boris Mitavskiy Comparing Evolutionary Computation Techniques via Their Representation , 2003, GECCO.

[32]  Michael D. Vose,et al.  The simple genetic algorithm - foundations and theory , 1999, Complex adaptive systems.

[33]  Nicholas J. Radcliffe,et al.  The algebra of genetic algorithms , 1994, Annals of Mathematics and Artificial Intelligence.