Replicators, Majorization and Genetic Algorithms: New Models and Analytical tools

This paper establishes a strong connection between evolutionary algorithms and majorization theory, using replicator models as a bridge. The relationship between replicator selection systems and majorization theory suggests new selection operators, convergence results and theoretical gains such as the availability of convergence results from the well developed theory of inhomogeneous doubly stochastic Markov chains. We also give sufficient conditions under which multiplicative models of crossover implement the majorization pre-ordering, complementing the classical results due to Moran and Nishimura. Quantities such as relative entropy are known to increase during crossover; we provide bounds on the increase. Our techniques apply to a wide class of functions (Schur-convex), and generalize previous results on quadratic dynamical systems. We also present some new results on replicator systems; these include a new interpretation of the necessary and sufficient conditions under which a replicator systems is a gradient descent system, and an application of a variant of Kolmogorov’s representation theorem to yield a generalized fundamental theorem.

[1]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[2]  Thomas Bäck,et al.  An Overview of Evolutionary Algorithms for Parameter Optimization , 1993, Evolutionary Computation.

[3]  R. F. Streater,et al.  Convergence of the Iterated Boltzmann Map , 1984 .

[4]  Heinz Mühlenbein,et al.  Evolution algorithms in combinatorial optimization , 1988, Parallel Comput..

[5]  Chi Song Wong,et al.  Applications of M-matrices to majorization , 1992 .

[6]  G. E. Hutchinson,et al.  Homage to Santa Rosalia or Why Are There So Many Kinds of Animals? , 1959, The American Naturalist.

[7]  Jaime Ramos,et al.  Alternate Realities: Mathematical Models of Nature and Man , 1990 .

[8]  F. Gantmacher.  Lectures in Analytical Mechanics , 1975 .

[9]  Demetres D. Kouvatsos,et al.  Asymptotic Analysis of a Heterogeneous Multiprocessor System in a Randomly Changing Environment , 1991, IEEE Trans. Software Eng..

[10]  János Sztrik.  Modelling of a Multiprocessor System in a Randomly Changing Environment , 1993, Perform. Evaluation.

[11]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[12]  W J Ewens.  A generalized fundamental theorem of natural selection. , 1969, Genetics.

[13]  V. M. Maksimov.  Convergence of Non-Homogeneous Bistochastic Markov Chains , 1970 .

[14]  P. A. P. Moran,et al.  Entropy, Markov processes and Boltzmann's H-theorem , 1961, Mathematical Proceedings of the Cambridge Philosophical Society.

[15]  E. Akin,et al.  Dynamics of games and genes: Discrete versus continuous time , 1983 .

[16]  W J Ewens,et al.  An optimizing principle of natural selection in evolutionary population genetics. , 1992, Theoretical population biology.

[17]  Srinivas R. Chakravarthy,et al.  Matrix-Analytic Methods in Stochastic Models , 1996 .

[18]  Ken-ichi Funahashi,et al.  On the approximate realization of continuous mappings by neural networks , 1989, Neural Networks.

[19]  Nishimura Shōichi,et al.  Random collision processes and their limiting distribution using the discrimination information , 1974, Journal of Applied Probability.

[20]  James V. Bondar.  Inequalities: Theory of majorization and its applications: by Albert W. Marshall and Ingram Olkin , 1994 .

[21]  H. Geiringer.  On the Probability Theory of Linkage in Mendelian Heredity , 1944 .

[22]  Tze Leung Lai,et al.  Fixed Accuracy Estimation of an Autoregressive Parameter , 1983 .

[23]  Hans-Michael Voigt,et al.  Evolution and optimization : an introduction to solving complex problems by replicator networks , 1989 .

[24]  Francesco Palmieri,et al.  Theoretical analysis of evolutionary algorithms with an infinite population size in continuous space. Part I: Basic properties of selection and mutation , 1994, IEEE Trans. Neural Networks.

[25]  A. W. F. EDWARDS,et al.  Evolution and optimization , 1987, Nature.

[26]  Kishan G. Mehrotra,et al.  Optimization Using Replicators , 1995, ICGA.

[27]  Steffen L. Lauritzen,et al.  Independence properties of directed markov fields , 1990, Networks.

[28]  Alexander R. Bednarek,et al.  Analogies Between Analogies: The Mathematical Reports of S.M. Ulam and his Los Alamos Collaborators , 1990 .

[29]  Yuval Rabani,et al.  Simulating quadratic dynamical systems is PSPACE-complete (preliminary version) , 1994, STOC '94.

[30]  M. West,et al.  Dynamic Generalized Linear Models and Bayesian Forecasting , 1985 .

[31]  Dirk Thierens,et al.  Convergence Models of Genetic Algorithm Selection Schemes , 1994, PPSN.

[32]  W. A. Coppel,et al.  A survey of quadratic systems , 1966 .

[33]  Stephen Grossberg,et al.  Absolute stability of global pattern formation and parallel memory storage by competitive neural networks , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[34]  E. Akin.  Cycling in simple genetic systems , 1982 .

[35]  Clarence Zener,et al.  Geometric Programming : Theory and Application , 1967 .

[36]  丸山 徹.  Convex Analysisの二,三の進展について , 1977 .

[37]  R. Dawkins.  The Extended Phenotype , 1982 .

[38]  SchwefelHans-Paul,et al.  An overview of evolutionary algorithms for parameter optimization , 1993 .

[39]  Lee Altenberg,et al.  The Schema Theorem and Price's Theorem , 1994, FOGA.

[40]  Heinz Mühlenbein,et al.  Evolution and optimization '89 : selected papers on evolution theory, combinatorial optimization, and related topics , 1990 .

[41]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[42]  Avi Wigderson,et al.  Quadratic Dynamical Systems (Preliminary Version) , 1992, FOCS 1992.

[43]  Hans-Michael Voigt,et al.  Pattern Formation by Natural Selection with Applications to Decision Support , 1986 .

[44]  M. Peschel,et al.  The Predator-Prey Model: Do We Live in a Volterra World? , 1986 .

[45]  Bruce Hajek,et al.  Optimization by simulated annealing: a necessary and sufficient condition for convergence , 1986 .

[46]  Igor N. Kovalenko,et al.  Rare events in queueing systems—A survey , 1994, Queueing Syst. Theory Appl..

[47]  A S Perelson,et al.  Immune networks modeled by replicator equations , 1994, Journal of mathematical biology.

[48]  David J. Spiegelhalter,et al.  Local computations with probabilities on graphical structures and their application to expert systems , 1990 .

[49]  Avi Wigderson,et al.  Quadratic dynamical systems , 1992, Proceedings., 33rd Annual Symposium on Foundations of Computer Science.

[50]  Arunava Mukherjea,et al.  Limit Theorems: Stochastic Matrices, Ergodic Markov Chains, and Measures on Semigroups* , 1979 .

[51]  Michael I. Jordan.  Graphical Models , 1998 .

[52]  Josef Hofbauer,et al.  The theory of evolution and dynamical systems , 1988 .

[53]  Michael D. Vose,et al.  Modeling Simple Genetic Algorithms , 1995, Evolutionary Computation.

[54]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[55]  Richard D Jenks,et al.  Homogeneous multidimensional differential systems for mathematical models , 1968 .

[56]  I. Olkin,et al.  Inequalities: Theory of Majorization and Its Applications , 1980 .

[57]  Probability functions on complex pedigrees , 1978 .

[58]  E. Akin.  The Differential Geometry of Population Genetics and Evolutionary Games , 1990 .

[59]  William Fishburn Donkin.  On a class of differential equations, including those which occur in dynamical problems. - Part II , 1855, Philosophical Transactions of the Royal Society of London.

[60]  Erhard Kremer,et al.  Empirical kalman-Credibility , 1995 .

[61]  C. Carver,et al.  On the Self-Regulation of Behavior , 1998 .

[62]  William S. Jewell,et al.  Further Results on Recursive Evaluation of Compound Distributions , 1981, ASTIN Bulletin.