The evolution of evolvability in genetic programming

The notion of ``evolvability''---the ability of a population to produce variants fitter than any yet existing---is developed as it applies to genetic algortithms. A theoretical analysis of the dynamics of genetic programming predicts the existence of a novel, emergent selection phenomenon: the evolution of evolvability. This is produced by the proliferation, within programs, of blocks of code that have a higher chance of increasing fitness when added to programs. Selection can then come to mold the variational aspects of the way evolved programs are represented. A model of code proliferation within programs is analyzed to illustrate this effect. The mathematical and conceptual framework includes: the definition of evolvability as a measure of performance for genetic algorithms; application of Price's Covariance and Selection Theorem to show how the fitness function, representation, and genetic operators must interact to produce evolvability---namely, that genetic operators produce offspring with fitnesses specifically correlated with their parent's fitnesses; how blocks of code emerge as a new level of replicator, proliferating as a function of their ``constructional fitness,'' which is distinct from their schema fitness; and how programs may change from innovative code to conservative code as the populations mature. Several new selection techniques and genetic operators are proposed in order to give better control over the evolution of evolvability and improved evolutionary performance.

[1]  R. Punnett,et al.  The Genetical Theory of Natural Selection , 1930, Nature.

[2]  M. Slatkin.  Selection and polygenic characters. , 1970, Proceedings of the National Academy of Sciences of the United States of America.

[3]  George R. Price,et al.  Selection and Covariance , 1970, Nature.

[4]  Wesley C. Salmon,et al.  Statistical explanation & statistical relevance , 1971 .

[5]  G. Price,et al.  Extension of covariance selection mathematics , 1972, Annals of human genetics.

[6]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[7]  M. Feldman,et al.  Evolution of continuous variation: direct approach through joint distribution of genotypes and phenotypes. , 1976, Proceedings of the National Academy of Sciences of the United States of America.

[8]  R. Lewontin.  ‘The Selfish Gene’ , 1977, Nature.

[9]  S Karlin,et al.  Models of multifactorial inheritance: I. Multivariate formulations and basic convergence results. , 1979, Theoretical population biology.

[10]  James H. Fetzer.  Statistical Explanation and Statistical Relevance , 1981 .

[11]  N. Cocchiarella,et al.  Situations and Attitudes. , 1986 .

[12]  John J. Grefenstette,et al.  Optimization of Control Parameters for Genetic Algorithms , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[13]  C. G. Shaefer,et al.  The ARGOT Strategy: Adaptive Representation Genetic Optimizer Technique , 1987, ICGA.

[14]  J. David Schaffer,et al.  An Adaptive Crossover Distribution Mechanism for Genetic Algorithms , 1987, ICGA.

[15]  M W Feldman,et al.  Selection, generalized transmission and the evolution of modifier genes. I. The reduction principle. , 1987, Genetics.

[16]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[17]  E.J. O'Neil,et al.  The ARGOT strategy III: the BBN Butterfly multiprocessor , 1988, Proceedings Supercomputing Vol.II: Science and Applications.

[18]  Rajarshi Das,et al.  A Study of Control Parameters Affecting Online Performance of Genetic Algorithms for Function Optimization , 1989, ICGA.

[19]  J. David Schaffer,et al.  Proceedings of the third international conference on Genetic algorithms , 1989 .

[20]  Lawrence Davis,et al.  Adapting Operator Probabilities in Genetic Algorithms , 1989, ICGA.

[21]  Jim Antonisse,et al.  A New Interpretation of Schema Notation that Overtums the Binary Encoding Constraint , 1989, ICGA.

[22]  In Schoenauer,et al.  Parallel Problem Solving from Nature , 1990, Lecture Notes in Computer Science.

[23]  William R. Charlesworth,et al.  The Role of Behavior in Evolution. , 1990 .

[24]  Heinz Mühlenbein,et al.  Evolution in Time and Space - The Parallel Genetic Algorithm , 1990, FOGA.

[25]  Kalyanmoy Deb,et al.  Messy Genetic Algorithms Revisited: Studies in Mixed Size and Scale , 1990, Complex Syst..

[26]  T. R. Smith,et al.  Genetic design of processing elements for path planning networks , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[27]  Reinhard Männer,et al.  Towards an Optimal Mutation Probability for Genetic Algorithms , 1990, PPSN.

[28]  Lashon B. Booker,et al.  Proceedings of the fourth international conference on Genetic algorithms , 1991 .

[29]  Thomas Bäck,et al.  A Survey of Evolution Strategies , 1991, ICGA.

[30]  Schloss Birlinghoven.  Evolution in Time and Space -the Parallel Genetic Algorithm , 1991 .

[31]  James R. Levenick.  Inserting Introns Improves Genetic Algorithm Success Rate: Taking a Cue from Biology , 1991, ICGA.

[32]  Thomas Bck,et al.  Self-adaptation in genetic algorithms , 1991 .

[33]  Bernard Manderick,et al.  The Genetic Algorithm and the Structure of the Fitness Landscape , 1991, ICGA.

[34]  John R. Koza.  Hierarchical Automatic Function Definition in Genetic Programming , 1992, FOGA.

[35]  E. Akin,et al.  Mathematical structures in population genetics , 1992 .

[36]  M. Feldman,et al.  Recombination dynamics and the fitness landscape , 1992 .

[37]  Melanie Mitchell,et al.  Relative Building-Block Fitness and the Building Block Hypothesis , 1992, FOGA.

[38]  Nicholas J. Radcliffe,et al.  Non-Linear Genetic Representations , 1992, PPSN.

[39]  Larry J. Eshelman,et al.  Foundations of Genetic Algorithms-2 , 1993 .

[40]  Simon Handley,et al.  The automatic generation of plans for a mobile robot via genetic programming with automatically defined functions , 1994 .

[41]  Walter Alden Tackett,et al.  Genetic Programming for Feature Discovery and Image Discrimination , 1993, ICGA.

[42]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[43]  J. Pollack,et al.  Coevolving High-Level Representations , 1993 .

[44]  Piero Mussio,et al.  Toward a Practice of Autonomous Systems , 1994 .

[45]  Astro Teller,et al.  The evolution of mental models , 1994 .

[46]  Howard Oakley,et al.  Two scientific applications of genetic programming: Stack filters and non-linear equation fitting to , 1994 .

[47]  Peter J. Angeline,et al.  Genetic programming and emergent intelligence , 1994 .

[48]  J. K. Kinnear,et al.  Alternatives in automatic function definition: a comparison of performance , 1994 .

[49]  Robert N. Brandon,et al.  Adaptation and Environment , 1995 .