Fitness Landscapes and Evolvability

In this paper, we develop techniques based on evolvability statistics of the fitness land-scape surrounding sampled solutions. Averaging the measures over a sample of equal fitness solutions allows us to build up fitness evolvability portraits of the fitness land-scape, which we show can be used to compare both the ruggedness and neutrality in a set of tunably rugged and tunably neutral landscapes. We further show that the tech-niques can be used with solution samples collected through both random sampling of the landscapes and online sampling during optimization. Finally, we apply the techniques to two real evolutionary electronics search spaces and highlight differences between the two search spaces, comparing with the time taken to find good solutions through search.

[1]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[2]  S. Gould,et al.  Punctuated equilibria: an alternative to phyletic gradualism , 1972 .

[3]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[4]  M. Feldman,et al.  Evolution of continuous variation: direct approach through joint distribution of genotypes and phenotypes. , 1976, Proceedings of the National Academy of Sciences of the United States of America.

[5]  S. Gould,et al.  Punctuated equilibria: the tempo and mode of evolution reconsidered , 1977, Paleobiology.

[6]  D. Marr,et al.  Artificial Intelligence - A Personal View , 1976, Artif. Intell..

[7]  B. Derrida.  Random-energy model: An exactly solvable model of disordered systems , 1981 .

[8]  K. Binder,et al.  Spin glasses: Experimental facts, theoretical concepts, and open questions , 1986 .

[9]  Richard Dawkins,et al.  The Evolution of Evolvability , 1987, ALIFE.

[10]  L. Taylor,et al.  Sewall Wright and Evolutionary Biology , 1987 .

[11]  Yuval Davidor,et al.  Epistasis Variance: A Viewpoint on GA-Hardness , 1990, FOGA.

[12]  Stuart A. Kauffman,et al.  The origins of order , 1993 .

[13]  Weinberger,et al.  Local properties of Kauffman's N-k model: A tunably rugged energy landscape. , 1991, Physical review. A, Atomic, molecular, and optical physics.

[14]  Bernard Manderick,et al.  The Genetic Algorithm and the Structure of the Fitness Landscape , 1991, ICGA.

[15]  P. Stadler,et al.  The landscape of the traveling salesman problem , 1992 .

[16]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[17]  L. Altenberg.  The evolution of evolvability in genetic programming , 1994 .

[18]  Terry Jones,et al.  Fitness Distance Correlation as a Measure of Problem Difficulty for Genetic Algorithms , 1995, ICGA.

[19]  Christian M. Reidys,et al.  Evolutionary Dynamics and Optimization: Neutral Networks as Model-Landscapes for RNA Secondary-Structure Folding-Landscapes , 1995, ECAL.

[20]  P. Schuster,et al.  Analysis of RNA sequence structure maps by exhaustive enumeration I. Neutral networks , 1995 .

[21]  L. Altenberg,et al.  PERSPECTIVE: COMPLEX ADAPTATIONS AND THE EVOLUTION OF EVOLVABILITY , 1996, Evolution; international journal of organic evolution.

[22]  Werner Ebeling,et al.  The Density of States - A Measure of the Difficulty of Optimisation Problems , 1996, PPSN.

[23]  M. Huynen,et al.  Smoothness within ruggedness: the role of neutrality in adaptation. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[24]  P. Schuster,et al.  Analysis of RNA sequence structure maps by exhaustive enumeration II. Structures of neutral networks and shape space covering , 1996 .

[25]  Wim Hordijk,et al.  A Measure of Landscapes , 1996, Evolutionary Computation.

[26]  R. Lenski,et al.  Punctuated Evolution Caused by Selection of Rare Beneficial Mutations , 1996, Science.

[27]  P. Stadler.  Landscapes and their correlation functions , 1996 .

[28]  Inman Harvey,et al.  Through the Labyrinth Evolution Finds a Way: A Silicon Ridge , 1996, ICES.

[29]  R. Lenski,et al.  Evolution of high mutation rates in experimental populations of E. coli , 1997, Nature.

[30]  Peter F. Stadler,et al.  Algebraic Theory of Recombination Spaces , 1997, Evolutionary Computation.

[31]  L. Barnett.  TANGLED WEBS Evolutionary Dynamics on Fitness Landscapes with Neutrality , 1997 .

[32]  N. Barton,et al.  PERSPECTIVE: A CRITIQUE OF SEWALL WRIGHT'S SHIFTING BALANCE THEORY OF EVOLUTION , 1997, Evolution; international journal of organic evolution.

[33]  F. Taddei,et al.  Role of mutator alleles in adaptive evolution , 1997, Nature.

[34]  L. Barnett.  Ruggedness and neutrality—the NKp family of fitness landscapes , 1998 .

[35]  M. Newman,et al.  Effects of selective neutrality on the evolution of molecular species , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[36]  M. Huynen,et al.  Neutral evolution of mutational robustness. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[37]  P. Layzell,et al.  Reducing hardware evolution's dependency on FPGAs , 1999, Proceedings of the Seventh International Conference on Microelectronics for Neural, Fuzzy and Bio-Inspired Systems.

[38]  P. Sibani,et al.  Evolution dynamics in terraced NK landscapes , 1999, adap-org/9904004.

[39]  Lawrence J. Fogel,et al.  Intelligence Through Simulated Evolution: Forty Years of Evolutionary Programming , 1999 .

[40]  Julian Francis Miller,et al.  The Advantages of Landscape Neutrality in Digital Circuit Evolution , 2000, ICES.

[41]  Bart Naudts,et al.  A comparison of predictive measures of problem difficulty in evolutionary algorithms , 2000, IEEE Trans. Evol. Comput..

[42]  M. Shackleton,et al.  An investigation of redundant genotype-phenotype mappings and their role in evolutionary search , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[43]  T. Jukes,et al.  The neutral theory of molecular evolution. , 2000, Genetics.

[44]  L. Chao,et al.  Evolvability of an RNA virus is determined by its mutational neighbourhood , 2000, Nature.

[45]  Julian Francis Miller,et al.  Information Characteristics and the Structure of Landscapes , 2000, Evolutionary Computation.

[46]  Phil Husbands,et al.  Neutral Networks and Evolvability with Complex Genotype-Phenotype Mapping , 2001, ECAL.

[47]  C. Ofria,et al.  Evolution of digital organisms at high mutation rates leads to survival of the flattest , 2001, Nature.

[48]  Claus O. Wilke,et al.  Adaptive evolution on neutral networks , 2001, Bulletin of mathematical biology.

[49]  P. Husbands,et al.  Neutral networks in an evolutionary robotics search space , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[50]  Marc Ebner,et al.  On neutral networks and evolvability , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[51]  Christian M. Reidys,et al.  Neutrality in fitness landscapes , 2001, Appl. Math. Comput..

[52]  Peter D. Turney.  Increasing Evolvability Considered as a Large-Scale Trend in Evolution , 2002, ArXiv.

[53]  E. Weinberger,et al.  Correlated and uncorrelated fitness landscapes and how to tell the difference , 1990, Biological Cybernetics.