Evolutionary Computation: An Overview

Evolutionary computation is an area of computer science that uses ideas from biological evolution to solve computational problems. Many such problems require searching through a huge space of possibilities for solutions, such as among a vast number of possible hardware circuit layouts for a configuration that produces desired behavior, for a set of equations that will predict the ups and downs of a financial market, or for a collection of rules that will control a robot as it navigates its environment. Such computational problems often require a system to be adaptive— that is, to continue to perform well in a changing environment. Problems like these require complex solutions that are usually difficult for human programmers to devise. Artificial intelligence practitioners once believed that it would be straightforward to encode the rules that would confer intelligence on a program; expert systems were one result of this early optimism. Nowadays, however, many researchers believe that the “rules” underlying intelligence are too complex for scientists to encode by hand in a top-down fashion. Instead they believe that the best route to artificial intelligence and other difficult computational problems is through a bottom-up paradigm in which humans write only very simple rules and provide a means for the system to adapt. Complex behaviors such as intelligence will emerge from the parallel application and interaction of these rules. Neural networks are one example of this philosophy; evolutionary computation is another. Biological evolution is an appealing source of inspiration for addressing difficult computational problems. Evolution is, in effect, a method of searching among an enormous number of possibilities—e.g., the set of possible gene sequences—for “solutions” that allow organisms to survive and reproduce in their environments. Evolution can also be seen as a method for adapting to changing environments. And, viewed from a high level, the “rules” of evolution are remarkably simple: Species evolve by means of random variation (via mutation, recombination, and

[1]  C. Waddington,et al.  GENETIC ASSIMILATION OF AN ACQUIRED CHARACTER , 1953 .

[2]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[3]  E. Mark Gold,et al.  Language Identification in the Limit , 1967, Inf. Control..

[4]  Donald Ervin Knuth,et al.  The Art of Computer Programming , 1968 .

[5]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[6]  Donald E. Knuth,et al.  Sorting and Searching , 1973 .

[7]  Donald E. Knuth,et al.  The Art of Computer Programming, Vol. 3: Sorting and Searching , 1974 .

[8]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[9]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[10]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[11]  John Maynard Smith,et al.  When learning guides evolution , 1987, Nature.

[12]  L. Taylor,et al.  Sewall Wright and Evolutionary Biology , 1987 .

[13]  Geoffrey E. Hinton,et al.  How Learning Can Guide Evolution , 1996, Complex Syst..

[14]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[15]  Reiko Tanese,et al.  Distributed Genetic Algorithms , 1989, ICGA.

[16]  W. Daniel Hillis,et al.  Co-evolving parasites improve simulated evolution as an optimization procedure , 1990 .

[17]  Thomas S. Ray,et al.  An Approach to the Synthesis of Life , 1991 .

[18]  David H. Ackley,et al.  Interactions between learning and evolution , 1991 .

[19]  G. M. Werner Evolution of Communication in Artificial Organisms, Artifial Life II , 1991 .

[20]  John J. Grefenstette,et al.  Lamarckian Learning in Multi-Agent Environments , 1991, ICGA.

[21]  John R. Koza,et al.  Evolution of Food-Foraging Strategies for the Caribbean Anolis Lizard Using Genetic Programming , 1992, Adapt. Behav..

[22]  John Maynard Smith,et al.  Byte-sized evolution , 1992, Nature.

[23]  Kristian Lindgren,et al.  Evolutionary phenomena in simple dynamics , 1992 .

[24]  Noam Chomsky,et al.  The Minimalist Program , 1992 .

[25]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[26]  Rusel DeMaria,et al.  SimLife: The Official Strategy Guide , 1993 .

[27]  Kunihiko Kaneko,et al.  Chaos as a Source of Complexity and Diversity in Evolution , 1993, Artificial Life.

[28]  L. Darrell Whitley,et al.  Serial and Parallel Genetic Algorithms as Function Optimizers , 1993, ICGA.

[29]  Kevin P. Kelly Out of control: the rise of neo-biological civilization , 1994 .

[30]  Karl Sims,et al.  Evolving 3D Morphology and Behavior by Competition , 1994, Artificial Life.

[31]  Charles E. Taylor,et al.  Selection for Wandering Behavior in a Small Robot , 1994, Artificial Life.

[32]  L. Booker Foundations of genetic algorithms. 2: L. Darrell Whitley (Ed.), Morgan Kaufmann, San Mateo, CA, 1993, ISBN 1-55860-263-1, 322 pp., US$45.95 , 1994 .

[33]  Charles E. Taylor,et al.  Selection for wandering behavior in a small robot , 1995 .

[34]  Partha Niyogi,et al.  The Logical Problem of Language Change , 1995 .

[35]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[36]  David B. Fogel,et al.  Evolutionary Computation: Towards a New Philosophy of Machine Intelligence , 1995 .

[37]  Richard K. Belew,et al.  Methods for Competitive Co-Evolution: Finding Opponents Worth Beating , 1995, ICGA.

[38]  Gennady M Verkhivker,et al.  Molecular recognition of the inhibitor AG-1343 by HIV-1 protease: conformationally flexible docking by evolutionary programming. , 1995, Chemistry & biology.

[39]  Melanie Mitchell,et al.  An introduction to genetic algorithms , 1996 .

[40]  Per Bak,et al.  How Nature Works , 1996 .

[41]  Akira Imada,et al.  Lamarckian evolution of associative memory , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[42]  M. Huynen,et al.  Smoothness within ruggedness: the role of neutrality in adaptation. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[43]  Jean Baptiste Pierre Antoine de Monet sw Lamarck Of the influence of the environment on the activities and habits of animals, and the influence of the activities and habits of these living bodies in modifying their organization and structure , 1996 .

[44]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[45]  John Maynard Smith,et al.  Natural selection: when learning guides evolution , 1996 .

[46]  Takahiro Sasaki,et al.  Adaptation toward Changing Environments: Why Darwinian in Nature? , 1997 .

[47]  Robert G. Reynolds,et al.  Evolutionary Programming VI , 1997, Lecture Notes in Computer Science.

[48]  David M. Raup,et al.  How Nature Works: The Science of Self-Organized Criticality , 1997 .

[49]  Melanie Mitchell,et al.  Finite populations induce metastability in evolutionary search , 1997 .

[50]  Thomas Bäck,et al.  Evolutionary computation: comments on the history and current state , 1997, IEEE Trans. Evol. Comput..

[51]  Thomas Bäck,et al.  Evolutionary computation: Toward a new philosophy of machine intelligence , 1997, Complex..

[52]  Jan Paredis,et al.  Coevolving Cellular Automata: Be Aware of the Red Queen! , 1997, ICGA.

[53]  Steven Durlauf,et al.  Growing artificial societies , 1997, Complex.

[54]  N. Barton,et al.  PERSPECTIVE: A CRITIQUE OF SEWALL WRIGHT'S SHIFTING BALANCE THEORY OF EVOLUTION , 1997, Evolution; international journal of organic evolution.

[55]  Georges R. Harik,et al.  Foundations of Genetic Algorithms , 1997 .

[56]  Masaya Iwata,et al.  Analogue EHW Chip for Intermediate Frequency Filters , 1998, ICES.

[57]  C. Adami,et al.  Introduction To Artificial Life , 1997, IEEE Trans. Evol. Comput..

[58]  Jordan B. Pollack,et al.  Coevolutionary Learning: A Case Study , 1998, ICML.

[59]  Takaya Arita,et al.  Evolution of Linguistic Diversity in a Simple Communication System , 1998, Artificial Life.

[60]  David B. Fogel,et al.  Evolutionary Computation: The Fossil Record , 1998 .

[61]  Marcus W. Feldman,et al.  Algorithms, genetics, and populations: The schemata theorem revisited , 1998, Complex..

[62]  Luc Steels,et al.  Stochasticity as a source of innovation in language games , 1998 .

[63]  Dave Cliff,et al.  The Creatures Global Digital Ecosystem , 1998, Artificial Life.

[64]  Takahiro Sasaki,et al.  Evolving Learnable Neural Networks Under Changing Environments with Various Rates of Inheritance of Acquired Characters: Comparison of Darwinian and Lamarckian Evolution , 1999, Artificial Life.

[65]  James P. Crutchfield,et al.  Statistical Dynamics of the Royal Road Genetic Algorithm , 1999, Theor. Comput. Sci..

[66]  Thomas S. Ray,et al.  Evolution of differentiated multi-threaded digital organisms , 1998, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[67]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[68]  J. Finnigan How Nature Works; The science of self-organized criticality , 2001 .