Coevolving Memetic Algorithms: A Review and Progress Report

Coevolving memetic algorithms are a family of metaheuristic search algorithms in which a rule-based representation of local search (LS) is coadapted alongside candidate solutions within a hybrid evolutionary system. Simple versions of these systems have been shown to outperform other nonadaptive memetic and evolutionary algorithms on a range of problems. This paper presents a rationale for such systems and places them in the context of other recent work on adaptive memetic algorithms. It then proposes a general structure within which a population of LS algorithms can be evolved in tandem with the solutions to which they are applied. Previous research started with a simple self-adaptive system before moving on to more complex models. Results showed that the algorithm was able to discover and exploit certain forms of structure and regularities within the problems. This "metalearning" of problem features provided a means of creating highly scalable algorithms. This work is briefly reviewed to highlight some of the important findings and behaviors exhibited. Based on this analysis, new results are then presented from systems with more flexible representations, which, again, show significant improvements. Finally, the current state of, and future directions for, research in this area is discussed

[1]  Larry Bull,et al.  Evolutionary computing in multi-agent environments: Partners , 1997 .

[2]  Bernd Freisleben,et al.  Fitness landscapes and memetic algorithm design , 1999 .

[3]  Zbigniew Michalewicz,et al.  Handbook of Evolutionary Computation , 1997 .

[4]  Graham Kendall,et al.  A Tabu-Search Hyperheuristic for Timetabling and Rostering , 2003, J. Heuristics.

[5]  Wolfgang Banzhaf,et al.  The evolution of genetic code in Genetic Programming , 1999 .

[6]  Frank Thomson Leighton,et al.  Protein folding in the hydrophobic-hydrophilic (HP) is NP-complete , 1998, RECOMB '98.

[7]  W. Hart Adaptive global optimization with local search , 1994 .

[8]  Hans-Paul Schwefel,et al.  Numerical Optimization of Computer Models , 1982 .

[9]  Stuart A. Kauffman,et al.  The origins of order , 1993 .

[10]  Edmund K. Burke,et al.  Hybrid evolutionary techniques for the maintenance scheduling problem , 2000 .

[11]  Jim Smith,et al.  Protein structure prediction with co-evolving memetic algorithms , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[12]  Tim Jones Evolutionary Algorithms, Fitness Landscapes and Search , 1995 .

[13]  J. David Schaffer,et al.  An Adaptive Crossover Distribution Mechanism for Genetic Algorithms , 1987, ICGA.

[14]  James Smith,et al.  A tutorial for competent memetic algorithms: model, taxonomy, and design issues , 2005, IEEE Transactions on Evolutionary Computation.

[15]  Jim Smith,et al.  Self adaptation of mutation rates in a steady state genetic algorithm , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[16]  Frank Thomson Leighton,et al.  Protein folding in the hydrophobic-hydrophilic (HP) is NP-complete , 1998, RECOMB '98.

[17]  Kevin Kok Wai Wong,et al.  Classification of adaptive memetic algorithms: a comparative study , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[18]  Zbigniew Michalewicz,et al.  Adaptation in evolutionary computation: a survey , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[19]  R Unger,et al.  Genetic algorithms for protein folding simulations. , 1992, Journal of molecular biology.

[20]  William E. Hart,et al.  Protein structure prediction with evolutionary algorithms , 1999 .

[21]  Jim Smith,et al.  Operator and parameter adaptation in genetic algorithms , 1997, Soft Comput..

[22]  Jim Smith,et al.  A Memetic Algorithm With Self-Adaptive Local Search: TSP as a case study , 2000, GECCO.

[23]  K. Dill Theory for the folding and stability of globular proteins. , 1985, Biochemistry.

[24]  Jim Smith,et al.  The Co-Evolution of Memetic Algorithms for Protein Structure Prediction , 2005 .

[25]  Lee Spector,et al.  Evolving teamwork and coordination with genetic programming , 1996 .

[26]  Silvano Martello,et al.  Meta-Heuristics: Advances and Trends in Local Search Paradigms for Optimization , 2012 .

[27]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[28]  Zbigniew Michalewicz,et al.  Parameter Control in Evolutionary Algorithms , 2007, Parameter Setting in Evolutionary Algorithms.

[29]  William E. Hart,et al.  Recent Advances in Memetic Algorithms , 2008 .

[30]  Jan Paredis,et al.  The Symbiotic Evolution of Solutions and Their Representations , 1995, International Conference on Genetic Algorithms.

[31]  Andy J. Keane,et al.  Meta-Lamarckian learning in memetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[32]  Nenad Mladenović,et al.  An Introduction to Variable Neighborhood Search , 1997 .

[33]  Carlos Alberto Conceição António,et al.  Self-adaptation in Genetic Algorithms applied to structural optimization , 2008 .

[34]  David B. Fogel,et al.  Evolving artificial intelligence , 1992 .

[35]  J. E. Smith,et al.  Co-evolving memetic algorithms: a learning approach to robust scalable optimisation , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[36]  W. Banzhaf,et al.  Genetic programming using genotype-phenotype mapping from linear genomes into linear phenotypes , 1996 .

[37]  Larry Bull,et al.  Horizontal gene transfer in endosymbiosis , 1997 .

[38]  Natalio Krasnogor,et al.  A Study on the use of ``self-generation'' in memetic algorithms , 2004, Natural Computing.

[39]  Gary B. Parker,et al.  Varying sample sizes for the co-evolution of heterogeneous agents , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[40]  Natalio Krasnogor,et al.  Emergence of profitable search strategies based on a simple inheritance mechanism , 2001 .

[41]  Natalio Krasnogor,et al.  Studies on the theory and design space of memetic algorithms , 2002 .

[42]  Graham Kendall,et al.  A Hyperheuristic Approach to Scheduling a Sales Summit , 2000, PATAT.

[43]  Jim Smith,et al.  Adaptively Parameterised Evolutionary Systems: Self-Adaptive Recombination and Mutation in a Genetic Algorithm , 1996, PPSN.

[44]  P. Cowling,et al.  CHOICE FUNCTION AND RANDOM HYPERHEURISTICS , 2002 .

[45]  Natalio Krasnogor,et al.  Self Generating Metaheuristics in Bioinformatics: The Proteins Structure Comparison Case , 2004, Genetic Programming and Evolvable Machines.

[46]  Hillol Kargupta,et al.  Toward Machine Learning Through Genetic Code-like Transformations , 2002, Genetic Programming and Evolvable Machines.