Convergence and crossover Froese and Spier 2 Convergence and crossover : The permutation problem revisited

Standard crossover operators are often omitted from simple genetic algorithms (GAs) used for optimizing artificial neural networks because of the traditional belief that they generally disrupt the distributed functionality of the evolving solutions. The notion that crossover will be especially disruptive when a genetic representation is used which has a many-to-one mapping between genotype and phenotype has become known as the ‘permutation problem’. In contrast, this paper argues that these problems do not normally appear in practical use of simple GAs because populations converge quickly and then continue to move through search space in this converged manner until a fitness optimum is found. After convergence all individuals are genetically similar, and moreover, distinct genetic permutations of the same phenotypic solution are unlikely to co-exist in the population. Genetic convergence thus minimizes the possibility for disruption caused by crossover. We have termed this the ‘convergence argument’. This claim is investigated experimentally on standard benchmark problems and the results provide empirical support.

[1]  Peter J. Angeline,et al.  An evolutionary algorithm that constructs recurrent neural networks , 1994, IEEE Trans. Neural Networks.

[2]  Jordan B. Pollack,et al.  Recombination Without Respect: Schema Combination and Disruption in Genetic Algorithm Grossover , 2000, GECCO.

[3]  D B Fogel,et al.  Evolving neural networks for detecting breast cancer. , 1995, Cancer letters.

[4]  Larry R. Medsker,et al.  Genetic Algorithms and Neural Networks , 1995 .

[5]  Marc Ebner,et al.  On neutral networks and evolvability , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[6]  Makoto Fujiyoshi Evolutionary Robotics from Intelligent Robots to Artificial Life , 1998 .

[7]  Xin Yao,et al.  A new evolutionary system for evolving artificial neural networks , 1997, IEEE Trans. Neural Networks.

[8]  N. Garc'ia-Pedrajas,et al.  CIXL2: A Crossover Operator for Evolutionary Algorithms Based on Population Features , 2005, J. Artif. Intell. Res..

[9]  X. Yao Evolving Artificial Neural Networks , 1999 .

[10]  SAGAInman HarveyCSRP,et al.  Species Adaptation Genetic Algorithms: A Basis for a Continuing SAGA , 1992 .

[11]  Hussein A. Abbass,et al.  An evolutionary artificial neural networks approach for breast cancer diagnosis , 2002, Artif. Intell. Medicine.

[12]  Lutz Prechelt,et al.  A Set of Neural Network Benchmark Problems and Benchmarking Rules , 1994 .

[13]  Eduardo Izquierdo-Torres,et al.  The Role of Nearly Neutral Mutations in the Evolution of Dynamical Neural Networks , 2022 .

[14]  Nicholas J. Radcliffe,et al.  Genetic set recombination and its application to neural network topology optimisation , 1993, Neural Computing & Applications.

[15]  Lionel Barnett,et al.  Netcrawling-optimal evolutionary search with neutral networks , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[16]  Richard K. Belew,et al.  Evolving networks: using the genetic algorithm with connectionist learning , 1990 .

[17]  Nicholas J. Radcliffe,et al.  Genetic neural networks on MIMD computers , 1992 .

[18]  Dirk Thierens,et al.  Non-redundant genetic coding of neural networks , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[19]  Phil Husbands,et al.  Fitness Landscapes and Evolvability , 2002, Evolutionary Computation.

[20]  T. Jukes,et al.  The neutral theory of molecular evolution. , 2000, Genetics.

[21]  Inman Harvey,et al.  The Use of Neutral Genotype-Phenotype Mappings for Improved Evolutionary Search , 2000 .

[22]  J. David Schaffer,et al.  An Adaptive Crossover Distribution Mechanism for Genetic Algorithms , 1987, ICGA.

[23]  Inman Harvey,et al.  The Microbial Genetic Algorithm , 2009, ECAL.

[24]  Heinz Mühlenbein,et al.  On the Mean Convergence Time of Evolutionary Algorithms without Selection and Mutation , 1994, PPSN.

[25]  Johan A. K. Suykens,et al.  Genetic Weight Optimization of a Feedforward Neural Network Controller , 1993 .

[26]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[27]  J. D. Schaffer,et al.  Combinations of genetic algorithms and neural networks: a survey of the state of the art , 1992, [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks.

[28]  J. Crutchfield,et al.  Metastable evolutionary dynamics: Crossing fitness barriers or escaping via neutral paths? , 1999, Bulletin of mathematical biology.

[29]  Inman Harvey,et al.  Through the Labyrinth Evolution Finds a Way: A Silicon Ridge , 1996, ICES.

[30]  Inman Harvey Artificial Evolution: A Continuing SAGA , 2001, EvoRobots.

[31]  César Hervás-Martínez,et al.  An alternative approach for neural network evolution with a genetic algorithm: Crossover by combinatorial optimization , 2006, Neural Networks.

[32]  Lawrence Davis,et al.  Training Feedforward Neural Networks Using Genetic Algorithms , 1989, IJCAI.

[33]  L. Darrell Whitley,et al.  Genetic algorithms and neural networks: optimizing connections and connectivity , 1990, Parallel Comput..

[34]  Peter J. B. Hancock,et al.  Genetic algorithms and permutation problems: a comparison of recombination operators for neural net structure specification , 1992, [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks.