Measuring the Genotype Diversity of Evolvable Neural Networks

Studying the diversity of genetic algorithms is the most important topic to prevent the problem of premature convergence of the population. In general diversity study can be divided into, measuring diversity of the population and maintaining the diversity of the population. This paper is interested in measuring the diversity. Measuring population diversity can be categorised into genotype diversity measure and phenotype diversity measure. Most of the previous research was devoted to measure diversity of genetic programming and genetic algorithms in general. The present paper introduces a dedicated study to measure and analyse the genotype or structure diversity of evolvable neural networks. A new metric is introduced to measure the genotype diversity of evolvable neural networks based on genetic operations required to transform one neural network to another one. This method is called neuro-edit, it is inspired on edit distance measure and genetic operations used to evolve neural networks. This metric measures the distance between neural networks in terms of connection genes addition, deletion, and substitution.

[1]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[2]  Yee Leung,et al.  Degree of population diversity - a perspective on premature convergence in genetic algorithms and its Markov chain analysis , 1997, IEEE Trans. Neural Networks.

[3]  Dario Floreano,et al.  Measures of Diversity for Populations and Distances Between Individuals with Highly Reorganizable Genomes , 2004, Evolutionary Computation.

[4]  Kenny Q. Zhu,et al.  Population Diversity in Permutation-Based Genetic Algorithm , 2004, ECML.

[5]  Li Yujian,et al.  A Normalized Levenshtein Distance Metric , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Rüdiger Reischuk,et al.  The intractability of computing the Hamming distance , 2003, Theor. Comput. Sci..

[7]  Graham Kendall,et al.  Diversity in genetic programming: an analysis of measures and correlation with fitness , 2004, IEEE Transactions on Evolutionary Computation.

[8]  Miao Li,et al.  Study of population diversity of multiobjective evolutionary algorithm based on immune and entropy principles , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[9]  Graham Kendall,et al.  Advanced Population Diversity Measures in Genetic Programming , 2002, PPSN.

[10]  Jorge Tavares Crossover and Diversity : A Study about GVR , 2003 .

[11]  Graham Kendall,et al.  A Survey And Analysis Of Diversity Measures In Genetic Programming , 2002, GECCO.

[12]  Ben Paechter,et al.  An empirical analysis of the grouping genetic algorithm: the timetabling case , 2005, 2005 IEEE Congress on Evolutionary Computation.

[13]  Kenny Q. Zhu,et al.  Empirical Study of Population Diversity in Permutation-Based Genetic Algorithm , 2004, GECCO.

[14]  Robert Krauthgamer,et al.  Approximating edit distance efficiently , 2004, 45th Annual IEEE Symposium on Foundations of Computer Science.

[15]  Xin Yao,et al.  Diversity creation methods: a survey and categorisation , 2004, Inf. Fusion.