Self-Organized Modularization in Evolutionary Algorithms

The principle of modularization has proven to be extremely successful in the field of technical applications and particularly for Software Engineering purposes. The question to be answered within the present article is whether mechanisms can also be identified within the framework of Evolutionary Computation that cause a modularization of solutions. We will concentrate on processes, where modularization results only from the typical evolutionary operators, i.e. selection and variation by recombination and mutation (and not, e.g., from special modularization operators). This is what we call Self-Organized Modularization. Based on a combination of two formalizations by Radcliffe and Altenberg, some quantitative measures of modularity are introduced. Particularly, we distinguish Built-in Modularityas an inherent property of a genotype and Effective Modularity, which depends on the rest of the population. These measures can easily be applied to a wide range of present Evolutionary Computation models. It will be shown, both theoretically and by simulation, that under certain conditions, Effective Modularity (as defined within this paper) can be a selection factor. This causes Self-Organized Modularization to take place. The experimental observations emphasize the importance of Effective Modularityin comparison with Built-in Modularity. Although the experimental results have been obtained using a minimalist toy model, they can lead to a number of consequences for existing models as well as for future approaches. Furthermore, the results suggest a complex self-amplification of highly modular equivalence classes in the case of respected relations. Since the well-known Holland schemata are just the equivalence classes of respected relations in most Simple Genetic Algorithms, this observation emphasizes the role of schemata as Building Blocks (in comparison with arbitrary subsets of the search space).

[1]  Heinz Mühlenbein,et al.  The Estimation of Distributions and the Minimum Relative Entropy Principle , 2005, Evol. Comput..

[2]  Nicholas J. Radcliffe,et al.  The algebra of genetic algorithms , 1994, Annals of Mathematics and Artificial Intelligence.

[3]  Risto Miikkulainen,et al.  Fast Reinforcement Learning through Eugenic Neuro-Evolution , 1999 .

[4]  Thomas Bäck,et al.  Intelligent Mutation Rate Control in Canonical Genetic Algorithms , 1996, ISMIS.

[5]  Günter P. Wagner,et al.  Adaptation and the Modular Design of Organisms , 1995, ECAL.

[6]  Lee Altenberg,et al.  Genome Growth and the Evolution of the Genotype-Phenotype Map , 1995, Evolution and Biocomputation.

[7]  David E. Goldberg,et al.  Learning Linkage , 1996, FOGA.

[8]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[9]  Katia Sycara,et al.  Reasons for premature convergence of self-adapting mutation rates , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[10]  Lee Altenberg,et al.  The Schema Theorem and Price's Theorem , 1994, FOGA.

[11]  John Holland,et al.  Adaptation in Natural and Artificial Sys-tems: An Introductory Analysis with Applications to Biology , 1975 .

[12]  G. Wagner,et al.  A case study of the evolution of modularity: towards a bridge between evolutionary biology, artificial life, neuro- and cognitive science , 1998 .

[13]  M. Vose The Simple Genetic Algorithm , 1999 .

[14]  L. Altenberg The evolution of evolvability in genetic programming , 1994 .

[15]  Daniel Polani,et al.  Adaption der Topologie von Kohonen-Karten durch genetische Algorithmen , 1996, DISKI.

[16]  Peter Dauscher Selbstorganisierte Modularisierung von Individuen in evolutionären Algorithmen , 2003 .

[17]  Jordan B. Pollack,et al.  How Symbiosis Can Guide Evolution , 1999, ECAL.

[18]  Xin Yao,et al.  Speciation as automatic categorical modularization , 1997, IEEE Trans. Evol. Comput..

[19]  Heinz Mühlenbein,et al.  Evolutionary Algorithms and the Boltzmann Distribution , 2002, FOGA.