An analysis of decentralized and spatially distributed genetic algorithms

A number of interesting design issues arise when one wants to implement and use decentralized and spatially distributed genetic algorithms (GAs). The implications of these design decisions are not well understood and have only been tested empirically. The objective of this research is to understand and characterize the behavior of the decentralized and spatially distributed GAs with overlapping neighborhoods. To do so the control structure of the GA must be decentralized which alters the semantics of the selection algorithm used. This in turn usually produces changes in the GA's problem solving behavior. First, the implications of the various decentralized selection algorithms are analyzed by studying the changes produced on the characteristics of the selection pressure they induce on the entire population. This analysis shows that the emergent global selection pressure of a particular local selection algorithm is qualitatively similar to its centralized counterpart, but quantitatively weaker. Next, the techniques to formally analyze the selection methods in centralized sequential GAs are extended and applied to the local neighborhood GAs to understand the effects of the neighborhood sizes and shapes. This results in a quantitative model in which the coefficient of the growth rate of the best individual in the population is expressed as a function of the ratio of the neighborhood radius to the grid radius. This quantitative model is used to predict the expected behavior of the spatially distributed GAs. These predictions are empirically validated using the domain of function optimization. These validations help us gain valuable insights into the behavior of these GAs. Furthermore, it is also demonstrated how the selection pressure in a local neighborhood GA can be adjusted based on the analytical model. Finally, the analytical model is used to design effective spatially distributed GAs for solving problems in complex and dynamic environments. The analytical model is also capable of explaining (in some cases conflicting) previously published empirical results. In addition, a developer can now make more effective choices when designing and implementing spatially distributed GAs.

[1]  Heinz Mühlenbein,et al.  Evolution in Time and Space - The Parallel Genetic Algorithm , 1990, FOGA.

[2]  Samir W. Mahfoud Crowding and Preselection Revisited , 1992, PPSN.

[3]  S. Wright,et al.  Isolation by Distance. , 1943, Genetics.

[4]  Reiko Tanese,et al.  Distributed Genetic Algorithms , 1989, ICGA.

[5]  Lawrence Davis,et al.  Bit-Climbing, Representational Bias, and Test Suite Design , 1991, ICGA.

[6]  Kenneth A. De Jong,et al.  On Decentralizing Selection Algorithms , 1995, ICGA.

[7]  Markus Schwehm,et al.  A Massively Parallel Genetic Algorithm on the MasPar MP-1 , 1993 .

[8]  Kenneth A. De Jong,et al.  Generation Gaps Revisited , 1992, FOGA.

[9]  Kenneth A. De Jong,et al.  On the State of Evolutionary Computation , 1993, ICGA.

[10]  John J. Grefenstette,et al.  Genetic Algorithms for Changing Environments , 1992, PPSN.

[11]  William M. Spears,et al.  Simple Subpopulation Schemes , 1998 .

[12]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[13]  Hans-Paul Schwefel,et al.  Numerical Optimization of Computer Models , 1982 .

[14]  S Hendry,et al.  Searching for diversity. , 1997, Australian nursing journal (July 1993).

[15]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[16]  David John Unwin,et al.  Introductory Spatial Analysis , 1982 .

[17]  Kenneth DeJong,et al.  Learning with genetic algorithms: An overview , 1988, Machine Learning.

[18]  Gilbert Syswerda,et al.  Uniform Crossover in Genetic Algorithms , 1989, ICGA.

[19]  Kenneth A. De Jong,et al.  Genetic algorithms: A 10 Year Perspective , 1985, ICGA.

[20]  KARL PEARSON,et al.  The Problem of the Random Walk , 1905, Nature.