Sample based crowding method for multimodal optimization in continuous domain

We proposed a selection scheme called sample-based crowding, which is aimed to improve the performance of genetic algorithms for multimodal optimization in ill-scaled and locally multimodal domains. These domains can be problematic for conventional approaches, but are commonly found in real-world optimization problems. The principle of crowding is to apply a tournament selection to a parent-child pair with a high similarity. In the sample-based crowding, we determine such pairs based on a statistical comparison of the fitness values, which are sampled from the region between the pairs. Further, we take into account the ranks of the parents among the sampled values in the selection process, to determine their indispensability. These measurements are scale-invariant, which enables the proposed method to search a domain without presuming the distance between the optima or the scaling and the correlation of the variables. The proposed approach is evaluated in two benchmark problems with an ill-scaled and a locally multimodal landscape. The proposed method has a substantial advantage in terms of comprehensiveness compared to the conventional approaches, despite the additional cost of evaluations.

[1]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[2]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[3]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[4]  Samir W. Mahfoud Crowding and Preselection Revisited , 1992, PPSN.

[5]  Hiroaki Satoh,et al.  Minimal generation gap model for GAs considering both exploration and exploitation , 1996 .

[6]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[7]  Isao Ono,et al.  A Real Coded Genetic Algorithm for Function Optimization Using Unimodal Normal Distributed Crossover , 1997, ICGA.

[8]  David E. Goldberg,et al.  Probabilistic Crowding: Deterministic Crowding with Probabilistic Replacement , 1999 .

[9]  Shigenobu Kobayashi,et al.  An Extension of UNDX Based on Guidelines for Designing Crossover Operators , 2000 .

[10]  Rasmus K. Ursem,et al.  Multinational GAs: Multimodal Optimization Techniques in Dynamic Environments , 2000, GECCO.

[11]  Shigenobu Kobayashi,et al.  GA Based on the UV-Structure Hypothesis and Its Application to JSP , 2000, PPSN.

[12]  Shigenobu Kobayashi,et al.  k-tablet Structures and Crossover on Latent Variables for Real-Coded GA , 2002, GECCO Late Breaking Papers.

[13]  P. John Clarkson,et al.  A Species Conserving Genetic Algorithm for Multimodal Function Optimization , 2002, Evolutionary Computation.

[14]  Andreas Zell,et al.  A Clustering Based Niching EA for Multimodal Search Spaces , 2003, Artificial Evolution.

[15]  Eric R. Ziegel,et al.  Probability and Statistics for Engineering and the Sciences , 2004, Technometrics.