Linkage identification for real-valued loci by fitness difference classification

In order to enhance efficiency of genetic algorithms, it is important to identify a linkage set, i.e. a set of loci tightly linked to construct a building block. In this paper, we propose a novel linkage identification method for real-valued strings called the real-valued dependency detection for distribution derived from df (rD/sup 5/). It can detect linkage sets with quasilinear fitness evaluations. The rD/sup 5/ is designed based on the D/sup 5/ which has been proposed for binary strings. It detects dependencies of loci by estimating the distribution of strings classified according to fitness differences. The rD/sup 5/ and the LINC-R which is one of linkage identification methods proposed elsewhere, provide approximate equivalent information about a function to be solved, however, the rD/sup 5/ performs smaller number of fitness evaluations than the LINC-R for larger functions. Although estimation of distribution algorithms (EDAs) also estimate distribution of strings, it is difficult for EDAs to solve a function composed of exponentially scaled subfunctions. The proposed method, by contrast, can be applied to the function in the similar way to as to a function composed of uniformly scaled subfunctions which is easy for EDAs. We perform experiments to compare the proposed method with the LINC-R and to examine the scaling effect stability of the rD/sup 5/. We also investigate two parameters, that define the amount of perturbation (mutation) and that define the quantization level.

[1]  M. Pelikán,et al.  The Bivariate Marginal Distribution Algorithm , 1999 .

[2]  Anne Auger,et al.  LS-CMA-ES: A Second-Order Algorithm for Covariance Matrix Adaptation , 2004, PPSN.

[3]  Pedro Larrañaga,et al.  Optimization in Continuous Domains by Learning and Simulation of Gaussian Networks , 2000 .

[4]  D. Goldberg,et al.  BOA: the Bayesian optimization algorithm , 1999 .

[5]  David E. Goldberg,et al.  Learning Linkage , 1996, FOGA.

[6]  Paul A. Viola,et al.  MIMIC: Finding Optima by Estimating Probability Densities , 1996, NIPS.

[7]  Pedro Larrañaga,et al.  Estimation of Distribution Algorithms , 2002, Genetic Algorithms and Evolutionary Computation.

[8]  Masaharu Munetomo,et al.  Linkage identification based on epistasis measures to realize efficient genetic algorithms , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[9]  D. Goldberg,et al.  Linkage learning through probabilistic expression , 2000 .

[10]  Masaharu Munetomo,et al.  Linkage Identification by Nonlinearity Check for Real-Coded Genetic Algorithms , 2004, GECCO.

[11]  Masaharu Munetomo,et al.  Identifying Linkage Groups by Nonlinearity/Non-monotonicity Detection , 1999 .

[12]  Kalyanmoy Deb,et al.  Messy Genetic Algorithms: Motivation, Analysis, and First Results , 1989, Complex Syst..

[13]  Alden H. Wright,et al.  Efficient Linkage Discovery by Limited Probing , 2003, Evolutionary Computation.

[14]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[15]  David E. Goldberg,et al.  Simplex crossover and linkage learning in real-coded GAs , 2001 .

[16]  Masaharu Munetomo,et al.  Modeling Dependencies of Loci with String Classification According to Fitness Differences , 2004, GECCO.

[17]  David E. Goldberg,et al.  Bayesian Optimization Algorithm: From Single Level to Hierarchy , 2002 .

[18]  Martin Pelikan,et al.  Bayesian Optimization Algorithm , 2005 .

[19]  Dirk Thierens,et al.  Expanding from Discrete to Continuous Estimation of Distribution Algorithms: The IDEA , 2000, PPSN.

[20]  David E. Goldberg,et al.  Real-coded Bayesian Optimization Algorithm , 2006, Towards a New Evolutionary Computation.

[21]  David E. Goldberg,et al.  Simplex crossover and linkage identification: single-stage evolution vs. multi-stage evolution , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[22]  Matthew J. Streeter.  Upper Bounds on the Time and Space Complexity of Optimizing Additively Separable Functions , 2004, GECCO.