A Signal-to-noise Framework for Quantifying Search Diiculties in Genetic Algorithms

This paper presents a signal-to-noise perspective of the search process in genetic algorithms. First we pose a decision problem in terms of multiple 2-armed, mutually dependent bandits. This presents a theoretical framework for understanding stochastic search techniques in general. The deterministic and nondeterministic e ects on the convolution kernel associated with the bandits are identi ed as signal and noise respectively. We discuss what these quantities mean in a GA and how they can be computed in GA. Next, we present a signal-to-noise perspective of GA hardness. It is noted that there are two fundamental modes of introducing di culty into the decision making process: 1) sending a wrong signal and 2) increasing or decreasing noise depending on the direction of signal. We also note that the di culty due to crosstalk[21] can be quanti ed by the higher order components of the noise kernel. Our experiments on Royal Road functions R1 & R2 [13] clearly demonstrate that increasing signal in the right direction alone does not necessarily make a problem easy for GA, unless the noise is also reduced.

[1]  L. Darrell Whitley,et al.  Fundamental Principles of Deception in Genetic Search , 1990, FOGA.

[2]  B. Gidas Global optimization via the Langevin equation , 1985, 1985 24th IEEE Conference on Decision and Control.

[3]  Lashon B. Booker,et al.  Recombination Distributions for Genetic Algorithms , 1992, FOGA.

[4]  David E. Goldberg,et al.  Genetic Algorithms and Walsh Functions: Part I, A Gentle Introduction , 1989, Complex Syst..

[5]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[6]  Yuval Davidor,et al.  Epistasis Variance: A Viewpoint on GA-Hardness , 1990, FOGA.

[7]  H. Meinhardt Models of biological pattern formation , 1982 .

[8]  Kalyanmoy Deb,et al.  Ordering Genetic Algorithms and Deception , 1992, PPSN.

[9]  James P. Egan,et al.  Signal detection theory and ROC analysis , 1975 .

[10]  A. Kolmogoroff Über die analytischen Methoden in der Wahrscheinlichkeitsrechnung , 1931 .

[11]  A. M. Turing,et al.  The chemical basis of morphogenesis , 1952, Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences.

[12]  Melanie Mitchell,et al.  Relative Building-Block Fitness and the Building Block Hypothesis , 1992, FOGA.

[13]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[14]  H. Geiringer On the Probability Theory of Linkage in Mendelian Heredity , 1944 .

[15]  R. A. Fisher,et al.  On the dominance ratio , 1990 .

[16]  Dirk Thierens,et al.  Toward a Better Understanding of Mixing in Genetic Algorithms , 1993 .

[17]  C. Gielen,et al.  Neural computation and self-organizing maps, an introduction , 1993 .

[18]  S. Chandrasekhar Stochastic problems in Physics and Astronomy , 1943 .

[19]  David E. Goldberg,et al.  Genetic Algorithms and Walsh Functions: Part II, Deception and Its Analysis , 1989, Complex Syst..

[20]  Kalyanmoy Deb,et al.  Genetic Algorithms, Noise, and the Sizing of Populations , 1992, Complex Syst..

[21]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[22]  Kalyanmoy Deb,et al.  Analyzing Deception in Trap Functions , 1992, FOGA.

[23]  Dirk Thierens,et al.  Convergence Models of Genetic Algorithm Selection Schemes , 1994, PPSN.

[24]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[25]  Kenneth A. De Jong,et al.  Are Genetic Algorithms Function Optimizers? , 1992, PPSN.

[26]  Emile H. L. Aarts,et al.  Simulated annealing and Boltzmann machines - a stochastic approach to combinatorial optimization and neural computing , 1990, Wiley-Interscience series in discrete mathematics and optimization.

[27]  Hillol Kargupta Information Transmission in Genetic Algorithm and Shannon's Second Theorem , 1993, ICGA.

[28]  M. Kimura Stochastic processes and distribution of gene frequencies under natural selection. , 1955, Cold Spring Harbor symposia on quantitative biology.

[29]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[30]  Dan Boneh,et al.  On genetic algorithms , 1995, COLT '95.