Analysis of estimation of distribution algorithms and genetic algorithms on NK landscapes

This study analyzes performance of several genetic and evolutionary algorithms on randomly generated NK fitness landscapes with various values of n and k. A large number of NK problem instances are first generated for each n and k, and the global optimum of each instance is obtained using the branch-and-bound algorithm. Next, the hierarchical Bayesian optimization algorithm (hBOA), the univariate marginal distribution algorithm (UMDA), and the simple genetic algorithm (GA) with uniform and two-point crossover operators are applied to all generated instances. Performance of all algorithms is then analyzed and compared, and the results are discussed.

[1]  David Maxwell Chickering,et al.  A Bayesian Approach to Learning Bayesian Networks with Local Structure , 1997, UAI.

[2]  David Maxwell Chickering,et al.  Learning Bayesian Networks: The Combination of Knowledge and Statistical Data , 1994, Machine Learning.

[3]  Nir Friedman,et al.  Learning Bayesian Networks with Local Structure , 1996, UAI.

[4]  Georges R. Harik,et al.  Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[5]  Stuart A. Kauffman,et al.  The origins of order , 1993 .

[6]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[7]  Kyomin Jung,et al.  Phase transition in a random NK landscape model , 2005, GECCO '05.

[8]  Kiyoshi Tanaka,et al.  Genetic Algorithms on NK-Landscapes: Effects of Selection, Drift, Mutation, and Recombination , 2003, EvoWorkshops.

[9]  H. Mühlenbein,et al.  From Recombination of Genes to the Estimation of Distributions I. Binary Parameters , 1996, PPSN.

[10]  D. Goldberg,et al.  Escaping hierarchical traps with competent genetic algorithms , 2001 .

[11]  Shumeet Baluja,et al.  A Method for Integrating Genetic Search Based Function Optimization and Competitive Learning , 1994 .

[12]  Yong Gao,et al.  An Analysis of Phase Transition in NK Landscapes , 2002, J. Artif. Intell. Res..

[13]  Kyomin Jung,et al.  Phase transition in a random NK landscape model , 2008, Artif. Intell..

[14]  David E. Goldberg,et al.  A Survey of Optimization by Building and Using Probabilistic Models , 2002, Comput. Optim. Appl..

[15]  S. Kobe,et al.  A recursive branch-and-bound algorithm for the exact ground state of Ising spin-glass models , 1984 .

[16]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[17]  Alden H. Wright,et al.  The computational complexity of N-K fitness functions , 2000, IEEE Trans. Evol. Comput..

[18]  David E. Goldberg,et al.  Hierarchical BOA Solves Ising Spin Glasses and MAXSAT , 2003, GECCO.

[19]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[20]  P. Bosman,et al.  Continuous iterated density estimation evolutionary algorithms within the IDEA framework , 2000 .

[21]  Martin Pelikan,et al.  Finding ground states of Sherrington-Kirkpatrick spin glasses with hierarchical boa and genetic algorithms , 2008, GECCO '08.

[22]  Martin Pelikan,et al.  Hierarchical Bayesian optimization algorithm: toward a new generation of evolutionary algorithms , 2010, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).

[23]  Jeffrey Horn,et al.  Handbook of evolutionary computation , 1997 .

[24]  Franz Rothlauf,et al.  Evaluation-Relaxation Schemes for Genetic and Evolutionary Algorithms , 2004 .