Hierarchical BOA, Cluster Exact Approximation, and Ising Spin Glasses

This paper analyzes the hierarchical Bayesian optimization algorithm (hBOA) on the problem of finding ground states of Ising spin glasses with ±J couplings in two and three dimensions. The performance of hBOA is compared to that of the simple genetic algorithm (GA) and the univariate marginal distribution algorithm (UMDA). The performance of all tested algorithms is improved by incorporating a deterministic hill climber (DHC) based on single-bit flips and cluster exact approximation (CEA). The results show that hBOA significantly outperforms GA and UMDA with both types of local search and that CEA enables all tested algorithms to solve larger spin-glass instances than DHC. Using advanced hybrid methods created by combining competent genetic and evolutionary algorithms with advanced local searchers thus proves advantageous in this challenging class of problems.

[1]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[2]  D. Goldberg,et al.  Analysis of Mixing in Genetic Algorithms: A Survey , 2002 .

[3]  Ingo Wegener,et al.  The Ising Model on the Ring: Mutation Versus Recombination , 2004, GECCO.

[4]  A. Young,et al.  Spin glasses and random fields , 1997 .

[5]  David Maxwell Chickering,et al.  A Bayesian Approach to Learning Bayesian Networks with Local Structure , 1997, UAI.

[6]  Riccardo Poli,et al.  Genetic and Evolutionary Computation – GECCO 2004 , 2004, Lecture Notes in Computer Science.

[7]  Nir Friedman,et al.  Learning Bayesian Networks with Local Structure , 1996, UAI.

[8]  Martin Pelikan,et al.  Computational Complexity and Simulation of Rare Events of Ising Spin Glasses , 2004, GECCO.

[9]  A. Hartmann.  Cluster – Exact Approximation of Spin Glass , 2008 .

[10]  L. Kallel,et al.  Theoretical Aspects of Evolutionary Computing , 2001, Natural Computing Series.

[11]  Martin Loebl,et al.  On the Theory of Pfaffian Orientations. I. Perfect Matchings and Permanents , 1998, Electron. J. Comb..

[12]  Dieter Jungnickel,et al.  Graphs, Networks, and Algorithms , 1980 .

[13]  Zbigniew Michalewicz,et al.  Evolutionary Computation 1 , 2018 .

[14]  Martin Loebl,et al.  On the Theory of Pfaffian Orientations. II. T-joins, k-cuts, and Duality of Enumeration , 1998, Electron. J. Comb..

[15]  M. Mézard,et al.  Spin Glass Theory and Beyond , 1987 .

[16]  F. Guerra.  Spin Glasses , 2005, cond-mat/0507581.

[17]  Robert E. Tarjan,et al.  Data structures and network algorithms , 1983, CBMS-NSF regional conference series in applied mathematics.

[18]  Heinz Mühlenbein,et al.  Predictive Models for the Breeder Genetic Algorithm I. Continuous Parameter Optimization , 1993, Evolutionary Computation.

[19]  M. Troyer,et al.  Performance limitations of flat-histogram methods. , 2003, Physical review letters.

[20]  A. Hartmann.  Phase Transitions in Combinatorial Optimization Problems - Basics, Algorithms and Statistical Mechanics , 2005 .

[21]  Georges R. Harik,et al.  Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[22]  F. Barahona.  On the computational complexity of Ising spin glass models , 1982 .

[23]  K. Binder,et al.  Spin glasses: Experimental facts, theoretical concepts, and open questions , 1986 .

[24]  Robin Hons,et al.  Estimation of Distribution Algorithms and Minimum Relative Entropy , 2005 .

[25]  J. A. Lozano,et al.  Towards a New Evolutionary Computation: Advances on Estimation of Distribution Algorithms (Studies in Fuzziness and Soft Computing) , 2006 .

[26]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[27]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[28]  H. Rieger,et al.  New Optimization Algorithms in Physics , 2004 .

[29]  D. Goldberg,et al.  Escaping hierarchical traps with competent genetic algorithms , 2001 .

[30]  Roberto Santana,et al.  Estimation of Distribution Algorithms with Kikuchi Approximations , 2005, Evolutionary Computation.

[31]  David Claiborne.  Mathematical Preliminaries for Computer Networking , 1990 .

[32]  Siddhartha Shakya,et al.  Solving the Ising Spin Glass Problem using a Bivariate EDA based on Markov Random Fields , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[33]  D. Landau,et al.  Efficient, multiple-range random walk algorithm to calculate the density of states. , 2000, Physical review letters.

[34]  A. Middleton,et al.  Three-dimensional random-field Ising magnet: Interfaces, scaling, and the nature of states , 2001, cond-mat/0107489.

[35]  Jan Naudts,et al.  The Effect of Spin-Flip Symmetry on the Performance of the Simple GA , 1998, PPSN.

[36]  A. Hartmann.  Ground-state clusters of two-, three-, and four-dimensional +/-J Ising spin glasses. , 1999, Physical review. E, Statistical, nonlinear, and soft matter physics.

[37]  H. D. Ratliff,et al.  Minimum cuts and related problems , 1975, Networks.

[38]  C. V. Hoyweghen.  Detecting spin-flip symmetry in optimization problems , 2001 .

[39]  H. Mühlenbein,et al.  From Recombination of Genes to the Estimation of Distributions I. Binary Parameters , 1996, PPSN.

[40]  Heiko Rieger,et al.  Optimization algorithms in physics , 2001 .

[41]  Martin Pelikan,et al.  Hierarchical Bayesian optimization algorithm: toward a new generation of evolutionary algorithms , 2010, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).

[42]  David E. Goldberg,et al.  Hierarchical BOA Solves Ising Spin Glasses and MAXSAT , 2003, GECCO.

[43]  David E. Goldberg,et al.  A Survey of Optimization by Building and Using Probabilistic Models , 2002, Comput. Optim. Appl..

[44]  Jesper Larsson Träff,et al.  A heuristic for blocking flow algorithms , 1996 .

[45]  D. Goldberg,et al.  Domino convergence, drift, and the temporal-salience structure of problems , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).