Hierarchical Parallel Simulated Annealing and Its Applications

In this paper we propose a new parallelization scheme for Simulated Annealing | Hierarchical Parallel SA (HPSA). This new scheme features coarse-granularity in parallelization, directed at message-passing systems such as clusters. It combines heuristics such as adaptive clustering with SA to achieve more efficiency in local search. Through experiments with various optimization problems and comparison with some available schemes, we show that HPSA is a powerful general-purposed optimization method. It can also serve as a framework for meta-heuristics to gain broader application.

[1]  R. H. J. M. Otten,et al.  The Annealing Algorithm , 1989 .

[2]  Kyung-Geun Lee,et al.  Synchronous and Asynchronous Parallel Simulated Annealing with Multiple Markov Chains , 1996, IEEE Trans. Parallel Distributed Syst..

[3]  Ehl Emile Aarts,et al.  Simulated annealing : an introduction , 1989 .

[4]  Hao Chen,et al.  Parallel Genetic Simulated Annealing: A Massively Parallel SIMD Algorithm , 1998, IEEE Trans. Parallel Distributed Syst..

[5]  Mirko Krivánek,et al.  Simulated Annealing: A Proof of Convergence , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Alessandro Bevilacqua,et al.  A Methodological Approach to Parallel Simulated Annealing on an SMP System , 2002, J. Parallel Distributed Comput..

[7]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[8]  Stefan Tschöke,et al.  A general parallel simulated annealing library and its application in airline industry , 2000, Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000.

[9]  Reinhard Lüling,et al.  A general purpose distributed implementation of simulated annealing , 1992, [1992] Proceedings of the Fourth IEEE Symposium on Parallel and Distributed Processing.

[10]  Emile H. L. Aarts,et al.  Simulated annealing and Boltzmann machines - a stochastic approach to combinatorial optimization and neural computing , 1990, Wiley-Interscience series in discrete mathematics and optimization.

[11]  Ehl Emile Aarts,et al.  Simulated annealing and Boltzmann machines , 2003 .

[12]  C Kooperberg,et al.  Assembly of protein tertiary structures from fragments with similar local sequences using simulated annealing and Bayesian scoring functions. , 1997, Journal of molecular biology.

[13]  D. Janaki Ram,et al.  Parallel Simulated Annealing Algorithms , 1996, J. Parallel Distributed Comput..

[14]  Georg Kliewer A General Software Library for Parallel Simulated Annealing , 2000 .

[15]  Reinhard Lüling,et al.  Problem Independent Distributed Simulated Annealing and its Applications , 1993 .