Optimizing simulated annealing schedules with genetic programming

Abstract Combinatorial optimization problems are encountered in many areas of science and engineering. Most of these problems are too difficult to be solved optimally, and hence heuristics are used to obtain “good” solutions in reasonable time. One heuristic that has been successfully applied to a variety of problems is Simulated Annealing. The performance of Simulated Annealing depends on the appropriate choice of a key parameter, the annealing schedule. Researchers usually experiment with some manually created annealing schedules and then use the one that performs best in their algorithms. This work replaces this manual search by Genetic Programming, a method based on natural evolution. We demonstrate the potential of this new approach by optimizing the annealing schedule for a well-known combinatorial optimization problem, the Quadratic Assignment Problem. We introduce two new algorithms for solving the Quadratic Assignment Problem that perform extremely well and outperform existing Simulated Annealing algorithms.

[1]  Elwood S. Buffa,et al.  A Heuristic Algorithm and Simulation Approach to Relative Location of Facilities , 1963 .

[2]  E. Lawler The Quadratic Assignment Problem , 1963 .

[3]  T. L. Ward,et al.  Solving Quadratic Assignment Problems by ‘Simulated Annealing’ , 1987 .

[4]  David Connolly An improved annealing scheme for the QAP , 1990 .

[5]  H. Sherali,et al.  Benders' partitioning scheme applied to a new formulation of the quadratic assignment problem , 1980 .

[6]  Jadranka Skorin-Kapov,et al.  Tabu Search Applied to the Quadratic Assignment Problem , 1990, INFORMS J. Comput..

[7]  F. S. Hillier,et al.  Quantitative Tools for Plant Layout Analysis , 1963 .

[8]  R. Burkard Quadratic Assignment Problems , 1984 .

[9]  Teofilo F. Gonzalez,et al.  P-Complete Approximation Problems , 1976, J. ACM.

[10]  F. Rendl,et al.  A thermodynamically motivated simulation procedure for combinatorial optimization problems , 1984 .

[11]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[12]  R. C. Lee,et al.  CORELAP: Computerized relationship layout planning , 1967 .

[13]  P. Gilmore Optimal and Suboptimal Algorithms for the Quadratic Assignment Problem , 1962 .

[14]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[15]  J. W. Gavett,et al.  The Optimal Assignment of Facilities to Locations by Branch and Bound , 1966, Oper. Res..

[16]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[17]  Donald E. Brown,et al.  A parallel heuristic for quadratic assignment problems , 1989, Comput. Oper. Res..

[18]  B. Golden,et al.  Using simulated annealing to solve routing and location problems , 1986 .

[19]  Fred Glover,et al.  Tabu Search - Part II , 1989, INFORMS J. Comput..

[20]  Alistair I. Mees,et al.  Convergence of an annealing algorithm , 1986, Math. Program..

[21]  Andreas Bölte Modelle und Verfahren zur innerbetrieblichen Standortplanung , 1994 .

[22]  F. Hillier,et al.  Quadratic Assignment Problem Algorithms and the Location of Indivisible Facilities , 1966 .

[23]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[24]  R. Wilensky,et al.  Common LISPcraft , 1986 .

[25]  T. Koopmans,et al.  Assignment Problems and the Location of Economic Activities , 1957 .

[26]  Thomas E. Vollmann,et al.  An Experimental Comparison of Techniques for the Assignment of Facilities to Locations , 1968, Oper. Res..

[27]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Leon Steinberg,et al.  The Backboard Wiring Problem: A Placement Algorithm , 1961 .

[29]  Elwood S. Buffa,et al.  The Facilities Layout Problem in Perspective , 1966 .

[30]  Rainer E. Burkard,et al.  Entwurf von Schreibmaschinentastaturen mittels quadratischer Zuordnungsprobleme , 1977, Math. Methods Oper. Res..

[31]  A. Federgruen,et al.  Simulated annealing methods with general acceptance probabilities , 1987, Journal of Applied Probability.

[32]  Andrew B. Whinston,et al.  On Optimal Allocation in a Distributed Processing Environment , 1982 .