Convergence of Simulated Annealing with Feedback Temperature Schedules

It is well known that the standard simulated annealing optimization method converges in distribution to the minimum of the cost function if the probability a for accepting an increase in costs goes to 0. α is controlled by the “temperature” parameter, which in the standard setup is a fixed sequence of values converging slowly to 0. We study a more general model in which the temperature may depend on the state of the search process. This allows us to adapt the temperature to the landscape of the cost function. The temperature may temporarily rise such that the process can leave a local optimum more easily. We give weak conditions on the temperature schedules such that the process of solutions finally concentrates near the optimal solutions. We also briefly sketch computational results for the job shop scheduling problem.

[1]  Jan Karel Lenstra,et al.  A Computational Study of Local Search Algorithms for Job Shop Scheduling , 1994, INFORMS J. Comput..

[2]  M. Loève Probability Theory II , 1978 .

[3]  Kenneth J. Supowit,et al.  Simulated Annealing Without Rejected Moves , 1986, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[4]  U. Faigle,et al.  Note on the convergence of simulated annealing algorithms , 1991 .

[5]  P. Schweitzer Perturbation theory and finite Markov chains , 1968 .

[6]  Jan Karel Lenstra,et al.  Job Shop Scheduling by Simulated Annealing , 1992, Oper. Res..

[7]  Bruce E. Hajek,et al.  Cooling Schedules for Optimal Annealing , 1988, Math. Oper. Res..

[8]  A. Federgruen,et al.  Simulated annealing methods with general acceptance probabilities , 1987, Journal of Applied Probability.

[9]  Pinaki Mazumder,et al.  VLSI cell placement techniques , 1991, CSUR.

[10]  N. Bouleau,et al.  Numerical methods for stochastic processes , 1993 .

[11]  Peter Brucker,et al.  Scheduling Algorithms , 1995 .

[12]  Emile H. L. Aarts,et al.  Simulated Annealing: Theory and Applications , 1987, Mathematics and Its Applications.

[13]  G. Pólya,et al.  Aufgaben und Lehrsätze aus der Analysis , 1926, Mathematical Gazette.

[14]  Manfred SchÄl,et al.  Conditions for optimality in dynamic programming and for the limit of n-stage optimal policies to be optimal , 1975 .

[15]  M. Kolonko,et al.  A piecewise Markovian model for simulated annealing with stochastic cooling schedules , 1995, Journal of Applied Probability.

[16]  Alistair I. Mees,et al.  Convergence of an annealing algorithm , 1986, Math. Program..

[17]  D. Mitra,et al.  Convergence and finite-time behavior of simulated annealing , 1986, Advances in Applied Probability.

[18]  Jan Karel Lenstra,et al.  Job Shop Scheduling by Local Search , 1996, INFORMS J. Comput..