Two simulated annealing algorithms for noisy objective functions

We present two new variants of the simulated annealing algorithm (with a decreasing cooling schedule) that are designed for solving discrete simulation optimization problems. We also provide conditions under which our methods converge almost surely to the set of global optimal solutions, discuss the implications of our results for both transient and steady-state simulations, and provide some numerical results.

[1]  Bruce E. Hajek,et al.  Cooling Schedules for Optimal Annealing , 1988, Math. Oper. Res..

[2]  Leyuan Shi,et al.  Nested Partitions Method for Stochastic Optimization , 2000 .

[3]  Barry L. Nelson,et al.  A combined procedure for optimization via simulation , 2002, Proceedings of the Winter Simulation Conference.

[4]  Sigrún Andradóttir,et al.  Chapter 20 An Overview of Simulation Optimization via Random Search , 2006, Simulation.

[5]  Sigurdur Olafsson,et al.  Simulation optimization , 2002, Proceedings of the Winter Simulation Conference.

[6]  B. S.  Simulated Annealing with Noisy or Imprecise Energy Measurements , 2004 .

[7]  John N. Tsitsiklis,et al.  Markov Chains with Rare Transitions and Simulated Annealing , 1989, Math. Oper. Res..

[8]  D. Yan,et al.  Stochastic discrete optimization , 1992 .

[9]  B. Fox,et al.  Probabilistic Search with Overrides , 1995 .

[10]  S. Andradóttir,et al.  A Simulated Annealing Algorithm with Constant Temperature for Discrete Stochastic Optimization , 1999 .

[11]  Yu-Chi Ho,et al.  Stochastic Comparison Algorithm for Discrete Optimization with Estimation , 1999, SIAM J. Optim..

[12]  Mahmoud H. Alrefaei,et al.  A modification of the stochastic ruler method for discrete stochastic optimization , 2001, Eur. J. Oper. Res..

[13]  Sigrún Andradóttir,et al.  A Global Search Method for Discrete Stochastic Optimization , 1996, SIAM J. Optim..

[14]  Michael C. Fu,et al.  Feature Article: Optimization for simulation: Theory vs. Practice , 2002, INFORMS J. Comput..

[15]  Barry L. Nelson,et al.  Discrete Optimization via Simulation Using COMPASS , 2006, Oper. Res..

[16]  Sigrún Andradóttir,et al.  A review of simulation optimization techniques , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).

[17]  Sigrún Andradóttir,et al.  Simulation optimization using balanced explorative and exploitative search , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[18]  Sigrún Andradóttir,et al.  Accelerating the convergence of random search methods for discrete stochastic optimization , 1999, TOMC.

[19]  Mahmoud H. Alrefaei,et al.  Discrete stochastic optimization using variants of the stochastic ruler method , 2005 .

[20]  Michael C. Fu,et al.  Optimization for Simulation: Theory vs. Practice , 2002 .

[21]  S. Andradóttir.  A method for discrete stochastic optimization , 1995 .

[22]  Georg Ch. Pflug,et al.  Simulated Annealing for noisy cost functions , 1996, J. Glob. Optim..