Optimization for Simulation : Theory vs . Practice

Probably one of the most successful interfaces between operations research and computer science has been the development of discrete-event simulation software. The recent integration of optimization techniques into simulation practice, specifically into commercial software, has become nearly ubiquitous, as most discrete-event simulation packages now include some form of “optimization” routine. The main thesis of this article, however, is that there is a disconnect between research in simulation optimization—which has addressed the stochastic nature of discrete-event simulation by concentrating on theoretical results of convergence and specialized algorithms that are mathematically elegant—and the recent software developments, which implement very general algorithms adopted from techniques in the deterministic optimization metaheuristic literature (e.g., genetic algorithms, tabu search, artificial neural networks). A tutorial exposition that summarizes the approaches found in the research literature is included, as well as a discussion contrasting these approaches with the algorithms implemented in commercial software. The article concludes with the author’s speculations on promising research areas and possible future directions in practice. (Simulation Optimization; Simulation Software; Stochastic Approximation; Metaheuristics)

[1]  Barry L. Nelson,et al.  Using Ranking and Selection to "Clean Up" after Simulation Optimization , 2003, Oper. Res..

[2]  L. Dai Convergence properties of ordinal comparison in the simulation of discrete event dynamic systems , 1995 .

[3]  Amir Dembo,et al.  Large Deviations Techniques and Applications , 1998 .

[4]  Barry L. Nelson,et al.  Search and selection for large-scale stochastic optimization , 1999 .

[5]  M. Fu,et al.  Optimization of discrete event systems via simultaneous perturbation stochastic approximation , 1997 .

[6]  Saul I. Gass,et al.  Encyclopedia of Operations Research and Management Science , 1997 .

[7]  Gül Gürkan,et al.  Sample-path solution of stochastic variational inequalities , 1999, Math. Program..

[8]  Harald Niederreiter,et al.  Random number generation and Quasi-Monte Carlo methods , 1992, CBMS-NSF regional conference series in applied mathematics.

[9]  Yu-Chi Ho,et al.  Ordinal optimization of DEDS , 1992, Discret. Event Dyn. Syst..

[10]  Fred W. Glover,et al.  Integrating optimization and simulation: research and practice , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[11]  Marco Dorigo,et al.  New Ideas in Optimisation , 1999 .

[12]  Fred W. Glover,et al.  New advances for wedding optimization and simulation , 1999, WSC '99.

[13]  L. Schruben,et al.  A Review of Techniques for Simulation Optimization , 1986 .

[14]  Jack P. C. Kleijnen,et al.  Experimental Design for Sensitivity Analysis, Optimization and Validation of Simulation Models , 1997 .

[15]  George Ch. Pflug,et al.  Optimization of Stochastic Models , 1996 .

[16]  Chun-Hung Chen,et al.  Computing efforts allocation for ordinal optimization and discrete event simulation , 2000, IEEE Trans. Autom. Control..

[17]  Michael C. Fu,et al.  Sensitivity Analysis for Monte Carlo Simulation of Option Pricing , 1995, Probability in the Engineering and Informational Sciences.

[18]  James A. Bucklew,et al.  Large Deviation Techniques in Decision, Simulation, and Estimation , 1990 .

[19]  Susan M. Sanchez,et al.  Robust design: seeking the best of all possible worlds , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[20]  M.C. Fu,et al.  Simulation optimization , 2001, Proceeding of the 2001 Winter Simulation Conference (Cat. No.01CH37304).

[21]  R. Caflisch Monte Carlo and quasi-Monte Carlo methods , 1998, Acta Numerica.

[22]  Chun-Hung Chen,et al.  Simulation Budget Allocation for Further Enhancing the Efficiency of Ordinal Optimization , 2000, Discret. Event Dyn. Syst..

[23]  Julie L. Swann,et al.  Simple Procedures for Selecting the Best Simulated System When the Number of Alternatives is Large , 2001, Oper. Res..

[24]  Sigrún Andradóttir,et al.  A Global Search Method for Discrete Stochastic Optimization , 1996, SIAM J. Optim..

[25]  Alan Weiss,et al.  Large Deviations For Performance Analysis: Queues, Communication and Computing , 1995 .

[26]  Russell R. Barton,et al.  Simulation metamodels , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).

[27]  Roman Kapuscinski,et al.  Optimal Policies and Simulation-Based Optimization for Capacitated Production Inventory Systems , 1999 .

[28]  Marco Dorigo,et al.  From Natural to Artificial Swarm Intelligence , 1999 .

[29]  Stephen M. Robinson,et al.  Analysis of Sample-Path Optimization , 1996, Math. Oper. Res..

[30]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[31]  Charles Leake,et al.  Discrete Event Systems: Sensitivity Analysis and Stochastic Optimization by the Score Function Method , 1994 .

[32]  Paul Glasserman,et al.  Gradient Estimation Via Perturbation Analysis , 1990 .

[33]  László Gerencsér,et al.  Optimization over discrete sets via SPSA , 1999, WSC '99.

[34]  J. Spall Multivariate stochastic approximation using a simultaneous perturbation gradient approximation , 1992 .

[35]  Ronald W. Wolff,et al.  Stochastic Modeling and the Theory of Queues , 1989 .

[36]  B. Nelson,et al.  A ranking and selection project: experiences from a university-industry collaboration , 1999, WSC'99. 1999 Winter Simulation Conference Proceedings. 'Simulation - A Bridge to the Future' (Cat. No.99CH37038).

[37]  Michael C. Fu,et al.  Optimization via simulation: A review , 1994, Ann. Oper. Res..