Some topics for simulation optimization

We give a tutorial introduction to simulation optimization. We begin by classifying the problem setting according to the decision variables and constraints, putting the setting in the simulation context, and then summarize the main approaches to simulation optimization. We then discuss three topics in more depth: optimal computing budget allocation, stochastic gradient estimation, and the nested partitions method. We conclude by briefly discussing some related research and currently available simulation optimization software.

[1]  Lucy Y. Pao,et al.  Computing budget allocation for efficient ranking and selection of variances with application to target tracking algorithms , 2004, IEEE Transactions on Automatic Control.

[2]  Georg Ch. Pflug.  Sampling derivatives of probabilities , 2005, Computing.

[3]  M.C. Fu,et al.  Simulation optimization , 2001, Proceeding of the 2001 Winter Simulation Conference (Cat. No.01CH37304).

[4]  S. Ólafsson.  Two-Stage Nested Partitions Method for Stochastic Optimization , 2004 .

[5]  Paul Glasserman,et al.  Monte Carlo Methods in Financial Engineering , 2003 .

[6]  Chun-Hung Chen,et al.  Simulation Budget Allocation for Further Enhancing the Efficiency of Ordinal Optimization , 2000, Discret. Event Dyn. Syst..

[7]  Leyuan Shi,et al.  New parallel randomized algorithms for the traveling salesman problem , 1999, Comput. Oper. Res..

[8]  Y. Rinott.  On two-stage selection procedures and related probability-inequalities , 1978 .

[9]  Peter W. Glynn,et al.  A large deviations perspective on ordinal optimization , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[10]  Ulrich Dieter,et al.  Discrete Optimization Approximating k-cuts using network strength as a Lagrangean relaxation , 2000 .

[11]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[12]  János D. Pintér,et al.  Computational Global Optimization , 2007 .

[13]  Ying He,et al.  Simulation-Based Algorithms for Markov Decision Processes , 2002 .

[14]  Chun-Hung Chen,et al.  An alternative simulation budget allocation scheme for efficient simulation , 2005, Int. J. Simul. Process. Model..

[15]  Michael C. Fu,et al.  Application of perturbation analysis to a class of periodic review (s, S) inventory systems , 1994 .

[16]  Chun-Hung Chen,et al.  Simulation Allocation for Determining the Best Design in the Presence of Correlated Sampling , 2007, INFORMS J. Comput..

[17]  P. Glynn.  LIKELIHOOD RATIO GRADIENT ESTIMATION : AN OVERVIEW by , 2022 .

[18]  Panos M. Pardalos,et al.  Approximate dynamic programming: solving the curses of dimensionality , 2009, Optim. Methods Softw..

[19]  Leyuan Shi.  A New Algorithm for Stochastic Discrete Resource Allocation Optimization , 2000, Discret. Event Dyn. Syst..

[20]  Jason H. Goodfriend,et al.  Discrete Event Systems: Sensitivity Analysis and Stochastic Optimization by the Score Function Method , 1995 .

[21]  Michael C. Fu,et al.  Feature Article: Optimization for simulation: Theory vs. Practice , 2002, INFORMS J. Comput..

[22]  Michael C. Fu,et al.  Chapter 19 Gradient Estimation , 2006, Simulation.

[23]  S. Dalal,et al.  ALLOCATION OF OBSERVATIONS IN RANKING AND SELECTION WITH UNEQUAL VARIANCES , 1971 .

[24]  Loo Hay Lee,et al.  Efficient Simulation Budget Allocation for Selecting an Optimal Subset , 2008, INFORMS J. Comput..

[25]  Chun-Hung Chen,et al.  Opportunity Cost and OCBA Selection Procedures in Ordinal Optimization for a Fixed Number of Alternative Systems , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[26]  Chun-Hung Chen.  A lower bound for the correct subset-selection probability and its application to discrete-event system simulations , 1996, IEEE Trans. Autom. Control..

[27]  Warren B. Powell,et al.  Approximate Dynamic Programming - Solving the Curses of Dimensionality , 2007 .

[28]  Sigurdur Olafsson,et al.  Simulation optimization , 2002, Proceedings of the Winter Simulation Conference.

[29]  George Ch. Pflug,et al.  Optimization of Stochastic Models , 1996 .

[30]  M. Fu.  What you should know about simulation and derivatives , 2008 .

[31]  Michael Fu,et al.  Sample Path Derivatives for (s, S) Inventory Systems with Price Determination , 2005 .

[32]  Jiaqiao Hu,et al.  Simulation-based Algorithms for Markov Decision Processes (Communications and Control Engineering) , 2007 .

[33]  Barry L. Nelson,et al.  Chapter 17 Selecting the Best System , 2006, Simulation.

[34]  Michael C. Fu,et al.  Sample Path Derivatives for (s, S) Inventory Systems , 1994, Oper. Res..

[35]  George L. Nemhauser,et al.  Handbooks in operations research and management science , 1989 .

[36]  Michael C. Fu,et al.  Simulation optimization of (s,S) inventory systems , 1992, WSC '92.

[37]  Russell R. Barton,et al.  Chapter 18 Metamodel-Based Simulation Optimization , 2006, Simulation.

[38]  Sigrún Andradóttir,et al.  Chapter 20 An Overview of Simulation Optimization via Random Search , 2006, Simulation.

[39]  P. L’Ecuyer,et al.  A Unified View of the IPA, SF, and LR Gradient Estimation Techniques , 1990 .

[40]  Stephen E. Chick,et al.  New Two-Stage and Sequential Procedures for Selecting the Best Simulated System , 2001, Oper. Res..

[41]  Robert E. Shannon,et al.  Design and analysis of simulation experiments , 1978, WSC '78.

[42]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[43]  Alexander Shapiro,et al.  Finding Optimal Material Release Times Using Simulation-Based Optimization , 1999 .

[44]  Peter W. Glynn,et al.  Gradient estimation for ratios , 1991, 1991 Winter Simulation Conference Proceedings..

[45]  J. Spall.  Multivariate stochastic approximation using a simultaneous perturbation gradient approximation , 1992 .

[46]  Carlos S. Kubrusly,et al.  Stochastic approximation algorithms and applications , 1973, CDC 1973.

[47]  Chun-Hung Chen,et al.  New development of optimal computing budget allocation for discrete event simulation , 1997, WSC '97.

[48]  Jürgen Branke,et al.  Selecting a Selection Procedure , 2007, Manag. Sci..

[49]  Michael C. Fu,et al.  Optimization via simulation: A review , 1994, Ann. Oper. Res..

[50]  Peter W. Glynn,et al.  Likelilood ratio gradient estimation: an overview , 1987, WSC '87.

[51]  Raghu Pasupathy,et al.  A Testbed of Simulation-Optimization Problems , 2006, Proceedings of the 2006 Winter Simulation Conference.

[52]  Leyuan Shi,et al.  Nested Partitions Method for Global Optimization , 2000, Oper. Res..

[53]  Michael C. Fu,et al.  Conditional Monte Carlo , 1997 .

[54]  Yaozhong Wu,et al.  Selection Procedures with Frequentist Expected Opportunity Cost Bounds , 2005, Oper. Res..

[55]  MICHAEL C. FU,et al.  Techniques for optimization via simulation: an experimental study on an (s,S) inventory system , 1997 .

[56]  R. Rubinstein,et al.  INVENTORY PROCESSES: QUASI-REGENERATIVE PROPERTY, PERFORMANCE EVALUATION, AND SENSITIVITY ESTIMATION VIA SIMULATION , 2002 .

[57]  Antonio Alonso Ayuso,et al.  Introduction to Stochastic Programming , 2009 .

[58]  Warren B. Powell,et al.  Approximate Dynamic Programming: Solving the Curses of Dimensionality (Wiley Series in Probability and Statistics) , 2007 .

[59]  Ward Whitt,et al.  What you should know about queueing models to set staffing requirements in service systems , 2007 .

[60]  Paul Glasserman,et al.  Gradient Estimation Via Perturbation Analysis , 1990 .

[61]  Leyuan Shi,et al.  Nested Partitions Optimization , 2009, Encyclopedia of Optimization.

[62]  Yu-Chi Ho,et al.  Ordinal optimization of DEDS , 1992, Discret. Event Dyn. Syst..

[63]  Leyuan Shi,et al.  Nested Partitions Method for Stochastic Optimization , 2000 .

[64]  M. Fu,et al.  (s, S) Inventory Systems with Random Lead Times: Harris Recurrence and Its Implications in Sensitivity Analysis , 1994 .

[65]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[66]  Charles Leake,et al.  Discrete Event Systems: Sensitivity Analysis and Stochastic Optimization by the Score Function Method , 1994 .

[67]  Loo Hay Lee,et al.  Optimal computing budget allocation for multi-objective simulation models , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[68]  M. Fu,et al.  Optimization of( s, S ) inventory systems with random lead times and a service level constraint , 1998 .

[69]  Christos G. Cassandras,et al.  Ordinal optimisation and simulation , 2000, J. Oper. Res. Soc..

[70]  A. Tamhane.  Design and Analysis of Experiments for Statistical Selection, Screening, and Multiple Comparisons , 1995 .

[71]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[72]  R. H. Smith.  Optimization for Simulation : Theory vs . Practice , 2002 .

[73]  Chun-Hung Chen,et al.  Optimal computing budget allocation under correlated sampling , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[74]  Alexander Shapiro,et al.  The Sample Average Approximation Method for Stochastic Discrete Optimization , 2002, SIAM J. Optim..

[75]  Stephen E. Chick,et al.  New Procedures to Select the Best Simulated System Using Common Random Numbers , 2001, Manag. Sci..