Simulation Optimization in the CTDS Domain

In this chapter the optimization task is examined within the DEDS modelling and simulation context. Because of the inherent random behaviour within DEDS simulation models it is noted that the criterion function itself is a random variable and consequently its meaningful evaluation for any particular parameter vector selection requires multiple replications and an associated averaging operation. The number of such replications that are carried out can impact the outcome of the optimization procedure. A considerable variety of approaches have emerged for dealing with the optimization task when random effects are present. These can be separated into general categories and four such categories are identified and their special features are briefly outlined. These are heuristic methods inasmuch as access to the meaningful gradient information is, for the most part, not feasible. A case study is presented to illustrate some of the special challenges that can be encountered. The problem has seven parameters but each is constrained to a small integer range. The simulation model itself has steady state requirements and consequently a “warm-up” period is necessarily embedded in experimentation phase. Optimization results for the problem are generated using the Nelder-Mead method (outlined in Chap. 10) but with significant modifications to accommodate both the integer constraint on parameter values and their restricted range of permitted values. Because of these constraints on the parameter values, the search space is relatively small and the results of an exhaustive search over that space are also presented.

[1]  L. G. Birta,et al.  Some stepsize adjustment procedures for parallel ODE solvers , 1995 .

[2]  Virginia Torczon,et al.  On the Convergence of Pattern Search Algorithms , 1997, SIAM J. Optim..

[3]  Louis G. Birta,et al.  Optimization in Simulation Studies , 1984 .

[4]  Kuo-Hao Chang,et al.  Stochastic Nelder-Mead simplex method - A new globally convergent direct search method for simulation optimization , 2012, Eur. J. Oper. Res..

[5]  Richard W. Eglese,et al.  Simulated annealing: A tool for operational research , 1990 .

[6]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[7]  Thomas Bäck,et al.  An Overview of Evolutionary Algorithms for Parameter Optimization , 1993, Evolutionary Computation.

[8]  Rommert Dekker,et al.  A framework for Response Surface Methodology for simulation optimization , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[9]  Fred Glover,et al.  Tabu Search - Part II , 1989, INFORMS J. Comput..

[10]  L. G. Birta,et al.  A comparative evaluation of the BPC and PPC methods for the parallel solution of ode's , 1990 .

[11]  H. A. Watts,et al.  Block Implicit One-Step Methods* , 1969 .

[12]  Robert Hooke,et al.  `` Direct Search'' Solution of Numerical and Statistical Problems , 1961, JACM.

[13]  Hans P. Geering,et al.  Optimal control with engineering applications , 2007 .

[14]  Louis G. Birta,et al.  A parameter optimization module for CSSL-based simulation software , 1977 .

[15]  Nikolaos V. Sahinidis,et al.  Simulation optimization: a review of algorithms and applications , 2014, 4OR.

[16]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[17]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[18]  Sheldon Howard Jacobson,et al.  The Theory and Practice of Simulated Annealing , 2003, Handbook of Metaheuristics.

[19]  J. S. Ivey,et al.  Nelder-Mead simplex modifications for simulation optimization , 1996 .

[20]  Frank L. Lewis,et al.  Optimal Control: Lewis/Optimal Control 3e , 2012 .

[21]  Averill M. Law,et al.  Simulation optimization: simulation-based optimization , 2002, WSC '02.

[22]  Shalabh Bhatnagar,et al.  A Discrete Parameter Stochastic Approximation Algorithm for Simulation Optimization , 2005, Simul..

[23]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[24]  Kevin W. Cassel Variational Methods with Applications in Science and Engineering: Frontmatter , 2013 .

[25]  Fred W. Glover,et al.  Simulation optimization: a review, new developments, and applications , 2005, Proceedings of the Winter Simulation Conference, 2005..

[26]  Peter B. Worland,et al.  Parallel Methods for the Numerical Solution of Ordinary Differential Equations , 1976, IEEE Transactions on Computers.

[27]  Michael C. Fu,et al.  History of seeking better solutions, AKA simulation optimization , 2017, 2017 Winter Simulation Conference (WSC).

[28]  Louis G. Birta,et al.  A sequential refinement approach for parameter optimization in continuous dynamic models , 1986 .

[29]  Louis G. Birta,et al.  Parallel Block Predictor–Corrector Methods for Ode's , 1987, IEEE Transactions on Computers.

[30]  G. Thompson,et al.  Optimal Control Theory: Applications to Management Science and Economics , 2000 .

[31]  Charles D. McAllister,et al.  Implementation of response surface methodology using variance reduction techniques in semiconductor manufacturing , 2001, Proceeding of the 2001 Winter Simulation Conference (Cat. No.01CH37304).

[32]  Michael C. Fu,et al.  Feature Article: Optimization for simulation: Theory vs. Practice , 2002, INFORMS J. Comput..

[33]  Mark A. Franklin,et al.  Parallel Solution of Ordinary Differential Equations , 1978, IEEE Transactions on Computers.

[34]  Michael C. Fu,et al.  Handbook of Simulation Optimization , 2014 .

[35]  Hanif D. Sherali,et al.  An enhanced response surface methodology (RSM) algorithm using gradient deflection and second-order search strategies , 1998, Comput. Oper. Res..