A statistical process control approach to selecting a warm-up period for a discrete-event simulation

The selection of a warm-up period for a discrete-event simulation continues to be problematic. A variety of selection methods have been devised, and are briefly reviewed. It is apparent that no one method can be recommended above any other. A new approach, based upon the principles of statistical process control, is described (SPC method). Because simulation output data are often highly autocorrelated and potentially non-normal, the batch means method is employed in constructing the control chart. The SPC method is tested on seven data sets and encouraging results are obtained concerning its accuracy. The approach is also discussed with respect to its ease of implementation, simplicity, generality of use and requirements for parameter estimation.

[1]  George Vassilacopoulos.  Testing for initialization bias in simulation output , 1989, Simul..

[2]  D. Darling,et al.  A Test of Goodness of Fit , 1954 .

[3]  Gavriel Salvendy,et al.  Handbook of industrial engineering , 2001 .

[4]  Marion R. Reynolds,et al.  EWMA CONTROL CHARTS FOR MONITORING THE MEAN OF AUTOCORRELATED PROCESSES , 1999 .

[5]  George S. Fishman,et al.  Estimating Sample Size in Computing Simulation Experiments , 1971 .

[6]  Stewart Robinson,et al.  Simulation: The Practice of Model Development and Use , 2004 .

[7]  Ronald L. Wasserstein,et al.  Monte Carlo: Concepts, Algorithms, and Applications , 1997 .

[8]  J. Banks,et al.  Discrete-Event System Simulation , 1995 .

[9]  K. Preston White,et al.  A comparison of five steady-state truncation heuristics for simulation , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[10]  Emily Roth.  The relaxation time heuristic for the initial transient problem in M/M/k queueing systems , 1994 .

[11]  Ralph B. D'Agostino,et al.  Goodness-of-Fit-Techniques , 2020 .

[12]  James R. Wilson,et al.  A survey of research on the simulation startup problem , 1978 .

[13]  John E. Freund,et al.  Probability and statistics for engineers , 1965 .

[14]  B. W. Ang,et al.  A SPC Procedure for Detecting Level Shifts of Autocorrelated Processes , 1998 .

[15]  Krzysztof Pawlikowski,et al.  Steady-state simulation of queueing processes: survey of problems and solutions , 1990, CSUR.

[16]  Barry L. Nelson,et al.  Statistical Analysis of Simulation Results , 2007 .

[17]  J. Neumann.  Distribution of the Ratio of the Mean Square Successive Difference to the Variance , 1941 .

[18]  Layth C. Alwan,et al.  TIME-SERIES INVESTIGATION OF SUBSAMPLE MEAN CHARTS , 1992 .

[19]  K. Preston White,et al.  An Effective Truncation Heuristic for Bias Reduction in Simulation Output , 1997, Simul..

[20]  George C. Runger,et al.  Batch-means control charts for autocorrelated data , 1996 .

[21]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[22]  Lee W. Schruben,et al.  Optimal Tests for Initialization Bias in Simulation Output , 1983, Oper. Res..

[23]  Eric R. Zieyel.  Operations research : applications and algorithms , 1988 .

[24]  Richard W. Conway,et al.  Some Tactical Problems in Digital Simulation , 1963 .

[25]  Lee W. Schruben,et al.  Detecting Initialization Bias in Simulation Output , 1982, Oper. Res..

[26]  Averill M. Law,et al.  A new approach for dealing with the startup problem in discrete event simulation , 1983 .

[27]  Geoffrey Gordon,et al.  System Simulation , 1970 .

[28]  Christos Alexopoulos,et al.  Output Data Analysis , 2007 .

[29]  C. J. Ancker,et al.  Evaluation of commonly used rules for detecting “steady state” in computer simulation , 1978 .

[30]  Douglas C. Montgomery,et al.  Applied Statistics and Probability for Engineers, Third edition , 1994 .

[31]  J. J. Swain,et al.  Tests for transient means in simulated time series , 1994 .

[32]  Russell R. Barton,et al.  Proceedings of the 2000 winter simulation conference , 2000 .

[33]  J. Banks,et al.  Handbook of Simulation , 1998 .

[34]  George S. Fishman,et al.  Solution of Large Networks by Matrix Methods , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[35]  Enver Yücesan,et al.  Randomization tests for initialization bias in simulation output , 1993 .

[36]  G. S. Fishman.  Grouping Observations in Digital Simulation , 1978 .

[37]  Bart L. MacCarthy,et al.  Statistical process control for monitoring scheduling performance—addressing the problem of correlated data , 2001, J. Oper. Res. Soc..

[38]  Loon Ching Tang,et al.  A CUSUM Scheme for Autocorrelated Observations , 2002 .

[39]  Charles R. Cash,et al.  Evaluation of tests for initial-condition bias , 1992, WSC '92.