Performance of a Wavelet-Based Spectral Procedure for Steady-State Simulation Analysis

A summary and an analysis are given for an experimental performance evaluation of WASSP, an automated wavelet-based spectral method for constructing an approximate confidence interval on the steady-state mean of a simulation output process such that the delivered confidence interval satisfies user-specified requirements on absolute or relative precision as well as coverage probability. The experimentation involved three difficult test problems, each with an output process exhibiting some combination of the following characteristics: a long warm-up period, a persistent autocorrelation structure, or a highly nonnormal marginal distribution. These problems were used to compare the performance of WASSP with that of the Heidelberger-Welch algorithm and ASAP3, two sequential procedures based respectively on the methods of spectral analysis and nonoverlapping batch means. Concerning efficiency (required sample sizes) and robustness against the statistical anomalies commonly encountered in simulation studies, WASSP outperformed the Heidelberger-Welch procedure and compared favorably with ASAP3.

[1]  E. Lada,et al.  A Wavelet-Based Procedure for Steady-State Simulation Output Analysis , 2003 .

[2]  Natalie M. Steiger,et al.  Output analysis: ASAP2: an improved batch means procedure for simulation output analysis , 2002, WSC '02.

[3]  Krzysztof Pawlikowski,et al.  Steady-state simulation of queueing processes: survey of problems and solutions , 1990, CSUR.

[4]  P. Heidelberger,et al.  Adaptive spectral methods for simulation output analysis , 1981 .

[5]  J. Neumann.  Distribution of the Ratio of the Mean Square Successive Difference to the Variance , 1941 .

[6]  S. Shapiro,et al.  An Analysis of Variance Test for Normality (Complete Samples) , 1965 .

[7]  Philip Heidelberger,et al.  A spectral method for confidence interval generation and run length control in simulations , 1981, CACM.

[8]  Emily K. Lada,et al.  ASAP3: a batch means procedure for steady-state simulation analysis , 2005, TOMC.

[9]  D. Goldsman,et al.  ASAP2: an improved batch means procedure for simulation output analysis , 2002, Proceedings of the Winter Simulation Conference.

[10]  T. W. Anderson,et al.  Asymptotic Theory of Certain "Goodness of Fit" Criteria Based on Stochastic Processes , 1952 .

[11]  Philip Heidelberger,et al.  Simulation Run Length Control in the Presence of an Initial Transient , 1983, Oper. Res..

[12]  Emily K. Lada,et al.  Performance evaluation of a wavelet-based spectral method for steady-state simulation analysis , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[13]  Emily K. Lada,et al.  A wavelet-based spectral procedure for steady-state simulation analysis , 2006, Eur. J. Oper. Res..

[14]  E.K. Lada,et al.  A wavelet-based spectral method for steady-state simulation analysis , 2003, Proceedings of the 2003 Winter Simulation Conference, 2003..