Performance evaluation of a wavelet-based spectral method for steady-state simulation analysis

We summarize the results of an experimental performance evaluation of WASSP, an automated wavelet-based spectral method for constructing an approximate confidence interval on the steady-state mean of a simulation output process so that the delivered confidence interval satisfies user-specified requirements on absolute or relative precision as well as coverage probability. We applied WASSP to test problems designed specifically to explore its efficiency and robustness in comparison with ASAP3 and the Heidelberger-Welch algorithm, two sequential procedures based respectively on the methods of nonoverlapping batch means and spectral analysis. Concerning efficiency, WASSP compared favorably with its competitors, often requiring smaller sample sizes to deliver confidence intervals with the same nominal levels of precision and coverage probability. Concerning robustness against the statistical anomalies commonly encountered in simulation studies, WASSP outperformed its competitors, delivering confidence intervals whose actual half-lengths and coverage probabilities were frequently closer to the corresponding user-specified nominal levels.

[1]  Nouna Kettaneh,et al.  Statistical Modeling by Wavelets , 1999, Technometrics.

[2]  J. Neumann.  Distribution of the Ratio of the Mean Square Successive Difference to the Variance , 1941 .

[3]  S. Shapiro,et al.  An Analysis of Variance Test for Normality (Complete Samples) , 1965 .

[4]  Emily K. Lada,et al.  A wavelet-based spectral procedure for steady-state simulation analysis , 2006, Eur. J. Oper. Res..

[5]  Sheldon M. Ross,et al.  Stochastic Processes , 2018, Gauge Integral Structures for Stochastic Calculus and Quantum Electrodynamics.

[6]  Hong-Ye Gao,et al.  Applied wavelet analysis with S-plus , 1996 .

[7]  Emily K. Lada,et al.  ASAP3: a batch means procedure for steady-state simulation analysis , 2005, TOMC.

[8]  M. Fernandez-Veiga,et al.  A batch means procedure for mean value estimation of processes exhibiting long range dependence , 2002, Proceedings of the Winter Simulation Conference.

[9]  Philip Heidelberger,et al.  A spectral method for confidence interval generation and run length control in simulations , 1981, CACM.

[10]  N. L. Johnson,et al.  Continuous Univariate Distributions. , 1995 .

[11]  Andrés Suárez-González,et al.  New simulation output analysis techniques: a batch means procedure for mean value estimation of processes exhibiting long range dependence , 2002, WSC '02.

[12]  Philip Heidelberger,et al.  Simulation Run Length Control in the Presence of an Initial Transient , 1983, Oper. Res..

[13]  A. Winsor.  Sampling techniques. , 2000, Nursing times.

[14]  D. Goldsman,et al.  ASAP2: an improved batch means procedure for simulation output analysis , 2002, Proceedings of the Winter Simulation Conference.

[15]  E. Lada,et al.  A Wavelet-Based Procedure for Steady-State Simulation Output Analysis , 2003 .

[16]  Hong-ye Gao.  Choice of thresholds for wavelet shrinkage estimate of the spectrum , 1997 .

[17]  P. Heidelberger,et al.  Adaptive spectral methods for simulation output analysis , 1981 .