Efficient Computation of Overlapping Variance Estimators for Simulation

For a steady-state simulation output process, we formulate efficient algorithms to compute certain estimators of the process variance parameter (i.e., the sum of covariances at all lags), where the estimators are derived in principle from overlapping batches separately and then averaged over all such batches. The algorithms require order-of-sample-size work to evaluate overlapping versions of the area and Cramer--von Mises estimators arising in the method of standardized time series. Recently, Alexopoulos et al. showed that, compared with estimators based on nonoverlapping batches, the estimators based on overlapping batches achieve reduced variance while maintaining similar bias asymptotically as the batch size increases. We provide illustrative analytical and Monte Carlo results for M/M/1 queue waiting times and for a first-order autoregressive process. We also present evidence that the asymptotic distribution of each overlapping variance estimator can be closely approximated using an appropriately rescaled chi-squared random variable with matching mean and variance.

[1]  Ward Whitt,et al.  Estimating the asymptotic variance with batch means , 1991, Oper. Res. Lett..

[2]  G. Box Some Theorems on Quadratic Forms Applied in the Study of Analysis of Variance Problems, I. Effect of Inequality of Variance in the One-Way Classification , 1954 .

[3]  James R. Wilson,et al.  Convergence Properties of the Batch Means Method for Simulation Output Analysis , 2001, INFORMS J. Comput..

[4]  Pierre L'Ecuyer,et al.  Good Parameters and Implementations for Combined Multiple Recursive Random Number Generators , 1999, Oper. Res..

[5]  Keebom Kang,et al.  Cramér-von Mises variance estimators for simulations , 1991, WSC '91.

[6]  Keebom Kang,et al.  An Investigation of Finite-Sample Behavior of Confidence Interval Estimators , 1992, Oper. Res..

[7]  F. E. Satterthwaite Synthesis of variance , 1941 .

[8]  B. Schmeiser,et al.  Optimal mean-squared-error batch sizes , 1995 .

[9]  Lee W. Schruben,et al.  Confidence Interval Estimation Using Standardized Time Series , 1983, Oper. Res..

[10]  Emily K. Lada,et al.  ASAP3: a batch means procedure for steady-state simulation analysis , 2005, TOMC.

[11]  A. Bowker,et al.  Statistical Theory with Engineering Applications. , 1953 .

[12]  L. Schruben,et al.  Properties of standardized time series weighted area variance estimators , 1990 .

[13]  B. L. Welch On Linear Combinations of Several Variances , 1956 .

[14]  James R. Wilson,et al.  Overlapping Variance Estimators for Simulation , 2007, Oper. Res..

[15]  David Goldsman,et al.  Overlapping variance estimators for simulations , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[16]  Bruce W. Schmeiser,et al.  Batch Size Effects in the Analysis of Simulation Output , 1982, Oper. Res..

[17]  Bruce W. Schmeiser,et al.  Overlapping batch means: something for nothing? , 1984, WSC '84.

[18]  David Goldsman,et al.  Confidence intervals using orthonormally weighted standardized time series , 1999, TOMC.