Improved batching for confidence interval construction in steady-state simulation

We describe an improved batch-means procedure for building a confidence interval on a steady-state expected simulation response that is centered on the sample mean of a portion of the corresponding simulation-generated time series and satisfies a user-specified absolute or relative precision requirement. The theory supporting the new algorithm merely requires the output process to be weakly dependent (phi-mixing) so that for a sufficiently large batch size, the batch means are approximately multivariate normal but not necessarily uncorrelated. A variant of the method of nonoverlapping batch means (NOBM), the Automated Simulation Analysis Procedure (ASAP) operates as follows: the batch size is progressively increased until either: the batch means pass the von Neumann test for independence, and then ASAP delivers a classical NOBM confidence interval; or the batch means pass the Shapiro-Wilk test for multivariate normality, and then ASAP delivers a corrected confidence interval. The latter correction is based on an inverted Cornish-Fisher expansion for the classical NOBM t-ratio, where the terms of the expansion are estimated via an autoregressive-moving average time series model of the batch means. An experimental performance evaluation demonstrates the advantages of ASAP versus other widely used batch-means procedures.

[1]  James R. Wilson,et al.  Validation of Simulation Analysis Methods for the Schruben-Margolin Correlation-Induction Strategy , 1992, Oper. Res..

[2]  George S. Fishman,et al.  LABATCH.2: software for statistical analysis of simulation sample path data , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).

[3]  James R. Wilson,et al.  Improved batching for confidence interval construction in steady-state simulation , 1999, WSC'99. 1999 Winter Simulation Conference Proceedings. 'Simulation - A Bridge to the Future' (Cat. No.99CH37038).

[4]  J. P. Royston,et al.  Algorithm AS 181: The W Test for Normality , 1982 .

[5]  George S. Fishman,et al.  An Implementation of the Batch Means Method , 1997, INFORMS J. Comput..

[6]  J. Royston An Extension of Shapiro and Wilk's W Test for Normality to Large Samples , 1982 .

[7]  J. Neumann Distribution of the Ratio of the Mean Square Successive Difference to the Variance , 1941 .

[8]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[9]  Ronald L. Wasserstein,et al.  Monte Carlo: Concepts, Algorithms, and Applications , 1997 .

[10]  M. Kendall,et al.  Kendall's advanced theory of statistics , 1995 .

[11]  Peter Hall,et al.  Inverting an Edgeworth Expansion , 1983 .

[12]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .

[13]  Chiahon Chien Small-sample theory for steady state confidence intervals , 1988, 1988 Winter Simulation Conference Proceedings.

[14]  Chiahon Chien Small-sample theory for steady state confidence intervals , 1988, WSC '88.

[15]  W. Whitt Planning queueing simulations , 1989 .

[16]  A. Afifi,et al.  On Tests for Multivariate Normality , 1973 .

[17]  G. S. Fishman Grouping Observations in Digital Simulation , 1978 .