Integrated Variance Reduction Strategies for Simulation

We develop strategies for integrated use of certain well-known variance reduction techniques to estimate a mean response in a finite-horizon simulation experiment. The building blocks for these integrated variance reduction strategies are the techniques of conditional expectation, correlation induction including antithetic variates and Latin hypercube sampling, and control variates; all pairings of these techniques are examined. For each integrated strategy, we establish sufficient conditions under which that strategy will yield a smaller response variance than its constituent variance reduction techniques will yield individually. We also provide asymptotic variance comparisons between many of the methods discussed, with emphasis on integrated strategies that incorporate Latin hypercube sampling. An experimental performance evaluation reveals that in the simulation of stochastic activity networks, substantial variance reductions can be achieved with these integrated strategies. Both the theoretical and experimental results indicate that superior performance is obtained via joint application of the techniques of conditional expectation and Latin hypercube sampling.

[1]  Athanassios N. Avramidis,et al.  Simulation of stochastic activity networks using path control variates , 1991 .

[2]  B. Jørgensen,et al.  The theory of linear models , 1995 .

[3]  Arjun K. Gupta The Theory of Linear Models and Multivariate Analysis , 1981 .

[4]  Stephen S. Lavenberg,et al.  Statistical Results on Control Variables with Application to Queueing Network Simulation , 1982, Oper. Res..

[5]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[6]  Vidyadhar G. Kulkarni,et al.  Exact cuts in networks , 1989, Networks.

[7]  Lee W. Schruben,et al.  Pseudorandom Number Assignment in Statistically Designed Simulation and Distribution Sampling Experiments , 1978 .

[8]  John M. Burt,et al.  Conditional Monte Carlo: A Simulation Technique for Stochastic Network Analysis , 1971 .

[9]  Athanassios N. Avramidis,et al.  Integrated variance reduction strategies , 1993, WSC '93.

[10]  T. W. Anderson An Introduction to Multivariate Statistical Analysis, 2nd Edition. , 1985 .

[11]  Athanassios N. Avramidis Variance reduction techniques for simulation with applications to stochastic networks , 1993 .

[12]  Pierre L'Ecuyer,et al.  Efficiency improvement and variance reduction , 1994, Proceedings of Winter Simulation Conference.

[13]  Barry L. Nelson,et al.  Control Variate Remedies , 1990, Oper. Res..

[14]  T. W. Anderson An Introduction to Multivariate Statistical Analysis , 1959 .

[15]  Salah E. Elmaghraby,et al.  Activity networks: Project planning and control by network models , 1977 .

[16]  W. Whitt Bivariate Distributions with Given Marginals , 1976 .

[17]  J. Tew,et al.  Strategies for combining antithetic variates and control variates in designed simulation experiments , 1994 .

[18]  Richard Loulou,et al.  A Comparison Of Variance Reducing Techniques In Pert Simulations , 1976 .

[19]  James R. Wilson,et al.  A splitting scheme for control variates , 1993, Oper. Res. Lett..

[20]  James R. Wilson,et al.  Estimation of multiresponse simulation metamodels using control variates , 1989 .

[21]  James J. Solberg,et al.  The Stochastic Shortest Route Problem , 1980, Oper. Res..

[22]  James R. Wilson Variance Reduction Techniques for Digital Simulation , 1984 .

[23]  I. D. Hill,et al.  Applied Statistics Algorithms. , 1985 .

[24]  S. R. Searle,et al.  Matrix Algebra Useful for Statistics , 1982 .

[25]  James M. Antill,et al.  Critical path methods in construction practice , 1970 .

[26]  I. D. Hill,et al.  Applied Statistics Algorithms. , 1985 .

[27]  M. Stein Large sample properties of simulations using latin hypercube sampling , 1987 .

[28]  Jack P. C. Kleijnen Antithetic Variates, Common Random Numbers and Optimal Computer Time Allocation in Simulation , 1975 .

[29]  D. P. Gaver,et al.  Simple stochastic networks: Some problems and procedures , 1970 .

[30]  J. Kingman A FIRST COURSE IN STOCHASTIC PROCESSES , 1967 .

[31]  George S. Fishman,et al.  Monte Carlo, control variates, and stochastic ordering , 1989 .

[32]  A. Owen A Central Limit Theorem for Latin Hypercube Sampling , 1992 .

[33]  E. Lehmann Some Concepts of Dependence , 1966 .

[34]  D. Rogers,et al.  Variance-Reduction Techniques , 1988 .

[35]  Ronald W. Wolff,et al.  Stochastic Modeling and the Theory of Queues , 1989 .

[36]  C. O'Connor An introduction to multivariate statistical analysis: 2nd edn. by T. W. Anderson. 675 pp. Wiley, New York (1984) , 1987 .

[37]  P. Bickel,et al.  Mathematical Statistics: Basic Ideas and Selected Topics , 1977 .

[38]  B. Nelson,et al.  A perspective on variance reduction in dynamic simulation experiments , 1987 .

[39]  James R. Wilson,et al.  Validation of Simulation Analysis Methods for the Schruben-Margolin Correlation-Induction Strategy , 1992, Oper. Res..

[40]  James R. Wilson,et al.  Estimating simulation metamodels using combined correlation-based variance reduction techniques , 1994 .

[41]  Samuel Karlin,et al.  A First Course on Stochastic Processes , 1968 .