A perspective on variance reduction in dynamic simulation experiments

A unifying perspective on variance reduction is presented that emphasizes broadly defined variance reduction strategies rather than specific variance reduction techniques (VRTs). The perspective is based on a new taxonomy of VRTs, which is reviewed in detail. The variance reduction problem is formulated as a constrained optimization problem, and results that guarantee the effectiveness of variance reduction strategies are summarized.

[1]  R. R. P. Jackson.  Introduction to Queueing Theory , 1943 .

[2]  W. G. Madow.  On the Theory of Systematic Sampling, II , 1944 .

[3]  W. G. Madow.  On the Theory of Systematic Sampling, III. Comparison of Centered and Random Start Systematic Sampling , 1953 .

[4]  J. G. Mauldon,et al.  General principles of antithetic variates , 1956, Mathematical Proceedings of the Cambridge Philosophical Society.

[5]  J. M. Hammersley,et al.  Proof of the antithetic variates theorem for n > 2 , 1958 .

[6]  Maurice G. Kendall,et al.  The Advanced Theory of Statistics, Vol. 2: Inference and Relationship , 1979 .

[7]  V. K. Sethi,et al.  A NOTE ON OPTIMUM STRATIFICATION OF POPULATIONS FOR ESTIMATING THE POPULATION MEANS , 1963 .

[8]  J. Hammersley,et al.  Monte Carlo Methods , 1965 .

[9]  Calyampudi Radhakrishna Rao,et al.  Linear Statistical Inference and its Applications , 1967 .

[10]  Raja K. Herlekar.  The problem of optimum stratification , 1967 .

[11]  John M. Burt,et al.  Conditional Monte Carlo: A Simulation Technique for Stochastic Network Analysis , 1971 .

[12]  Averill M. Law.  Efficient estimators for simulated queueing systems , 1974 .

[13]  G. Arthur Mihram.  Blockinq in simular experimental designs , 1974 .

[14]  L. L. Carter,et al.  Particle Transport Simulation with the Monte Carlo Method; Prepared for the Division of Military Application, U.S. Energy Research and Development Administration , 1975 .

[15]  Calyampudi R. Rao,et al.  Linear Statistical Inference and Its Applications. , 1975 .

[16]  Edward Ignall,et al.  Virtual Measures: A Variance Reduction Technique for Simulation , 1975 .

[17]  Jack P. C. Kleijnen,et al.  Statistical Techniques in Simulation , 1977, IEEE Transactions on Systems, Man and Cybernetics.

[18]  Gary Simon.  Computer Simulation Swindles, with Applications to Estimates of Location and Dispersion , 1976 .

[19]  William L. Roach,et al.  Optimal antithetic sampling plans , 1977 .

[20]  Averill M. Law,et al.  Conservation equations and variance reduction in queueing simulations , 1977, WSC '77.

[21]  P. Bickel,et al.  Mathematical Statistics: Basic Ideas and Selected Topics , 1977 .

[22]  J.P.C. Kleijnen,et al.  Importance sampling in systems simulation : A practical failure? , 1979 .

[23]  Lee W. Schruben,et al.  Pseudorandom Number Assignment in Statistically Designed Simulation and Distribution Sampling Experiments , 1978 .

[24]  James R. Wilson.  Proof of the antithetic-variates theorem for unbounded functions , 1979 .

[25]  Stephen S. Lavenberg,et al.  Using conditional expectation to reduce variance in discrete event simulation , 1979, WSC '79.

[26]  Lee W. Schruben,et al.  DESIGNING CORRELATION INDUCTION STRATEGIES FOR SIMULATION EXPERIMENTS , 1979 .

[27]  James J. Solberg,et al.  The use of cutsets in Monte Carlo analysis of stochastic networks , 1979 .

[28]  BIVARIATE DISTRIBUTIONS WITH GIVEN MARGINALS AND FIXED MEASURES OF DEPENDENCE , 1979 .

[29]  Ward Whitt,et al.  Continuity of Generalized Semi-Markov Processes , 1980, Math. Oper. Res..

[30]  Reuven Y. Rubinstein,et al.  Simulation and the Monte Carlo Method , 1981 .

[31]  Stephen S. Lavenberg,et al.  A Perspective on the Use of Control Variables to Increase the Efficiency of Monte Carlo Simulations , 1981 .

[32]  Belva J. Cooley,et al.  A VARIANCE‐REDUCTION STRATEGY FOR RSM SIMULATION STUDIES , 1982 .

[33]  Stephen S. Lavenberg,et al.  Statistical Results on Control Variables with Application to Queueing Network Simulation , 1982, Oper. Res..

[34]  Shlomo Halfin.  Linear Estimators for a Class of Stationary Queueing Processes , 1982, Oper. Res..

[35]  M. Hossein Safizadeh,et al.  AN ALTERNATIVE VARIANCE‐REDUCTION STRATEGY FOR RSM SIMULATION STUDIES , 1982 .

[36]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[37]  Peter W. Glynn,et al.  On the role of generalized semi-Markov processes in simulation output analysis , 1983, WSC '83.

[38]  Belva J. Cooley,et al.  ON AN ALTERNATIVE VARIANCE‐REDUCTION STRATEGY FOR RSM SIMULATION STUDIES* , 1983 .

[39]  George S. Fishman,et al.  Antithetic variates revisited , 1983, CACM.

[40]  Linus Schrage,et al.  A guide to simulation , 1983 .

[41]  James R. Wilson.  Antithetic Sampling with Multivariate Inputs , 1983 .

[42]  Paul Bratley,et al.  A guide to simulation , 1983 .

[43]  M. Safizadeh.  MORE ON VARIANCE-REDUCTION STRATEGIES FOR RSM SIMULATION STUDIES* , 1983 .

[44]  Barry L. Nelson,et al.  Variance reduction: Basic transformations , 1983, WSC '83.

[45]  Douglas R. Miller,et al.  An importance sampling scheme for simulating the degradation and failure of complex systems during finite missions , 1983, WSC '83.

[46]  Do Le Minh,et al.  Technical Note - Simulating the GI/G/1 Queue in Heavy Traffic , 1983, Oper. Res..

[47]  Michel C. Jeruchim.  On the Application of Importance Sampling to the Simulation of Digital Satellite and Multihop Links , 1984, IEEE Trans. Commun..

[48]  ANTITHETIC VARIATES FOR MONTE CARLO ESTIMATION OF PROBABILITIES , 1984 .

[49]  C. D. Pegden,et al.  Control Variates for Multipopulation Simulation Experiments , 1984 .

[50]  J. Wilson,et al.  Experimental Evaluation of Variance Reduction Techniques for Queueing Simulation Using Generalized Concomitant Variables , 1984 .

[51]  Robert J. Wilson,et al.  Variance reduction in queueing simulation using generalized concomitant variables , 1984 .

[52]  G. S. Fishman,et al.  Sampling from a Discrete Distribution While Preserving Monotonicity , 1984 .

[53]  James R. Wilson.  Variance Reduction Techniques for Digital Simulation , 1984 .

[54]  T. Caliński,et al.  Linear Statistical Inference , 1985 .

[55]  James R. Wilson,et al.  Validation of correlation-induction strategies for simulation experiments , 1985, WSC '85.

[56]  Barry L. Nelson,et al.  A decomposition approach to variance reduction , 1985, WSC '85.

[57]  R. Rubinstein,et al.  Antithetic Variates, Multivariate Dependence and Simulation of Stochastic Systems , 1985 .

[58]  B L Nelson,et al.  Decomposition of Some Well-Known Variance Reduction Techniques. Revision. , 1985 .

[59]  ILLUSTRATION OF THE SAMPLE SPACE DEFINITION OF SIMULATION AND VARIANCE REDUCTION. , 1985 .

[60]  G. S. Fishman.  Estimating Network Characteristics in Stochastic Activity Networks , 1985 .

[61]  S. Ross,et al.  Using Simulation to Estimate First Passage Distribution , 1985 .

[62]  Reuven Y. Rubinstein,et al.  Efficiency of Multivariate Control Variates in Monte Carlo Simulation , 1985, Oper. Res..

[63]  George S. Fishman.  Estimating critical path and arc probabilities in stochastic activity networks , 1985 .

[64]  R. Cheng.  Generation of multivariate normal samples with given sample mean and covariance matrix , 1985 .

[65]  James R. Wilson,et al.  The efficiency of control variates in multiresponse simulation , 1986 .

[66]  Voratas Kachitvichyanukul,et al.  Correlation induction without the inverse transformation , 1986, WSC '86.

[67]  P. Glynn,et al.  Discrete-time conversion for simulating semi-Markov processes , 1986 .

[68]  Jack P. C. Kleijnen,et al.  Analyzing simulation experiments with common random numbers (Part I, 2nd rev. and expanded version) , 1986 .

[69]  James R. Wilson,et al.  Using control variates to estimate multiresponse simulation metamodels , 1986, WSC '86.

[70]  Barry L. Nelson,et al.  On control variate estimators , 1987, Comput. Oper. Res..

[71]  J. Kleijnen.  Analyzing simulation experiments with common random numbers , 1988 .