Single-experiment input uncertainty

Abstract‘Input uncertainty’ refers to the simulation model risk caused by estimating input distributions from real-world data, and specifically the (usually unmeasured) variance in performance estimates that this introduces. We provide the first single-run method for quantifying input uncertainty, meaning that we derive our measure of input-uncertainty variance—both overall variance and the contribution to it of each input model—from the nominal experiment that the analyst would typically run using the estimated input models; other methods in the literature require additional diagnostic experiments. Application of our method is illustrated with two examples.

[1]  Bruce W. Schmeiser,et al.  Batch Size Effects in the Analysis of Simulation Output , 1982, Oper. Res..

[2]  Ward Whitt,et al.  Chapter 13 Analysis for Design , 2006, Simulation.

[3]  Barry L. Nelson,et al.  Advanced tutorial: Input uncertainty quantification , 2014, Proceedings of the Winter Simulation Conference 2014.

[4]  R. R. Barton,et al.  Tutorial: Input uncertainty in outout analysis , 2012, Proceedings Title: Proceedings of the 2012 Winter Simulation Conference (WSC).

[5]  R. Cheng,et al.  Sensitivity of computer simulation experiments to errors in input data , 1997 .

[6]  Michael C. Fu,et al.  Handbook of Simulation Optimization , 2014 .

[7]  Barry L. Nelson,et al.  A quicker assessment of input uncertainty , 2013, 2013 Winter Simulations Conference (WSC).

[8]  M. Fu Stochastic Gradient Estimation , 2005 .

[9]  Bruce W. Schmeiser,et al.  Stochastic Gradient Estimation using a Single Design Point , 2006, Proceedings of the 2006 Winter Simulation Conference.

[10]  R. Cheng,et al.  Two-point methods for assessing variability in simulation output , 1998 .

[11]  Barry L. Nelson,et al.  Foundations and Methods of Stochastic Simulation: A First Course , 2013 .

[12]  Russell C. H. Cheng,et al.  Calculation of confidence intervals for simulation output , 2004, TOMC.

[13]  Barry L. Nelson,et al.  Foundations and Methods of Stochastic Simulation , 2021, International Series in Operations Research & Management Science.

[14]  Barry L. Nelson,et al.  Quickly Assessing Contributions to Input Uncertainty , 2015 .