Statistical analysis of simulation output data

This paper is a tutorial paper on how to obtain point estimates and confidence intervals of steady state means of simulation output data. The methods of using replications, batch means, and regenerative cycles for obtaining these point and interval estimates are discussed in detail and are applied to a simple time-shared computer model to illustrate their use. A brief discussion is included on using time series methods to obtain these estimates. The advantages and disadvantages of the various methods are given, including specific recommendations as to when certain methods might be used.

[1]  Arch William Hunt,et al.  Statistical evaluation and verification of digital simulation models through spectral analysis , 1970 .

[2]  Robert E. Shannon,et al.  Simulation: A Survey with Research Suggestions , 1975 .

[3]  Thomas H. Naylor,et al.  Experimental Designs for Computer Simulation Experiments , 1970 .

[4]  George S. Fishman,et al.  The Analysis of Simulation-Generated Time Series , 1967 .

[5]  D. G. Watts,et al.  Spectral analysis and its applications , 1968 .

[6]  F. David,et al.  Statistical Techniques in Simulation: Part I , 1975 .

[7]  Michael A. Crane,et al.  Simulating Stable Stochastic Systems, I: General Multiserver Queues , 1974, JACM.

[8]  D. Iglehart.  Simulating stable stochastic systems, V: Comparison of ratio estimators , 1975 .

[9]  Donald L. Iglehart,et al.  Simulating Stable Stochastic Systems, VI: Quantile Estimation , 1976, JACM.

[10]  Michael A. Crane,et al.  Simulating Stable Stochastic Systems, II: Markov Chains , 1974, JACM.

[11]  Herbert Maisel,et al.  Simulation of discrete stochastic systems , 1972 .

[12]  Robert E. Shannon,et al.  Simulation modeling and methodology , 1976, WSC '76.

[13]  Stephen S. Lavenberg,et al.  Introduction to Regenerative Simulation , 1975, IBM J. Res. Dev..

[14]  W. Sasser,et al.  Computer Simulation Experiments with Economic Systems: The Problem of Experimental Design , 1967 .

[15]  Thomas Herbert Naylor.  Computer Simulation Techniques , 1966 .

[16]  Paul Gray,et al.  A decision-tree framework for estimating the costs of simulation , 1976 .

[17]  Richard W. Conway,et al.  Some Tactical Problems in Digital Simulation , 1963 .

[18]  Jean E. Sammet,et al.  Programming languages: history and future , 1972, CACM.

[19]  Michael A. Crane,et al.  Simulating Stable Stochastic Systems, IV: Approximation Techniques , 1975 .

[20]  Robert G. Sargent,et al.  A Statistical Evaluation of the Scheduler of an Experimental Interactive Computing System , 1972, Statistical Computer Performance Evaluation.

[21]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[22]  George S. Fishman,et al.  Solution of Large Networks by Matrix Methods , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[23]  Benjamin Avi-Itzhak,et al.  A Time-Sharing Queue with a Finite Number of Customers , 1969, JACM.

[24]  Michael A. Crane,et al.  Simulating Stable Stochastic Systems: III. Regenerative Processes and Discrete-Event Simulations , 1975, Oper. Res..

[25]  Mary S. Brisley.  “Continued” , 1924 .

[26]  James R. Emshoff,et al.  Design and use of computer simulation models , 1970 .

[27]  Robert G. Sargent,et al.  Investigation Into Scheduling for an Interactive Computing System , 1974, IBM J. Res. Dev..

[28]  J. D. Johannes,et al.  Systems Simulation: The Art and Science , 1975, IEEE Transactions on Systems, Man, and Cybernetics.