Some examples of simulation model validation using hypothesis testing

The use of hypothesis testing with cost-risk analysis is illustrated for simulation model validation by two examples. In the first example, Hotelling's two-sample T<sup>2</sup> test with cost-risk analysis is used for illustrating the validation of a multivariate response self-driven steady-state simulation model representing a single server M/M/1 queueing system. In the second example, the validation of a multivariate response trace-driven terminating simulation model representing an M/M/1 system is illustrated by the use of Hotelling's one-sample T<sup>2</sup> test with cost-risk analysis.

[1]  I. A. Chaikovsky,et al.  Terminology for model credibility , 1979 .

[2]  Hisashi Kobayashi,et al.  Modeling and analysis , 1978 .

[3]  Robert Earl Schellenberger,et al.  CRITERIA FOR ASSESSING MODEL VALIDITY FOR MANAGERIAL PURPOSES , 1974 .

[4]  H. Theil,et al.  Economic Forecasts and Policy. , 1959 .

[5]  James R. Emshoff,et al.  Design and use of computer simulation models , 1970 .

[6]  Ian I. Mitroff.  Fundamental Issues in the Simulation of Human Behavior: A Case in the Strategy of Behavioral Science , 1969 .

[7]  Lee W. Schruben,et al.  Establishing the credibility of simulations , 1980 .

[8]  H. Theil,et al.  Economic Forecasts and Policy. , 1959 .

[9]  Osman Balci,et al.  A methodology for cost-risk analysis in the statistical validation of simulation models , 1981, CACM.

[10]  Reuven Y. Rubinstein,et al.  Simulation and the Monte Carlo method , 1981, Wiley series in probability and mathematical statistics.

[11]  Osman Balci,et al.  A METHODOLOGY FOR VALIDATING MULTIVARIATE RESPONSE SIMULATION MODELS BY USING SIMULTANEOUS CONFIDENCE INTERVALS , 1981 .

[12]  Toby J. Teorey,et al.  Validation criteria for computer system simulations , 1975, ANSS '75.

[13]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[14]  BalciOsman,et al.  A methodology for cost-risk analysis in the statistical validation of simulation models , 1981 .

[15]  R. Cyert,et al.  Computer Models in Dynamic Economics , 1961 .

[16]  Thomas P Tytula.  A Method for Validating Missile System Simulation Models. , 1978 .

[17]  Arch William Hunt,et al.  Statistical evaluation and verification of digital simulation models through spectral analysis , 1970 .

[18]  James R. Rowland,et al.  Simulation validation with sparse random data , 1978 .

[19]  George S. Fishman,et al.  On validation of simulation models , 1973, AFIPS National Computer Conference.

[20]  M. J. Damborg,et al.  Model validation using time and frequency domain error measures , 1976 .

[21]  George S. Fishman,et al.  The Analysis of Simulation-Generated Time Series , 1967 .

[22]  C F Hermann.  Validation problems in games and simulations with special reference to models of international politics. , 1967, Behavioral science.

[23]  Reuven Y. Rubinstein,et al.  Simulation and the Monte Carlo Method , 1981 .

[24]  Richard L. Van Horn,et al.  Validation of Simulation Results , 1971 .

[25]  Osman Balci,et al.  Validation of multivariate response models using Hotelling's two-sample T2 test , 1982 .

[26]  Dennis J. Aigner,et al.  A Note on Verification of Computer Simulation Models , 1972 .

[27]  Gunnar Abrahamson,et al.  Terminology for model credibility , 1980 .

[28]  D. R. Miller,et al.  Sensitivity analysis and validation of simulation models , 1974 .

[29]  Willard M. Holmes,et al.  On validating simulation models of missile systems , 1978 .

[30]  J. D. Johannes,et al.  Systems Simulation: The Art and Science , 1975, IEEE Transactions on Systems, Man, and Cybernetics.

[31]  J. W. Evans,et al.  Time Series Realizations Obtained According to an Experimental Design , 1974 .

[32]  G. S. Fishman.  Principles of Discrete Event Simulation , 1978 .

[33]  Osman Balci,et al.  Validation fo Multivariate Response Trace-driven Simulation Models , 1983, Performance.

[34]  C. J. Ancker,et al.  Mean Value Estimation from Digital Computer Simulation , 1966, Oper. Res..

[35]  Stephen W. Sherman,et al.  Trace Driven modeling: An update , 1976, ANSS '76.

[36]  A. Law.  Statistical Analysis of the Output Data from Terminating Simulations. , 1980 .

[37]  A. V. Gafarian,et al.  STATISTICAL APPROACH FOR VALIDATING SIMULATION MODELS BY COMPARISON WITH OPERATIONAL SYSTEMS-ILLUSTRATED FOR TRAFFIC FLOW. , 1966 .