Verification of Computer Simulation Models

The problem of validating computer simulation models of industrial systems has received only limited attention in the management science literature. The purpose of this paper is to consider the problem of validating computer models in the light of contemporary thought in the fields of philosophy of science, economic theory, and statistics. In order to achieve this goal we have attempted to gather together and present some of the ideas of scientific philosophers, economists, statisticians, and practitioners in the field of simulation which are relevant to the problem of verifying simulation models. We have paid particular attention to the writings of economists who have been concerned with testing the validity of economic models. Among the questions which we shall consider are included: What does it mean to verify a computer model of an industrial system? Are there any differences between the verification of computer models and the verification of other types of models? If so, what are some of these differences? Also considered are a number of measures and techniques for testing the "goodness of fit" of time series generated by computer models to observed historical series.

[1]  L. Robbins,et al.  An Essay on the Nature and Significance of Economic Science. , 1934 .

[2]  M. Kendall,et al.  The Logic of Scientific Discovery. , 1959 .

[3]  I. R. Savage.  Handbook of Nonparametric Statistics II: Results for Two and Several Sample Problems, Symmetry, and Extremes by John E. Walsh (D. Van Nostrand, Princeton, 1965), xxvi, 686. $17.50 , 1965 .

[4]  Thomas H. Wonnacott,et al.  Methods for analyzing data from computer simulation experiments , 1967, CACM.

[5]  George S. Fishman,et al.  The Analysis of Simulation-Generated Time Series , 1967 .

[6]  T. Koopmans.  Three Essays on the State of Economic Science , 1958 .

[7]  Thomas Herbert Naylor.  Computer Simulation Techniques , 1966 .

[8]  M. Blaug,et al.  Economic Theory in Retrospect. , 1963 .

[9]  Henry S. Leonard,et al.  Testability and Meaning. , 1937 .

[10]  R. Cyert,et al.  Computer Models in Dynamic Economics , 1961 .

[11]  Daniel Teichroew,et al.  Computer simulation—discussion of the technique and comparison of languages , 1966, CACM.

[12]  John E. Walsh,et al.  Handbook of nonparametric statistics , 1963 .

[13]  H. Theil,et al.  Economic Forecasts and Policy. , 1959 .

[14]  Richard W. Conway,et al.  Some Tactical Problems in Digital Simulation , 1963 .

[15]  H. Reichenbach.  The rise of scientific philosophy , 1952 .

[16]  Thomas H. Naylor,et al.  Design of computer simulation experiments for industrial systems , 1966, CACM.

[17]  J. March,et al.  A Behavioral Theory of the Firm , 1964 .

[18]  W. Sasser,et al.  A Computer Simulation Model of the Textile Industry , 1967 .