The Analysis of Simulation-Generated Time Series

This study applies spectral analysis to the study of time series data generated by simulated stochastic models. Because these data are autocorrelated, analysis by methods applicable to independent observations is not possible. Mathematical models known as covariance stationary stochastic processes are useful representations of autocorrelated time series. The increased publication of literature describing stochastic processes and spectral analysis, in particular, is making these ideas available to an increasing audience. Section I presents a rationale for our interest in time series models and spectral analysis. Section II describes the basic notions of covariance stationary processes. It emphasizes the equivalence of these processes in both the time and frequency domains; the compactness of frequency domain analysis seemingly recommends it over correlation analysis. Section III provides a heuristic background for understanding statistical spectral analysis. Simple frequency-domain statistical properties are emphasized and compared with the rather involved sampling properties of estimated correlograms. Several relevant statistical tests are described. Three simulated experiments are used as examples of how to apply spectral analysis. These are described in Section IV. They are (1) a single-server, first-come-first-served (FCFS) queueing problem with Poisson arrivals and exponentially distributed service times; (2) a similar model with the FCFS assignment rule replaced by one that chooses the job with the shortest service time; and (3) yet another similar model, but with constant service time. In this third example both assignment rules are equivalent. The state of the queue was observed and recorded at unit intervals for all three examples and forms the time series on which Section V is based; theoretical and statistical correlograms and spectra are compared for example 1; examples 1 and 2 are compared using estimated correlograms and spectra; example 3 serves to show some unusual properties of spectra. A particular conclusion of this paper is that differences in the statistical properties of queue length that result under various assumptions and operating rules are easily identified using spectral analysis. More generally, however, this estimation procedure provides a tool for (1) comparing simulated time series with real-world data, and (2) for understanding the implications that various alternative assumptions have on the output of simulated stochastic models.

[1]  Wilbur Marks,et al.  The power spectrum analysis of ocean-wave records , 1952 .

[2]  George S. Fishman,et al.  Problems in the statistical analysis of simulation experiments: the comparision of means and the length of sample records , 1967, CACM.

[3]  E. Parzen Mathematical Considerations in the Estimation of Spectra , 1961 .

[4]  J. Tukey Discussion, Emphasizing the Connection Between Analysis of Variance and Spectrum Analysis* , 1961 .

[5]  Gwilym M. Jenkins,et al.  General Considerations in the Analysis of Spectra , 1961 .

[6]  A. Khintchine Korrelationstheorie der stationären stochastischen Prozesse , 1934 .

[7]  D. Kendall Some Problems in the Theory of Queues , 1951 .

[8]  Samuel Karlin,et al.  Many server queueing processes with Poisson input and exponential service times , 1958 .

[9]  J. Doob Stochastic processes , 1953 .

[10]  N. Wiener Generalized harmonic analysis , 1930 .

[11]  Norman T. J. Bailey,et al.  A Continuous Time Treatment of a Simple Queue Using Generating Functions , 1954 .

[12]  G. Reuter,et al.  Spectral theory for the differential equations of simple birth and death processes , 1954, Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences.

[13]  M. S. Bartlett,et al.  Some probability limit theorems with statistical applications , 1953, Mathematical Proceedings of the Cambridge Philosophical Society.

[14]  C. Granger,et al.  THE RANDOM-WALK HYPOTHESIS OF STOCK MARKET BEHAVIOR† , 1964 .

[15]  Geoffrey Gordon,et al.  A general purpose systems simulation program , 1899, AFIPS '61 (Eastern).

[16]  A. Yaglom,et al.  An Introduction to the Theory of Stationary Random Functions , 1963 .

[17]  Richard W. Conway,et al.  Some Tactical Problems in Digital Simulation , 1963 .

[18]  M. Geisler The Sizes of Simulation Samples Required to Compute Certain Inventory Characteristics with Stated Precision and Confidence , 1964 .

[19]  G. F. Newell,et al.  Introduction to the Theory of Queues. , 1963 .

[20]  Philip M. Morse,et al.  Stochastic Properties of Waiting Lines , 1955, Oper. Res..

[21]  T. Teichmann,et al.  The Measurement of Power Spectra , 1960 .

[22]  Eugen Slutzky Summation of random causes as the source of cyclic processes , 1937 .