Statistical Analysis of Non-Stationary Series of Events in a Data Base System

Central problems in the performance evaluation of computer systems are the description of the behavior of the system and characterization of the workload. One approach to these problems comprises the interactive combination of data-analytic procedures with probability modeling. This paper describes methods, both old and new, for the statistical analysis of non-stationary univariate stochastic point processes and sequences of positive random variables. Such processes arefr equently encountered in computer systems. As an illustration of the methodology an analysis is given of the stochastic point process of transactions initiated in a running data base system. On theb asis of the statistical analysis, a non-homogeneous Poissonp rocess model for the transaction initiation process is postulated for periods of high system activity and found to be an adequate characterization of the data. For periods of lower system activity, the transaction initiation process has a complex structure, with more clustering evident. Overall models of this type have application to the validation of proposed data base subsystem models.

[1]  P. Lewis.  Recent results in the statistical analysis of univariate point processes , 1971 .

[2]  Stephen S. Lavenberg,et al.  Stochastic Modeling of Processor Scheduling with Application to Data Base Management Systems , 1976, IBM J. Res. Dev..

[3]  E. Çinlar,et al.  On the Superposition of Point Processes , 1968 .

[4]  M. Rosenblatt.  Remarks on Some Nonparametric Estimates of a Density Function , 1956 .

[5]  C. Maclean,et al.  Estimation and testing of an exponential polynomial rate function within the nonstationary Poisson process , 1974 .

[6]  H. Lilliefors.  On the Kolmogorov-Smirnov Test for the Exponential Distribution with Mean Unknown , 1969 .

[7]  M Rosenblatt,et al.  Empirical sampling study of a goodness of fit statistic for density function estimation , 1975 .

[8]  Peter A. Lewis,et al.  Non‐Homogeneous Branching Poisson Processes , 1967 .

[9]  Gerald S. Shedler,et al.  Empirically derived micromodels for sequences of page exceptions , 1973 .

[10]  A. Hawkes,et al.  A cluster process representation of a self-exciting process , 1974, Journal of Applied Probability.

[11]  D. Cox,et al.  The statistical analysis of series of events , 1966 .

[12]  P. Lewis,et al.  Some results on tests for Poisson processes , 1965 .

[13]  H. Lilliefors.  On the Kolmogorov-Smirnov Test for Normality with Mean and Variance Unknown , 1967 .

[14]  Cuthbert Daniel,et al.  Fitting Equations to Data: Computer Analysis of Multifactor Data , 1980 .

[15]  P. Lewis.  Remarks on the theory, computation and application of the spectral analysis of series of events , 1970 .

[16]  David R. Cox,et al.  The statistical analysis of series of events , 1966 .