Efficient estimation of autocorrelation functions of random data with time series models

Sample covariances, estimated as mean-lagged products of random data, are poor and inaccurate fundaments for the non-parametric spectral estimation with tapered and windowed periodograms. However, the autocovariance can be estimated efficiently with a parametric method as transformation of an estimated time series model, if the model type and model order are known a-priori. A recent development in time-series analysis gives the possibility to automatically select the model type and the model order for data with unknown characteristics. After the computation of hundreds of candidate models of different orders and types, a statistical criterion can select a single time series model. The accuracy of this identification from many candidates is sufficient to approach the performance that can be obtained with parametric estimation if the type and the order of the time series model would be known a priori. Hence, the accuracy (mean square error) of parametric covariance estimates is typically the same or better than what can be achieved by non-parametric mean-lagged-product estimates.

[1]  Piet M. T. Broersen,et al.  Finite sample criteria for autoregressive order selection , 2000, IEEE Trans. Signal Process..

[2]  P. Whittle,et al.  Estimation and information in stationary time series , 1953 .

[3]  Piet M. T. Broersen Facts and fiction in spectral analysis , 2000, IEEE Trans. Instrum. Meas..

[4]  Piet M. T. Broersen,et al.  The quality of models for ARMA processes , 1998, IEEE Trans. Signal Process..

[5]  A. Wald,et al.  On the Statistical Treatment of Linear Stochastic Difference Equations , 1943 .

[6]  S.M. Kay,et al.  Spectrum analysis—A modern perspective , 1981, Proceedings of the IEEE.

[7]  J. Durbin EFFICIENT ESTIMATION OF PARAMETERS IN MOVING-AVERAGE MODELS , 1959 .

[8]  P. Broersen,et al.  Windowed periodograms and moving average models , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[9]  Mátyás Arató,et al.  On the Sufficient Statistics for Stationary Gaussian Random Processes , 1961 .

[10]  Piet M. T. Broersen,et al.  Autoregressive model orders for Durbin's MA and ARMA estimators , 2000, IEEE Trans. Signal Process..

[11]  S. Zacks The theory of statistical inference , 1972 .

[12]  J. P. Burg,et al.  Maximum entropy spectral analysis. , 1967 .

[13]  J. Tukey,et al.  An algorithm for the machine calculation of complex Fourier series , 1965 .

[14]  James Durbin,et al.  The fitting of time series models , 1960 .

[15]  Piet M. T. Broersen The performance of spectral quality measures , 2001, IEEE Trans. Instrum. Meas..

[16]  D. B. Preston Spectral Analysis and Time Series , 1983 .