IN PARAMETRIC MODELLING OF TIME SERIES ,

Autoregressive-moving average (ARnA) models, and their autoregressive (AR) counterparts, are useful approximants to the kinds of random processes commonly encountered in discrete-time signal processing applications. Such models may be used to compress data in low bit-rate information transmission, improve frequency resolution In spectrum analysis, and to forecast in economic, meteorological, and other time series. In this paper we discuss several aspects of the maximum likelihood theory of parameter identification in ARMA and AR models. We highlight the initial condition problem encountered when identifying AMA or AR models from finite data records and propose several methods for computing exact and approximate likelihood. Several new interpretations are given for the innovation representation of an AIA process. Computationally efficient lattice and fast Kalman filters are proposed for the computation of exact likelihood.

[1]  Louis L. Scharf,et al.  Linear transformations and parametric spectrum analysis , 1982, ICASSP.

[2]  Marcello Pagano,et al.  Minimum Mean Square Error Prediction of Autoregressive Moving Average Time Series. , 1981 .

[3]  J. Cadzow,et al.  High performance spectral estimation--A new ARMA method , 1980 .

[4]  Richard H. Jones,et al.  Maximum Likelihood Fitting of ARMA Models to Time Series With Missing Observations , 1980 .

[5]  A. A. Beex,et al.  Generating covariance sequences and the calculation of quantization and rounding error variances in digital filters , 1980 .

[6]  G. Kedem,et al.  Computation of the exact likelihood function of multivariate moving average models , 1978 .

[7]  L. Ljung,et al.  Extended Levinson and Chandrasekhar equations for general discrete-time linear estimation problems , 1978 .

[8]  F. Ahrabi Maximum Likelihood Estimation of the Covariances of the Vector Moving Average Models in the Time and Frequency Domains , 1978 .

[9]  J. L. Roux,et al.  A fixed point computation of partial correlation coefficients , 1977 .

[10]  G. Reinsel,et al.  Maximum Likelihood Estimation of Vector Autoregressive Moving Average Models. , 1976 .

[11]  T. Ulrich,et al.  Maximum entropy spectral analy-sis and autoregressive decomposition , 1975 .

[12]  H. Akaike Markovian representation of stochastic processes and its application to the analysis of autoregressive moving average processes , 1974 .

[13]  M. Morf,et al.  Some new algorithms for recursive estimation in constant, linear, discrete-time systems , 1974 .

[14]  G. T. Wilson The Estimation of Parameters in Multivariate Time Series Models , 1973 .

[15]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[16]  R. Kashyap Maximum likelihood identification of stochastic linear systems , 1970 .

[17]  K. Steiglitz,et al.  Power-spectrum identification in terms of rational models , 1967, IEEE Transactions on Automatic Control.

[18]  Fred C. Schweppe,et al.  Evaluation of likelihood functions for Gaussian signals , 1965, IEEE Trans. Inf. Theory.

[19]  James Durbin,et al.  The fitting of time series models , 1960 .