Some Exact Formulae for Autoregressive Moving Average Processes

This paper demonstrates that for a finite stationary autoregressive moving average process the inverse of the covariance matrix differs from the matrix of the covariances of the inverse process by a matrix of low rank. The formula for the exact inverse of the covariance matrix of the scalar or multivariate process is provided. We obtain approximations based on this formula and evaluate some of the approximate results in the existing literature. Applications to computational algorithms and to the distributions of two-step estimators are discussed. In addition the paper contains the formula for the determinant of the covariance matrix which is useful in exact maximum likelihood estimation; it also lists the expressions for the autocovariances of scalar autoregressive moving average processes.

[1]  Exact maximum likelihood regression estimation with ARMA (n, n - 1) errors , 1985 .

[2]  C. Ansley An algorithm for the exact likelihood of a mixed autoregressive-moving average process , 1979 .

[3]  J. Wise,et al.  THE AUTOCORRELATION FUNCTION AND THE SPECTRAL DENSITY FUNCTION , 1955 .

[4]  A. Ullah,et al.  ESTIMATION OF LINEAR REGRESSION MODEL WITH AUTOCORRELATED DISTURBANCES , 1983 .

[5]  I. Gohberg,et al.  Convolution Equations and Projection Methods for Their Solution , 1974 .

[6]  G. Kedem,et al.  Computation of the exact likelihood function of multivariate moving average models , 1978 .

[7]  Second-order expansion of mean squared error matrix of generalized least squares estimator with estimated parameters , 1982 .

[8]  J. Gooijer,et al.  On the maximum likelihood estimation of the parameters of a Gaussian moving average process , 1982 .

[9]  P. Shaman Approximations for Stationary Covariance Matrices and Their Inverses with Application to ARMA Models , 1976 .

[10]  D. F. Hays,et al.  Table of Integrals, Series, and Products , 1966 .

[11]  M. Pesaran Exact Maximum Likelihood Estimation of a Regression Equation with a First-Order Moving-Average Error , 1973 .

[12]  A. I. Markushevich,et al.  The theory of analytic functions, a brief course , 1983 .

[13]  P. Shaman On the inverse of the covariance matrix for an autoregressive-moving average process , 1973 .

[14]  Shien-Ming Wu,et al.  Time series and system analysis with applications , 1983 .

[15]  E. J. Godolphin,et al.  A direct representation for the large-sample maximum likelihood estimator of a Gaussian autoregressive-moving average process , 1984 .

[16]  Alfred M. Bruckstein,et al.  Fast matrix factorizations via discrete transmission lines , 1986 .

[17]  D. B. Preston Spectral Analysis and Time Series , 1983 .