Maximum likelihood identification of Gaussian autoregressive moving average models

SUMMARY Closed form representations of the gradients and an approximation to the Hessian are given for an asymptotic approximation to the log likelihood function of a multidimensional autoregressive moving average Gaussian process. Their use for the numerical maximization of the likelihood function is discussed. It is shown that the procedure described by Hannan (1969) for the estimation of the parameters of one-dimensional autoregressive moving average processes is equivalent to a three-stage realization of one step of the NewtonRaphson procedure for the numerical maximization of the likelihood function, using the gradient and the approximate Hessian. This makes it straightforward to extend the procedure to the multidimensional case. The use of the block Toeplitz type characteristic of the approximate Hessian is pointed out.

[1]  P. Whittle.  The Analysis of Multiple Stationary Time Series , 1953 .

[2]  L. L. Cam,et al.  On the Asymptotic Theory of Estimation and Testing Hypotheses , 1956 .

[3]  Solomon Kullback,et al.  Information Theory and Statistics , 1960 .

[4]  James Durbin,et al.  The fitting of time series models , 1960 .

[5]  J. Hájek.  On linear statistical problems in stochastic processes , 1962 .

[6]  P. Whittle.  On the fitting of multivariate autoregressions, and the approximate canonical factorization of a spectral density matrix , 1963 .

[7]  L. M. Kutikov.  The structure of matrices which are the inverse of the correlation matrices of random vector processes , 1967 .

[8]  P. S. Dwyer.  Some Applications of Matrix Derivatives in Multivariate Analysis , 1967 .

[9]  K. Steiglitz,et al.  Power-spectrum identification in terms of rational models , 1967, IEEE Transactions on Automatic Control.

[10]  E. Hannan.  The estimation of mixed moving average autoregressive systems , 1969 .

[12]  E. J. Hannan,et al.  Multiple time series , 1970 .

[13]  M. Powell.  A Survey of Numerical Methods for Unconstrained Optimization , 1970 .

[14]  H. Akaike.  Autoregressive model fitting for control , 1971 .

[15]  K. Dzhaparidze,et al.  On Methods for Obtaining Asymptotically Efficient Spectral Parameter Estimates for a Stationary Gaussian Process with Rational Spectral Density , 1971 .

[16]  T. Nakagawa,et al.  Statistical approach to computer control of cement rotary kilns , 1972 .

[17]  H. Akaike.  Block Toeplitz Matrix Inversion , 1973 .