The statistical theory of linear systems

Publisher Summary The chapter discusses the development of a rather complete inferential theory for ARMAX models. The first problem in the development is the coordinatization of spaces of such structures. Coordinates are needed both for computations and because a central limit theorem must be expressed in terms of them. One such coordinatization would follow from the use of the coefficient matrices in g, h, j in the scalar m.f.d., but there are many others. The chapter highlights the algebraic and topological description of ARMAX systems. In this connection, control engineers have played a premier part. The chapter focuses on the asymptotic properties of maximum likelihood (ML) estimators. The ML estimator is obtained by optimizing this likelihood. The chapter explains the asymptotic properties of these estimators without assuming the data to be Gaussian and also discusses the basis of the assumptions that appear to be minimal.

[1]  R. Plackett.  Some theorems in least squares. , 1950, Biometrika.

[2]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[3]  A. M. Walker.  Large-sample estimation of parameters for autoregressive processes with moving-average residuals , 1962 .

[4]  E. Hannan.  The identification of vector mixed autoregressive-moving average system , 1969 .

[5]  T. Kailath.  The innovations approach to detection and estimation theory , 1970 .

[6]  E. J. Hannan,et al.  Multiple time series , 1970 .

[7]  E. J. Hannan,et al.  On Limit Theorems for Quadratic Functions of Discrete Time Series , 1972 .

[8]  E. J. Hannan,et al.  Central limit theorems for time series regression , 1973 .

[9]  H. Akaike.  Markovian Representation of Stochastic Processes and Its Application to the Analysis of Autoregressive Moving Average Processes , 1974 .

[10]  J. Willems,et al.  Parametrizations of linear dynamical systems: Canonical forms and identifiability , 1974 .

[11]  H. Akaike.  Stochastic theory of minimal realization , 1974 .

[12]  J. Durbin,et al.  Techniques for Testing the Constancy of Regression Relationships Over Time , 1975 .

[13]  Jr. G. Forney,et al.  Minimal Bases of Rational Vector Spaces, with Applications to Multivariable Linear Systems , 1975 .

[14]  E. Hannan.  The Convergence of Some Recursions , 1976 .

[15]  R. Shibata.  Selection of the order of an autoregressive model by Akaike's information criterion , 1976 .

[16]  E. J. Hannan,et al.  Vector linear time series models , 1976, Advances in Applied Probability.

[17]  H. Akaike.  Canonical Correlation Analysis of Time Series and the Use of an Information Criterion , 1976 .

[18]  E. Hannan,et al.  Vector linear time series models: corrections and extensions , 1978, Advances in Applied Probability.

[19]  Takamitsu Sawa,et al.  Information criteria for discriminating among alternative regression models / BEBR No. 455 , 1978 .

[20]  Jorma Rissanen,et al.  THE STRONG CONSISTENCY OF MAXIMUM LIKELIHOOD ESTIMATORS FOR ARMA PROCESSES , 1979 .

[21]  W. Dunsmuir.  A Central Limit Theorem for Parameter Estimation in Stationary Vector Time Series and its Application to Models for a Signal Observed with Noise , 1979 .

[22]  Richard W. Hamming,et al.  Coding and Information Theory , 1980 .

[23]  Thomas Kailath,et al.  Linear Systems , 1980 .

[24]  G. Chow.  A comparison of the information and posterior probability criteria for model selection , 1981 .

[25]  Peter No,et al.  Digital Coding of Waveforms , 1986 .

[26]  Victor Solo,et al.  Topics in advanced time series analysis , 1986 .

[27]  Masanao Aoki,et al.  State Space Modeling of Time Series , 1987 .

[28]  E. Hannan.  Rational Transfer Function Approximation , 1987 .

[29]  Rainer Dahlhaus,et al.  Small Sample Effects in Time Series Analysis: A New Asymptotic Theory and a New Estimate , 1988 .

[30]  P. Caines.  Linear Stochastic Systems , 1988 .

[31]  Mark H. A. Davis,et al.  Strong Consistency of the PLS Criterion for Order Determination of Autoregressive Processes , 1989 .