Estimation of structure by minimum description length

A theorem is proved which demonstrates that an earlier derived minimum description length estimation criterion is capable of distinguishing between structures in linear models for vector processes. A fairly simple algorithm is described for the estimation of the best model, including its structure and the number of its parameters.

[1]  E. K. Wakeford.  On Canonical Forms , 1920 .

[2]  D. Luenberger.  Canonical forms for linear multivariable systems , 1967, IEEE Transactions on Automatic Control.

[3]  Andrew H. Wallace,et al.  Differential topology; first steps , 1968 .

[4]  Michael A. Arbib,et al.  Topics in Mathematical System Theory , 1969 .

[5]  V. Popov.  Invariant Description of Linear, Time-Invariant Controllable Systems , 1972 .

[6]  J. Willems,et al.  Parametrizations of linear dynamical systems: Canonical forms and identifiability , 1974 .

[7]  H. Akaike.  A new look at the statistical model identification , 1974 .

[8]  J. Rissanen.  Basis of invariants and canonical forms for linear dynamic systems , 1974, Autom..

[9]  H. Akaike.  Markovian Representation of Stochastic Processes by Canonical Variables , 1975 .

[10]  L. Ljung,et al.  On Canonical Forms, Parameter Identifiability and the Concept of Complexity , 1975 .

[11]  L. Ljung,et al.  Estimation of Optimum Structures and Parameters for Linear Systems , 1976 .

[12]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[13]  B. G. Quinn,et al.  The determination of the order of an autoregression , 1979 .

[14]  E. Hannan.  The Estimation of the Order of an ARMA Process , 1980 .

[15]  Manfred Deistler,et al.  Some properties of the parameterization of ARMA systems with unknown order , 1981 .

[16]  E. Hannan,et al.  The determination of optimum structures for the state space representation of multivariate stochastic processes , 1982 .

[17]  Lennart Ljung,et al.  On-line structure selection for multivariable state-space models , 1982, Autom..

[18]  E. Hannan,et al.  Recursive estimation of mixed autoregressive-moving average order , 1982 .