The estimation of the model order in exponential families

Estimators are sought that achieve high exponential rate of decrease in the underestimation probability while keeping the overestimation probability exponent at a certain prescribed level. It is assumed that a given integer is known to upper-bound the true order. Some examples are given of possible applications of the proposed method in specific order estimation and hypothesis testing problems. >

[1]  J. Rissanen.  Stochastic Complexity and Modeling , 1986 .

[2]  J. Rissanen.  Estimation of structure by minimum description length , 1982 .

[3]  H. Tong.  Determination of the order of a Markov chain by Akaike's information criterion , 1975, Journal of Applied Probability.

[4]  Bradley Efron,et al.  LARGE DEVIATIONS THEORY IN EXPONENTIAL FAMILIES , 1968 .

[5]  R. Shibata.  An Optimal Autoregressive Spectral Estimate , 1981 .

[6]  R. Kashyap.  Inconsistency of the AIC rule for estimating the order of autoregressive models , 1980 .

[7]  Neri Merhav,et al.  On the estimation of the order of a Markov chain and universal data compression , 1989, IEEE Trans. Inf. Theory.

[8]  E. Hannan,et al.  The determination of optimum structures for the state space representation of multivariate stochastic processes , 1982 .

[9]  R. Shibata.  Selection of the order of an autoregressive model by Akaike's information criterion , 1976 .

[10]  E. Parzen.  Some recent advances in time series modeling , 1974 .

[11]  E. Hannan.  The Estimation of the Order of an ARMA Process , 1980 .

[12]  H. Akaike.  Fitting autoregressive models for prediction , 1969 .

[13]  B. G. Quinn,et al.  The determination of the order of an autoregression , 1979 .

[14]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[15]  H. Akaike.  A new look at the statistical model identification , 1974 .

[16]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[17]  Piet M. T. Broersen,et al.  Selecting the order of autoregressive models from small samples , 1985, IEEE Trans. Acoust. Speech Signal Process..

[18]  Ritei Shibata,et al.  Consistency of model selection and parameter estimation , 1986, Journal of Applied Probability.

[19]  Michael Gutman,et al.  Asymptotically optimal classification for multiple tests with empirically observed statistics , 1989, IEEE Trans. Inf. Theory.

[20]  H. Akaike.  Statistical predictor identification , 1970 .

[21]  Jorma Rissanen,et al.  Universal coding, information, prediction, and estimation , 1984, IEEE Trans. Inf. Theory.

[22]  R. Shibata.  Asymptotically Efficient Selection of the Order of the Model for Estimating Parameters of a Linear Process , 1980 .

[23]  Thomas Kailath,et al.  Detection of signals by information theoretic criteria , 1985, IEEE Trans. Acoust. Speech Signal Process..