Regression and time series model selection in small samples

SUMMARY A bias correction to the Akaike information criterion, AIC, is derived for regression and autoregressive time series models. The correction is of particular use when the sample size is small, or when the number of fitted parameters is a moderate to large fraction of the sample size. The corrected method, called AICC, is asymptotically efficient if the true model is infinite dimensional. Furthermore, when the true model is of finite dimension, AICC is found to provide better model order choices than any other asymptotically efficient method. Applications to nonstationary autoregressive and mixed autoregressive moving average time series models are also discussed.

[1]  P. Whittle.  The Analysis of Multiple Stationary Time Series , 1953 .

[2]  H. Akaike.  Statistical predictor identification , 1970 .

[3]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[4]  C. L. Mallows.  Some comments on C_p , 1973 .

[5]  David M. Allen,et al.  The Relationship Between Variable Selection and Data Agumentation and a Method for Prediction , 1974 .

[6]  E. Parzen.  Multiple Time Series: Determining the Order of Approximating Autoregressive Schemes. , 1975 .

[7]  R. Shibata.  Selection of the order of an autoregressive model by Akaike's information criterion , 1976 .

[8]  R. Bhansali,et al.  Some properties of the order of an autoregressive model selected by a generalization of Akaike∘s EPF criterion , 1977 .

[9]  N. Sugiura.  Further analysts of the data by akaike' s information criterion and the finite corrections , 1978 .

[10]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[11]  H. Akaike.  A Bayesian analysis of the minimum AIC procedure , 1978 .

[12]  B. G. Quinn,et al.  The determination of the order of an autoregression , 1979 .

[13]  R. Shibata.  Asymptotically Efficient Selection of the Order of the Model for Estimating Parameters of a Linear Process , 1980 .

[14]  E. Hannan.  The Estimation of the Order of an ARMA Process , 1980 .

[15]  R. Shibata.  An optimal selection of regression variables , 1981 .

[16]  D. B. Preston.  Spectral Analysis and Time Series , 1983 .

[17]  Ruey S. Tsay,et al.  Order Selection in Nonstationary Autoregressive Models , 1984 .

[18]  A. Ronald Gallant.  Nonlinear statistical models. Ch. 9 dynamic nonlinear models , 1985 .

[19]  Ritei Shibata,et al.  Consistency of model selection and parameter estimation , 1986, Journal of Applied Probability.

[20]  J. Gani,et al.  Essays in Time Series and Allied Processes. , 1986 .

[21]  R. J. Bhansali,et al.  Asymptotically Efficient Selection of the Order by the Criterion Autoregressive Transfer Function , 1986 .

[22]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .