Subset selection of autoregressive time series models

We propose a solution to select promising subsets of autoregressive time series models for further consideration which follows up on the idea of the stochastic search variable selection procedure in George and McCulloch (1993). It is based on a Bayesian approach which is unconditional on the initial terms. The autoregression stepup is in the form of a hierarchical normal mixture model, where latent variables are used to identify the subset choice. The framework of our procedure is utilized by the Gibbs sampler, a Markov chain Monte Carlo method. The advantage of the method presented is computational: it is an alternative way to search over a potentially large set of possible subsets. The proposed method is illustrated with a simulated data as well as a real data. Copyright © 1999 John Wiley & Sons, Ltd.

[1]  R. Kohn,et al.  Bayesian estimation of an autoregressive model using Markov chain Monte Carlo , 1996 .

[2]  W. Wong,et al.  The calculation of posterior distributions by data augmentation , 1987 .

[3]  Richard Terrell,et al.  ON THE RECURSIVE FITTING OF SUBSET AUTOREGRESSIONS , 1982 .

[4]  E. George,et al.  Journal of the American Statistical Association is currently published by American Statistical Association. , 2007 .

[5]  Adrian F. M. Smith,et al.  Sampling-Based Approaches to Calculating Marginal Densities , 1990 .

[6]  Clifford M. Hurvich,et al.  Regression and time series model selection in small samples , 1989 .

[7]  S. Chib,et al.  Bayes inference in regression models with ARMA (p, q) errors , 1994 .

[8]  B. Y. Thanoon.  SUBSET THRESHOLD AUTOREGRESSION WITH APPLICATIONS , 1990 .

[9]  V. Haggan,et al.  ON THE SELECTION OF SUBSET AUTOREGRESSIVE TIME SERIES MODELS , 1984 .

[10]  Cathy W. S. Chen,et al.  A UNIFIED APPROACH TO ESTIMATING AND MODELING LINEAR AND NONLINEAR TIME SERIES , 1997 .

[11]  S. Chib,et al.  Bayes inference via Gibbs sampling of autoregressive time series subject to Markov mean and variance shifts , 1993 .

[12]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  G. C. Tiao,et al.  Bayesian inference in statistical analysis , 1973 .

[14]  S. E. Hills,et al.  Illustration of Bayesian Inference in Normal Data Models Using Gibbs Sampling , 1990 .

[15]  P. Kanjilal,et al.  On a method of identification of best subset model from full ar-model , 1995 .

[16]  H. Akaike.  A new look at the statistical model identification , 1974 .

[17]  Siddhartha Chib,et al.  Bayes regression with autoregressive errors : A Gibbs sampling approach , 1993 .

[18]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[19]  T. J. Mitchell,et al.  Bayesian Variable Selection in Linear Regression , 1988 .

[20]  M. Degroot.  Optimal Statistical Decisions , 1970 .

[21]  R. McCulloch,et al.  BAYESIAN ANALYSIS OF AUTOREGRESSIVE TIME SERIES VIA THE GIBBS SAMPLER , 1994 .

[22]  Hirotugu Akaike,et al.  On entropy maximization principle , 1977 .

[23]  R. Shibata.  Selection of the order of an autoregressive model by Akaike's information criterion , 1976 .

[24]  G. Casella,et al.  Explaining the Gibbs Sampler , 1992 .

[25]  James T. McClave,et al.  Estimating the Order of Autoregressive Models: The Max x 2 Method , 1978 .