Bayes factor consistency for nested linear models with a growing number of parameters

Abstract In this paper, we consider the Bayesian approach to the model selection problem for nested linear regression models. Common Bayesian procedures to this problem are based on Zellner's g-prior with a hyper-prior for the scaling factor g. Maruyama and George (2011) recently adopted this procedure with the beta-prime distribution for g and derived an explicit closed-form Bayes factor without integral representation which is thus easy to compute. In addition, they have studied its corresponding model selection consistency for fixed number of parameters. Over recent years, linear regression models with a growing number of unknown parameters have gained increased popularity in practical applications, such as the clustering problem. This observation motivates us to further investigate the consistency of Bayes factor with the beta-prime distribution for g under a scenario in which the number of parameters increases with the sample size. Finally, the results presented here are compared with the ones for the Bayes factor under intrinsic priors in relevant literature.

[1]  Dean Phillips Foster,et al.  Calibration and empirical Bayes variable selection , 2000 .

[2]  F. Girón,et al.  Intrinsic priors for model comparison in multivariate normal regression , 2011 .

[3]  E. Moreno,et al.  Objective Testing Procedures in Linear Models: Calibration of the p‐values , 2006 .

[4]  G. Casella,et al.  CONSISTENCY OF OBJECTIVE BAYES FACTORS AS THE MODEL DIMENSION GROWS , 2010, 1010.3821.

[5]  Xiaoqian Sun,et al.  Bayes factor consistency for unbalanced ANOVA models , 2012, 1204.1567.

[6]  F. Javier Girón,et al.  Comparison of Bayesian objective procedures for variable selection in linear regression , 2008 .

[7]  E. George,et al.  Journal of the American Statistical Association is currently published by American Statistical Association. , 2007 .

[8]  Yuzo Maruyama,et al.  Fully Bayes factors with a generalized g-prior , 2008, 0801.4410.

[9]  E. Moreno,et al.  Default Bayesian analysis of the Behrens-Fisher problem , 1999 .

[10]  Yuzo Maruyama,et al.  A Bayes factor with reasonable model selection consistency for ANOVA model (Statistical Experiment and Its Related Topics) , 2009, 0906.4329.

[11]  George Casella,et al.  An objective Bayesian analysis of the change point problem , 2005 .

[12]  R. Kass,et al.  Approximate Bayes Factors and Orthogonal Parameters, with Application to Testing Equality of Two Binomial Proportions , 1992 .

[13]  F. Javier Girón,et al.  Consistency of objective Bayes factors for nonnested linear models and increasing model dimension , 2010 .

[14]  M. Steel,et al.  Benchmark Priors for Bayesian Model Averaging , 2001 .

[15]  J. Ghosh,et al.  Approximations and consistency of Bayes factors as model dimension grows , 2003 .

[16]  M. Clyde,et al.  Mixtures of g Priors for Bayesian Variable Selection , 2008 .

[17]  M. Bartlett.  A comment on D. V. Lindley's statistical paradox , 1957 .

[18]  G. Casella,et al.  Objective Bayesian Variable Selection , 2006 .

[19]  G. Casella,et al.  Consistency of Bayesian procedures for variable selection , 2009, 0904.2978.

[20]  Francisco Javier Girón González-Torre,et al.  Intrinsic priors for hypothesis testing in normal regression models , 2003 .

[21]  Luis R. Pericchi,et al.  ACCURATE AND STABLE BAYESIAN MODEL SELECTION: THE MEDIAN INTRINSIC BAYES FACTOR* , 2002 .

[22]  M. Hashem Pesaran,et al.  Non-nested Hypothesis Testing: An Overview , 1999 .

[23]  Edward I. George,et al.  Empirical Bayes vs. Fully Bayes Variable Selection , 2008 .

[24]  A. F. Smith.  A Bayesian approach to inference about a change-point in a sequence of random variables , 1975 .

[25]  James O. Berger,et al.  Objective Bayesian Methods for Model Selection: Introduction and Comparison , 2001 .

[26]  Yuzo Maruyama,et al.  Robust Bayesian variable selection with sub-harmonic priors , 2010, 1009.1926.