Bayesian Model Averaging and Weighted-Average Least Squares: Equivariance, Stability, and Numerical Issues

This article is concerned with the estimation of linear regression models with uncertainty about the choice of the explanatory variables. We introduce the Stata commands bma and wals which implement, respectively, the exact Bayesian Model Averaging (BMA) estimator and the Weighted Average Least Squares (WALS) estimator developed by Magnus et al. (2010). Unlike standard pretest estimators which are based on some preliminary diagnostic test, these model averaging estimators provide a coherent way of making inference on the regression parameters of interest by taking into account the uncertainty due to both the estimation and the model selection steps. Special emphasis is given to a number practical issues that users are likely to face in applied work: equivariance to certain transformations of the explanatory variables, stability, accuracy, computing speed and out-of-memory problems. Performances of our bma and wals commands are illustrated using simulated data and empirical applications from the literature on model averaging estimation.

[1]  S. Modica,et al.  A Generalized Missing-Indicator Approach to Regression with Imputed Covariates , 2012 .

[2]  Per Capita,et al.  About the authors , 1995, Machine Vision and Applications.

[3]  James Znglis.  Specification Searcher: Ad Hoc Inference With Nonexperimental Data , 1981 .

[4]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .

[5]  James Durbin,et al.  Estimation of Regression Coefficients of Interest when Other Regression Coefficients are of no Interest , 1999 .

[6]  X. Sala-i-Martin,et al.  Determinants of Long-Term Growth: A Bayesian Averaging of Classical Estimates (Bace) Approach , 2000 .

[7]  J. Magnus,et al.  Matrix Differential Calculus with Applications in Statistics and Econometrics , 1991 .

[8]  J. Magnus,et al.  Estimation of the Mean of a Univariate Normal Distribution with Known Variance , 2002 .

[9]  M. Steel,et al.  Jointness in Bayesian Variable Selection with Applications to Growth Regression , 2006 .

[10]  David R. Kincaid,et al.  Numerical mathematics and computing , 1980 .

[11]  Adrian E. Raftery,et al.  Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors , 1999 .

[12]  Franco Peracchi,et al.  Regression with Imputed Covariates: A Generalized Missing Indicator Approach , 2009 .

[13]  A. Raftery.  Bayesian Model Selection in Social Research , 1995 .

[14]  D. Danilov.  Estimation of the mean of a univariate normal distribution when the variance is not known , 2005 .

[15]  Xinyu Zhang,et al.  Weighted average least squares estimation with nonspherical disturbances and an application to the Hong Kong housing market , 2011, Comput. Stat. Data Anal..

[16]  M. Steel,et al.  Model uncertainty in cross-country growth regressions , 2001 .

[17]  Jan R. Magnus,et al.  On the harm that ignoring pretesting can cause , 2004 .

[18]  Jan R. Magnus,et al.  A comparison of two model averaging techniques with an application to growth empirics , 2010 .

[19]  J. Magnus,et al.  A characterization of Bayesian robustness for a normal location parameter , 2013, Sankhya B.

[20]  J. Magnus,et al.  On the Choice of Prior in Bayesian Model Averaging , 2011 .

[21]  Chris Papageorgiou,et al.  Rough and lonely road to prosperity: a reexamination of the sources of growth in Africa using Bayesian model averaging , 2008 .

[22]  J. Magnus,et al.  Matrix Differential Calculus with Applications in Statistics and Econometrics (Revised Edition) , 1999 .