Model Averaging in Economics: An Overview

Standard practice in empirical research is based on two steps: first, researchers select a model from the space of all possible models; second, they proceed as if the selected model had generated the data. Therefore, uncertainty in the model selection step is typically ignored. Alternatively, model averaging accounts for this model uncertainty. In this paper, I review the literature on model averaging with special emphasis on its applications to economics. Finally, as an empirical illustration, I consider model averaging to examine the deterrent effect of capital punishment across states in the USA.

[1]  Brent R. Moulton A Bayesian approach to regression selection and estimation, with application to a price index for radio services , 1991 .

[2]  John W. Galbraith,et al.  Série Scientifique Scientific Series Dimension Reduction and Model Averaging for Estimation of Artists' Age- Valuation Profiles Dimension Reduction and Model Averaging for Estimation of Artists' Age-valuation Profiles , 2022 .

[3]  David Draper,et al.  Assessment and Propagation of Model Uncertainty , 2011 .

[4]  Hairul Azlan Annuar,et al.  Foreign investors' interests and corporate tax avoidance: Evidence from an emerging economy , 2015 .

[5]  J. Geweke,et al.  Optimal Prediction Pools , 2008 .

[6]  Ryo Okui,et al.  Constructing Optimal Instruments by First-Stage Prediction Averaging , 2010 .

[7]  T. Gneiting,et al.  Combining probability forecasts , 2010 .

[8]  K. Gaver,et al.  Posterior probabilities of alternative linear models , 1971 .

[9]  A. Timmermann Chapter 4 Forecast Combinations , 2006 .

[10]  Eduardo Ley,et al.  Bayesian modelling of catch in a north‐west Atlantic fishery , 2002 .

[11]  Joshua D. Angrist,et al.  The Credibility Revolution in Empirical Economics: How Better Research Design is Taking the Con Out of Econometrics , 2010, SSRN Electronic Journal.

[12]  I. Jolliffe,et al.  Combination and Calibration Methods for Probabilistic Forecasts of Binary Events , 2008 .

[13]  Giuseppe De Luca,et al.  Bayesian Model Averaging and Weighted-Average Least Squares: Equivariance, Stability, and Numerical Issues , 2011 .

[14]  Bin Yu,et al.  Model Selection and the Principle of Minimum Description Length , 2001 .

[15]  Peter A. Morris,et al.  Decision Analysis Expert Use , 1974 .

[16]  Peter A. Morris,et al.  Combining Expert Judgments: A Bayesian Approach , 1977 .

[17]  Paul Horst,et al.  Obtaining a composite measure from a number of different measures of the same attribute , 1936 .

[18]  Mingliang Li,et al.  Returns to Schooling and Bayesian Model Averaging: A Union of Two Literatures , 2004 .

[19]  Enrique Moral-Benito Dynamic Panels with Predetermined Regressors: Likelihood-Based Estimation and Bayesian Averaging With an Application to Cross-Country Growth , 2011 .

[20]  R. Clemen Combining forecasts: A review and annotated bibliography , 1989 .

[21]  V. Chernozhukov,et al.  Bayesian Econometrics , 2007 .

[22]  Isaac Ehrlich,et al.  The Deterrent Effect of Capital Punishment: A Question of Life and Death , 1973 .

[23]  D. Madigan,et al.  Bayesian Model Averaging in Proportional Hazard Models: Assessing the Risk of a Stroke , 1997 .

[24]  Steven D. Levitt,et al.  Prison Conditions, Capital Punishment, and Deterrence , 2003 .

[25]  Adrian E. Raftery,et al.  Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors , 1999 .

[26]  S. Geisser,et al.  A Predictive Approach to Model Selection , 1979 .

[27]  Joseph G. Ibrahim,et al.  Bayesian Model Averaging With Applications to Benchmark Dose Estimation for Arsenic in Drinking Water , 2006 .

[28]  Bruce E. Hansen,et al.  Least-squares forecast averaging , 2008 .

[29]  Detlof von Winterfeldt,et al.  Advances in decision analysis : from foundations to applications , 2007 .

[30]  Arnold Zellner,et al.  "Bayesian and Non-Bayesian Methods for Combining Models and Forecasts with Applications to Forecasting International Growth Rates" , 2004 .

[31]  M. Hashem Pesaran,et al.  Selection of estimation window in the presence of breaks , 2007 .

[32]  Hashem Dezhbakhsh,et al.  The Deterrent Effect of Capital Punishment: Evidence from a "Judicial Experiment" , 2006 .

[33]  Nils Lid Hjort,et al.  Model Selection and Model Averaging: Contents , 2008 .

[34]  D. Spiegelhalter,et al.  Bayes Factors for Linear and Log‐Linear Models with Vague Prior Information , 1982 .

[35]  M. Clyde,et al.  Mixtures of g Priors for Bayesian Variable Selection , 2008 .

[36]  Christian Genest,et al.  Allocating the weights in the linear opinion pool , 1990 .

[37]  Shaun P. Vahey,et al.  Combining forecast densities from VARs with uncertain instabilities , 2010 .

[38]  J. Cuaresma,et al.  The Determinants of Economic Growth in European Regions , 2009, SSRN Electronic Journal.

[39]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[40]  L. Wasserman,et al.  A Reference Bayesian Test for Nested Hypotheses and its Relationship to the Schwarz Criterion , 1995 .

[41]  M. Arellano,et al.  The Time Series and Cross-Section Asymptotics of Dynamic Panel Data Estimators , 2003 .

[42]  M. Geisel Bayesian Comparisons of Simple Macroeconomic Models , 1973 .

[43]  Tilmann Gneiting,et al.  Editorial: Probabilistic forecasting , 2008 .

[44]  J. Cuaresma,et al.  Working Papers in Economics and Statistics On the determinants of currency crises : The role of model uncertainty , 2008 .

[45]  Shaun P. Vahey,et al.  Real-Time Prediction With U.K. Monetary Aggregates in the Presence of Model Uncertainty , 2009 .

[46]  John Geweke,et al.  Chapter 1 Bayesian Forecasting , 2006 .

[47]  M. Halperin Almost Linearly-Optimum Combination of Unbiased Estimates , 1961 .

[48]  G. Doppelhofer,et al.  Jointness of Growth Determinants , 2007, SSRN Electronic Journal.

[49]  J. Geweke,et al.  Hierarchical Markov Normal Mixture Models with Applications to Financial Asset Returns , 2007 .

[50]  S. Stigler Studies in the History of Probability and Statistics. XXXII Laplace, Fisher, and the discovery of the concept of sufficiency , 1973 .

[51]  K. Burnham,et al.  Model selection: An integral part of inference , 1997 .

[52]  R. L. Winkler,et al.  Advances in Decision Analysis: Aggregating Probability Distributions , 2007 .

[53]  D. Madigan,et al.  Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window , 1994 .

[54]  A. Raftery Bayesian Model Selection in Social Research , 1995 .

[55]  Anthony Garratt,et al.  Forecast Uncertainties in Macroeconomic Modeling , 2003 .

[56]  N. Hjort,et al.  The Focused Information Criterion , 2003 .

[57]  I. Koske,et al.  The drivers of labour income inequality – an analysis based on Bayesian Model Averaging , 2013 .

[58]  G. Gregory,et al.  Probability, Induction and Statistics , 1974 .

[59]  K. Wallis,et al.  A Simple Explanation of the Forecast Combination Puzzle , 2009 .

[60]  Chris Papageorgiou,et al.  Rough and lonely road to prosperity: a reexamination of the sources of growth in Africa using Bayesian model averaging , 2008 .

[61]  Adrian E. Raftery,et al.  Bayesian Model Averaging and Endogeneity Under Model Uncertainty: An Application to Development Determinants , 2009 .

[62]  A. Raftery,et al.  Probabilistic forecasts, calibration and sharpness , 2007 .

[63]  J. York,et al.  Bayesian Graphical Models for Discrete Data , 1995 .

[64]  Bruno de Finetti,et al.  Probability, induction and statistics , 1972 .

[65]  G. A. Barnard,et al.  New Methods of Quality Control , 1963 .

[66]  A. Timmermann,et al.  Small Sample Properties of Forecasts from Autoregressive Models Under Structural Breaks , 2003, SSRN Electronic Journal.

[67]  A. P. Dawid,et al.  Bayesian Model Averaging and Model Search Strategies , 2007 .

[68]  Adrian E. Raftery,et al.  Bayesian Model Averaging: A Tutorial , 2016 .

[69]  A. O'Hagan,et al.  Fractional Bayes factors for model comparison , 1995 .

[70]  James Mitchell,et al.  The Drivers of International Migration to the UK: A Panel�?Based Bayesian Model Averaging Approach , 2011 .

[71]  A. Raftery,et al.  Default Priors and Predictive Performance in Bayesian Model Averaging, with Application to Growth Determinants , 2007 .

[72]  M. Clyde,et al.  Flexible empirical Bayes estimation for wavelets , 2000 .

[73]  Jan R. Magnus,et al.  A comparison of two model averaging techniques with an application to growth empirics , 2010 .

[74]  Harold A. Edgerton,et al.  The method of minimum variation for the combination of criteria , 1936 .

[75]  Doron Avramov,et al.  Stock Return Predictability and Model Uncertainty , 2001 .

[76]  Gary Koop,et al.  Forecasting in Dynamic Factor Models Using Bayesian Model Averaging , 2004 .

[77]  C. Granger,et al.  Improved methods of combining forecasts , 1984 .

[78]  Seymour Geisser,et al.  A Bayes Approach for Combining Correlated Estimates , 1965 .

[79]  Chih Ming Tan,et al.  Are Any Growth Theories Robust? , 2007 .

[80]  Christian Genest,et al.  Combining Probability Distributions: A Critique and an Annotated Bibliography , 1986 .

[81]  Alexei Onatski,et al.  Modeling Model Uncertainty , 2002 .

[82]  Enrique Moral-Benito,et al.  Growth Empirics in Panel Data Under Model Uncertainty and Weak Exogeneity , 2013 .

[83]  J. Geweke,et al.  Bayesian Forecasting , 2004 .

[84]  Dean Phillips Foster,et al.  Calibration and Empirical Bayes Variable Selection , 1997 .

[85]  Enrique Moral-Benito,et al.  Likelihood-Based Estimation of Dynamic Panels With Predetermined Regressors , 2013 .

[86]  Mark F. J. Steel,et al.  On the effect of prior assumptions in Bayesian model averaging with applications to growth regression , 2009 .

[87]  M. Bartlett A comment on D. V. Lindley's statistical paradox , 1957 .

[88]  Andros Kourtellos,et al.  Is God in the Details? A Reexamination of the Role of Religion in Economic Growth , 2011 .

[89]  R. Kohn,et al.  Nonparametric regression using Bayesian variable selection , 1996 .

[90]  C. Granger,et al.  Interval forecasting. An analysis based upon ARCH-quantile estimators , 1989 .

[91]  Xinyu Zhang,et al.  On the Use of Model Averaging in Tourism Research , 2009 .

[92]  Eric Zivot,et al.  Bayesian and Classical Approaches to Instrumental Variables Regression , 2003 .

[93]  Steven N. Durlauf,et al.  Model Uncertainty and the Deterrent Effect of Capital Punishment , 2007 .

[94]  M. Steel,et al.  Model uncertainty in cross-country growth regressions , 2001 .

[95]  N. Hjort,et al.  Frequentist Model Average Estimators , 2003 .

[96]  George M. Furnival,et al.  Regressions by leaps and bounds , 2000 .

[97]  J. Berger,et al.  The Intrinsic Bayes Factor for Model Selection and Prediction , 1996 .

[98]  John Geweke,et al.  Complete and Incomplete Econometric Models , 2010 .

[99]  X. Sala-i-Martin,et al.  Determinants of Long-Term Growth: A Bayesian Averaging of Classical Estimates (Bace) Approach , 2000 .

[100]  Jonathan H. Wright,et al.  Bayesian Model Averaging and Exchange Rate Forecasts , 2003 .

[101]  A. Raftery,et al.  Using Bayesian Model Averaging to Calibrate Forecast Ensembles , 2005 .

[102]  K. J. Martijn Cremers,et al.  Stock Return Predictability: A Bayesian Model Selection Perspective , 2000 .

[103]  Eduardo Ley,et al.  On the Effect of Prior Assumptions in Bayesian Model Averaging With Applications to Growth Regression , 2007 .

[104]  Nils Lid Hjort,et al.  Model Selection and Model Averaging , 2001 .

[105]  William W. Davis,et al.  Approximate Bayesian Predictive Distributions and Model Selection , 1979 .

[106]  C. Granger,et al.  Handbook of Economic Forecasting , 2006 .

[107]  Huigang Chen,et al.  Limited Information Bayesian Model Averaging for Dynamic Panels with Short Time Periods , 2009, SSRN Electronic Journal.

[108]  Edward E. Leamer,et al.  Reporting the Fragility of Regression Estimates , 1983 .

[109]  M. Steel,et al.  Jointness in Bayesian Variable Selection with Applications to Growth Regression , 2006 .

[110]  Christian Henn,et al.  Trade Creation and Diversion Revisited: Accounting for Model Uncertainty and Natural Trading Partner Effects , 2008 .

[111]  T. Gneiting,et al.  Combining Predictive Distributions , 2011, 1106.1638.

[112]  Dean P. Foster,et al.  The risk inflation criterion for multiple regression , 1994 .

[113]  Ian T. Jolliffe,et al.  Calibration of Probabilistic Forecasts of Binary Events , 2009 .

[114]  Alexei Onatski,et al.  ROBUST MONETARY POLICY UNDER MODEL UNCERTAINTY IN A SMALL MODEL OF THE U.S. ECONOMY , 1998, Macroeconomic Dynamics.

[115]  M. Steel,et al.  Benchmark Priors for Bayesian Model Averaging , 2001 .

[116]  J. Cuaresma,et al.  Economic Growth Determinants for European Regions: Is Central and Eastern Europe Different? , 2009 .

[117]  A. Timmermann Forecast Combinations , 2005 .

[118]  Jonathan H. Wright,et al.  Forecasting U.S. Inflation by Bayesian Model Averaging , 2003 .

[119]  S. Hall,et al.  Combining density forecasts , 2007 .

[120]  Gary Koop,et al.  Bayesian Analysis of Long Memory and Persistence using ARFIMA Models , 1995 .

[121]  M. Stone The Opinion Pool , 1961 .

[122]  Edward E. Leamer,et al.  Let's Take the Con Out of Econometrics , 1983 .

[123]  L. Blume,et al.  The New Palgrave Dictionary of Economics, 2nd edition , 2008 .

[124]  Peter E. Kennedy,et al.  Combining Qualitative Forecasts Using Logit , 1998 .

[125]  B. Hansen Least Squares Model Averaging , 2007 .

[126]  J. M. Bates,et al.  The Combination of Forecasts , 1969 .

[127]  M. Wagner,et al.  Growth Regressions, Principal Components and Frequentist Model Averaging , 2009 .

[128]  William A Brock,et al.  Policy Evaluation in Uncertain Economic Environments , 2003 .

[129]  On the Determinants of Currency Crises: The Role of Model Uncertainty , 2009 .

[130]  Jeffrey S. Racine,et al.  Jackknife model averaging , 2012 .

[131]  Enrique Moral-Benito,et al.  Determinants of Economic Growth: A Bayesian Panel Data Approach , 2009, Review of Economics and Statistics.

[132]  Paolo Zaffaroni,et al.  Model Averaging in Risk Management with an Application to Futures Markets , 2008, SSRN Electronic Journal.