Bayesian Model Averaging: A Systematic Review and Conceptual Classification

Bayesian model averaging (BMA) provides a coherent and systematic mechanism for accounting for model uncertainty. It can be regarded as an direct application of Bayesian inference to the problem of model selection, combined estimation and prediction. BMA produces a straightforward model choice criterion and less risky predictions. However, the application of BMA is not always straightforward, leading to diverse assumptions and situational choices on its different aspects. Despite the widespread application of BMA in the literature, there were not many accounts of these differences and trends besides a few landmark revisions in the late 1990s and early 2000s, therefore not accounting for advancements made in the last decades. In this work, we present an account of these developments through a careful content analysis of 820 articles in BMA published between 1996 and 2016. We also develop a conceptual classification scheme to better describe this vast literature, understand its trends and future directions and provide guidance for the researcher interested in both the application and development of the methodology. The results of the classification scheme and content review are then used to discuss the present and future of the BMA literature.

[1]  M. Steel,et al.  Benchmark Priors for Bayesian Model Averaging , 2001 .

[2]  D. Madigan,et al.  Bayesian Model Averaging in Proportional Hazard Models: Assessing the Risk of a Stroke , 1997 .

[3]  E. Fleishman,et al.  Predicting Bird Species Distributions in Reconstructed Landscapes , 2007, Conservation biology : the journal of the Society for Conservation Biology.

[4]  M. Stephens,et al.  Bayesian variable selection regression for genome-wide association studies and other large-scale problems , 2011, 1110.6019.

[5]  Joseph G. Ibrahim,et al.  Bayesian Model Averaging With Applications to Benchmark Dose Estimation for Arsenic in Drinking Water , 2006 .

[6]  Matthew J. Lebo,et al.  Forecasting non-incumbent presidential elections: Lessons learned from the 2000 election , 2008 .

[7]  M. Newton.  Approximate Bayesian-inference With the Weighted Likelihood Bootstrap , 1994 .

[8]  Andrew R. Liddle,et al.  Bayesian model averaging in astrophysics: a review , 2013, Stat. Anal. Data Min..

[9]  Jarrett J. Barber,et al.  Modelling map positional error to infer true feature location , 2006 .

[10]  E. George,et al.  APPROACHES FOR BAYESIAN VARIABLE SELECTION , 1997 .

[11]  M. Goddard,et al.  Prediction of total genetic value using genome-wide dense marker maps. , 2001, Genetics.

[12]  J. York,et al.  Bayesian Graphical Models for Discrete Data , 1995 .

[13]  Meili Baragatti,et al.  Bayesian Variable Selection for Probit Mixed Models Applied to Gene Selection , 2011, 1101.4577.

[14]  Karl J. Friston,et al.  Comparing Families of Dynamic Causal Models , 2010, PLoS Comput. Biol..

[15]  Nir Friedman,et al.  Being Bayesian About Network Structure. A Bayesian Approach to Structure Discovery in Bayesian Networks , 2004, Machine Learning.

[16]  S. Brooks,et al.  On the Bayesian analysis of population size , 2001 .

[17]  Xiao-Li Meng,et al.  Simulating Normalizing Constants: From Importance Sampling to Bridge Sampling to Path Sampling , 1998 .

[18]  Yike Guo,et al.  Option pricing under model and parameter uncertainty using predictive densities , 2002, Stat. Comput..

[19]  P. Haapasaari,et al.  Incorporating stakeholders' knowledge to stock assessment: Central Baltic herring , 2013 .

[20]  A. Raftery,et al.  Using Bayesian Model Averaging to Calibrate Forecast Ensembles , 2005 .

[21]  Keying Ye,et al.  Assessment of two approximation methods for computing posterior model probabilities , 2005, Comput. Stat. Data Anal..

[22]  A. Raftery,et al.  Default Priors and Predictive Performance in Bayesian Model Averaging, with Application to Growth Determinants , 2007 .

[23]  David J. Lunn.  Automated covariate selection and Bayesian model averaging in population PK/PD models , 2008, Journal of Pharmacokinetics and Pharmacodynamics.

[24]  Susan J. Simmons,et al.  Bayesian hierarchical regression models for detecting QTLs in plant experiments , 2008 .

[25]  Karl J. Friston,et al.  Variational free energy and the Laplace approximation , 2007, NeuroImage.

[26]  Ka Yee Yeung,et al.  The derivation of diagnostic markers of chronic myeloid leukemia progression from microarray data. , 2009, Blood.

[27]  T. Fearn,et al.  Bayes model averaging with selection of regressors , 2002 .

[28]  P. Garthwaite,et al.  SELECTION OF WEIGHTS FOR WEIGHTED MODEL AVERAGING , 2010 .

[29]  Brendan A. Wintle,et al.  The Use of Bayesian Model Averaging to Better Represent Uncertainty in Ecological Models , 2003 .

[30]  Adrian E. Raftery,et al.  Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors , 1999 .

[31]  Robert W. Wilson,et al.  Regressions by Leaps and Bounds , 2000, Technometrics.

[32]  George M. Furnival,et al.  Regressions by leaps and bounds , 2000 .

[33]  E. George,et al.  Journal of the American Statistical Association is currently published by American Statistical Association. , 2007 .

[34]  Wasserman,et al.  Bayesian Model Selection and Model Averaging. , 2000, Journal of mathematical psychology.

[35]  Gregory F. Cooper,et al.  Model Averaging for Prediction with Discrete Bayesian Networks , 2004, J. Mach. Learn. Res..

[36]  P. Green,et al.  Corrigendum: On Bayesian analysis of mixtures with an unknown number of components , 1997 .

[37]  Daniele Silvestro,et al.  DISENTANGLING THE EFFECTS OF KEY INNOVATIONS ON THE DIVERSIFICATION OF BROMELIOIDEAE (BROMELIACEAE) , 2014, Evolution; international journal of organic evolution.

[38]  Nial Friel,et al.  Estimating the evidence – a review , 2011, 1111.1957.

[39]  D. Conti,et al.  Bayesian Modeling of Complex Metabolic Pathways , 2003, Human Heredity.

[40]  Adrian E. Raftery,et al.  Iterative Bayesian Model Averaging: a method for the application of survival analysis to high-dimensional microarray data , 2009, BMC Bioinformatics.

[41]  D. Madigan,et al.  Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window , 1994 .

[42]  Cullen F. Goenner,et al.  Discrimination and Mortgage Lending in Boston: The Effects of Model Uncertainty , 2010 .

[43]  P. Green.  Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[44]  Ying Yuan,et al.  Bayesian Model Averaging Continual Reassessment Method in Phase I Clinical Trials , 2009 .

[45]  Hoon Kim,et al.  Monte Carlo Statistical Methods , 2000, Technometrics.

[46]  Walter R. Gilks,et al.  BUGS - Bayesian inference Using Gibbs Sampling Version 0.50 , 1995 .

[47]  A. Gelfand,et al.  Bayesian Model Choice: Asymptotics and Exact Calculations , 1994 .

[48]  Marina Vannucci,et al.  Investigating Multiple Candidate Genes and Nutrients in the Folate Metabolism Pathway to Detect Genetic and Nutritional Risk Factors for Lung Cancer , 2013, PloS one.

[49]  Cullen F. Goenner,et al.  Uncertainty of the Liberal Peace , 2004 .

[50]  Martyn Plummer,et al.  JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling , 2003 .

[51]  David Madigan,et al.  Bayesian Variable and Transformation Selection in Linear Regression , 2002 .

[52]  John Geweke,et al.  Federal Reserve Bank of Minneapolis Research Department Staff Report 249 Using Simulation Methods for Bayesian Econometric Models: Inference, Development, and Communication , 2022 .

[53]  Daniel Giamouridis,et al.  Hedge Fund Pricing and Model Uncertainty , 2008 .

[54]  P. Lichtner,et al.  The impact of genetic relationship information on genomic breeding values in German Holstein cattle , 2010, Genetics Selection Evolution.

[55]  Pia Mukherjee,et al.  Present and future evidence for evolving dark energy , 2006 .

[56]  M. Steel,et al.  Model uncertainty in cross-country growth regressions , 2001 .

[57]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[58]  Joseph Hogan,et al.  What Distinguishes Weight-Loss Maintainers from the Treatment-Seeking Obese? Analysis of Environmental, Behavioral, and Psychosocial Variables in Diverse Populations , 2009, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[59]  Xiao-Lin Wu,et al.  Modeling relationships between calving traits: a comparison between standard and recursive mixed models , 2010, Genetics Selection Evolution.

[60]  Ahmed Ghorbel,et al.  A survey of control-chart pattern-recognition literature (1991-2010) based on a new conceptual classification scheme , 2012, Comput. Ind. Eng..

[61]  M J Kelly,et al.  Genomic predictions in Angus cattle: comparisons of sample size, response variables, and clustering methods for cross-validation. , 2014, Journal of animal science.

[62]  S. Chib.  Marginal Likelihood from the Gibbs Output , 1995 .

[63]  K. McKelvey,et al.  Robust Detection of Rare Species Using Environmental DNA: The Importance of Primer Specificity , 2013, PloS one.

[64]  Shyam Visweswaran,et al.  Learning patient-specific predictive models from clinical data , 2010, J. Biomed. Informatics.

[65]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[66]  L Held,et al.  Estimation of the false negative fraction of a diagnostic kit through Bayesian regression model averaging , 2006, Statistics in medicine.

[67]  Gary Koop,et al.  Forecasting in Dynamic Factor Models Using Bayesian Model Averaging , 2004 .

[68]  Xiao-Li Meng,et al.  POSTERIOR PREDICTIVE ASSESSMENT OF MODEL FITNESS VIA REALIZED DISCREPANCIES , 1996 .

[69]  Ramón López de Mántaras,et al.  TAN Classifiers Based on Decomposable Distributions , 2005, Machine Learning.

[70]  Xiao-Li Meng,et al.  Posterior Predictive Assessment of Model Fitnessvia Realized , 1995 .

[71]  ScienceDirect.  Computational statistics & data analysis , 1983 .

[72]  Andrés González,et al.  An Early Warning Model for Predicting Credit Booms Using Macroeconomic Aggregates , 2012 .

[73]  Peter D. Loeb,et al.  Understanding the cell phone effect on vehicle fatalities: a Bayesian view , 2012 .

[74]  E. Conrad Lamon,et al.  Accounting for Model Uncertainty in Prediction of Chlorophyll a in , 2000 .

[75]  Sune Karlsson,et al.  Finding Good Predictors for Inflation: A Bayesian Model Averaging Approach , 2004 .

[76]  Adrian E. Raftery,et al.  Bayesian Model Averaging: A Tutorial , 2016 .

[77]  N. Lazar,et al.  Methods and Criteria for Model Selection , 2004 .

[78]  Yu Hayakawa,et al.  Capture–Recapture Estimation Using Finite Mixtures of Arbitrary Dimension , 2010, Biometrics.

[79]  B. Fridley.  Bayesian variable and model selection methods for genetic association studies , 2009, Genetic epidemiology.

[80]  Adrian E. Raftery,et al.  Bayesian model averaging: development of an improved multi-class, gene selection and classification tool for microarray data , 2005, Bioinform..

[81]  Cathy W. S. Chen,et al.  Bayesian subset selection for threshold autoregressive moving-average models , 2011, Comput. Stat..

[82]  Adrian E. Raftery,et al.  Prediction under Model Uncertainty Via Dynamic Model Averaging : Application to a Cold Rolling Mill 1 , 2008 .

[83]  A. Raftery.  Approximate Bayes factors and accounting for model uncertainty in generalised linear models , 1996 .

[84]  Chieh-Hsi Wu,et al.  Joint Inference of Microsatellite Mutation Models, Population History and Genealogies Using Transdimensional Markov Chain Monte Carlo , 2011, Genetics.

[85]  R. Fernando,et al.  Genomic prediction of simulated multibreed and purebred performance using observed fifty thousand single nucleotide polymorphism genotypes. , 2010, Journal of animal science.

[86]  Mario Medvedovic,et al.  Bayesian infinite mixture model based clustering of gene expression profiles , 2002, Bioinform..