Approximate Bayesian Computation using Markov Chain Monte Carlo simulation: DREAM(ABC)

The quest for a more powerful method for model evaluation has inspired Vrugt and Sadegh (2013) to introduce “likelihood‐free” inference as vehicle for diagnostic model evaluation. This class of methods is also referred to as Approximate Bayesian Computation (ABC) and relaxes the need for a residual‐based likelihood function in favor of one or multiple different summary statistics that exhibit superior diagnostic power. Here we propose several methodological improvements over commonly used ABC sampling methods to permit inference of complex system models. Our methodology entitled DREAM(ABC) uses the DiffeRential Evolution Adaptive Metropolis algorithm as its main building block and takes advantage of a continuous fitness function to efficiently explore the behavioral model space. Three case studies demonstrate that DREAM(ABC) is at least an order of magnitude more efficient than commonly used ABC sampling methods for more complex models. DREAM(ABC) is also more amenable to distributed, multi‐processor, implementation, a prerequisite to diagnostic inference of CPU‐intensive system models.

[1]  Jasper A. Vrugt,et al.  Bridging the gap between GLUE and formal statistical approaches: approximate Bayesian computation , 2013 .

[2]  George Kuczera,et al.  Pitfalls and improvements in the joint inference of heteroscedasticity and autocorrelation in hydrological model calibration , 2013 .

[3]  J. Vrugt,et al.  Toward diagnostic model calibration and evaluation: Approximate Bayesian computation , 2013 .

[4]  Jukka Corander,et al.  Approximate Bayesian Computation , 2013, PLoS Comput. Biol..

[5]  David J. Nott,et al.  Generalized likelihood uncertainty estimation (GLUE) and approximate Bayesian computation: What's the connection? , 2012 .

[6]  Brandon M. Turner,et al.  Approximate Bayesian computation with differential evolution , 2012 .

[7]  Arnaud Doucet,et al.  An adaptive sequential Monte Carlo method for approximate Bayesian computation , 2011, Statistics and Computing.

[8]  Brandon M. Turner,et al.  A tutorial on approximate Bayesian computation , 2012 .

[9]  Jasper A. Vrugt,et al.  High‐dimensional posterior exploration of hydrologic models using multiple‐try DREAM(ZS) and high‐performance computing , 2012 .

[10]  Jasper A. Vrugt,et al.  UvA-DARE ( Digital Academic Repository ) DREAM ( D ) : An adaptive Markov chain Monte Carlo simulation algorithm to solve discrete , noncontinuous , and combinatorial posterior parameter estimation problems , 2011 .

[11]  Sarah Filippi,et al.  Considerate approaches to achieving sufficiency for ABC model selection , 2011, 1106.6281.

[12]  Tyler Smith,et al.  Development of a formal likelihood function for improved Bayesian inference of ephemeral catchments , 2010 .

[13]  J. Vrugt,et al.  A formal likelihood function for parameter and predictive inference of hydrologic models with correlated, heteroscedastic, and non‐Gaussian errors , 2010 .

[14]  M. Clark,et al.  Ancient numerical daemons of conceptual hydrological modeling: 2. Impact of time stepping schemes on model analysis and prediction , 2010 .

[15]  Dmitri Kavetski,et al.  Ancient numerical daemons of conceptual hydrological modeling: 1. Fidelity and efficiency of time stepping schemes , 2010 .

[16]  O. François,et al.  Approximate Bayesian Computation (ABC) in practice. , 2010, Trends in ecology & evolution.

[17]  G. Bertorelle,et al.  ABC as a flexible framework to estimate demography over space and time: some cons, many pros , 2010, Molecular ecology.

[18]  L. Excoffier,et al.  Efficient Approximate Bayesian Computation Coupled With Markov Chain Monte Carlo Without Likelihood , 2009, Genetics.

[19]  Christophe Andrieu,et al.  Model criticism based on likelihood-free inference, with an application to protein network evolution , 2009, Proceedings of the National Academy of Sciences.

[20]  David Welch,et al.  Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems , 2009, Journal of The Royal Society Interface.

[21]  Cajo J. F. ter Braak,et al.  Treatment of input uncertainty in hydrologic modeling: Doing hydrology backward with Markov chain Monte Carlo simulation , 2008 .

[22]  Olivier François,et al.  Non-linear regression models for Approximate Bayesian Computation , 2008, Stat. Comput..

[23]  Yuqiong Liu,et al.  Reconciling theory with observations: elements of a diagnostic approach to model evaluation , 2008 .

[24]  Paul Marjoram,et al.  Statistical Applications in Genetics and Molecular Biology Approximately Sufficient Statistics and Bayesian Computation , 2011 .

[25]  C. Robert,et al.  ABC likelihood-free methods for model choice in Gibbs random fields , 2008, 0807.2767.

[26]  C. Robert,et al.  Adaptive approximate Bayesian computation , 2008, 0805.2256.

[27]  S. Saint,et al.  Clinical problem-solving. What's the connection? - A 26-year-old white man presented to our referral hospital with a 1-month history of persistent cough productive of white sputum, which was occasionally tinged with blood. , 2008, The New England journal of medicine.

[28]  Mark M. Tanaka,et al.  Sequential Monte Carlo without likelihoods , 2007, Proceedings of the National Academy of Sciences.

[29]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[30]  Paul Marjoram,et al.  Markov chain Monte Carlo without likelihoods , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[31]  D. Balding,et al.  Approximate Bayesian computation in population genetics. , 2002, Genetics.

[32]  H. Haario,et al.  An adaptive Metropolis algorithm , 2001 .

[33]  M. Feldman,et al.  Population growth of human Y chromosomes: a study of Y chromosome microsatellites. , 1999, Molecular biology and evolution.

[34]  Heikki Haario,et al.  Adaptive proposal distribution for random walk Metropolis algorithm , 1999, Comput. Stat..

[35]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[36]  T. Higuchi.  Monte carlo filter using the genetic algorithm operators , 1997 .

[37]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[38]  S. Sorooshian,et al.  Effective and efficient global optimization for conceptual rainfall‐runoff models , 1992 .

[39]  Leif H. Finkel,et al.  What's the connection? , 1986, Behavioral and Brain Sciences.

[40]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[41]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[42]  M. Gutmann,et al.  Approximate Bayesian Computation , 2012 .

[43]  R. Plevin,et al.  Approximate Bayesian Computation in Evolution and Ecology , 2011 .

[44]  D. Higdon,et al.  Accelerating Markov Chain Monte Carlo Simulation by Differential Evolution with Self-Adaptive Randomized Subspace Sampling , 2009 .

[45]  Eero Saksman,et al.  Adaptive proposal distribution for random walkMetropolis , 1999 .

[46]  P. Diggle,et al.  Monte Carlo Methods of Inference for Implicit Statistical Models , 1984 .