Fundamentals and Recent Developments in Approximate Bayesian Computation

&NA; Bayesian inference plays an important role in phylogenetics, evolutionary biology, and in many other branches of science. It provides a principled framework for dealing with uncertainty and quantifying how it changes in the light of new evidence. For many complex models and inference problems, however, only approximate quantitative answers are obtainable. Approximate Bayesian computation (ABC) refers to a family of algorithms for approximate inference that makes a minimal set of assumptions by only requiring that sampling from a model is possible. We explain here the fundamentals of ABC, review the classical algorithms, and highlight recent developments. [ABC; approximate Bayesian computation; Bayesian inference; likelihood‐free inference; phylogenetics; simulator‐based models; stochastic simulation models; tree‐based models.]

[1]  P. Diggle,et al.  Monte Carlo Methods of Inference for Implicit Statistical Models , 1984 .

[2]  D. Rubin.  Bayesianly Justifiable and Relevant Frequency Calculations for the Applied Statistician , 1984 .

[3]  D. Pollard,et al.  Simulation and the Asymptotics of Optimization Estimators , 1989 .

[4]  D. McFadden.  A Method of Simulated Moments for Estimation of Discrete Response Models Without Numerical Integration , 1989 .

[5]  A. Benveniste,et al.  Rate of Convergence , 1990 .

[6]  P. Kaye.  Infectious diseases of humans: Dynamics and control , 1993 .

[7]  Huaiyu Zhu.  On Information and Sufficiency , 1997 .

[8]  M. Feldman,et al.  Population growth of human Y chromosomes: a study of Y chromosome microsatellites. , 1999, Molecular biology and evolution.

[9]  Hoon Kim,et al.  Monte Carlo Statistical Methods , 2000, Technometrics.

[10]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[11]  D. Balding,et al.  Approximate Bayesian computation in population genetics. , 2002, Genetics.

[12]  Paul Marjoram,et al.  Markov chain Monte Carlo without likelihoods , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[13]  K. Heggland,et al.  Estimating functions in indirect inference , 2004 .

[14]  L. Excoffier,et al.  Modern Humans Did Not Admix with Neanderthals during Their Range Expansion into Europe , 2004, PLoS biology.

[15]  Andrew R. Francis,et al.  Using Approximate Bayesian Computation to Estimate Tuberculosis Transmission Parameters From Genotype Data , 2006, Genetics.

[16]  H A Lessios,et al.  TEST FOR SIMULTANEOUS DIVERGENCE USING APPROXIMATE BAYESIAN COMPUTATION , 2006, Evolution; international journal of organic evolution.

[17]  L. Excoffier,et al.  Statistical evaluation of alternative models of human evolution , 2007, Proceedings of the National Academy of Sciences.

[18]  Mark M. Tanaka,et al.  Sequential Monte Carlo without likelihoods , 2007, Proceedings of the National Academy of Sciences.

[19]  David Welch,et al.  Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems , 2009, Journal of The Royal Society Interface.

[20]  Paul Marjoram,et al.  Statistical Applications in Genetics and Molecular Biology Approximately Sufficient Statistics and Bayesian Computation , 2011 .

[21]  M. Blum.  Approximate Bayesian Computation: A Nonparametric Perspective , 2009, 0904.0635.

[22]  Adam Powell,et al.  The Origins of Lactase Persistence in Europe , 2009, PLoS Comput. Biol..

[23]  C. Robert,et al.  Adaptive approximate Bayesian computation , 2008, 0805.2256.

[24]  L. Excoffier,et al.  Efficient Approximate Bayesian Computation Coupled With Markov Chain Monte Carlo Without Likelihood , 2009, Genetics.

[25]  Christophe Andrieu,et al.  Model criticism based on likelihood-free inference, with an application to protein network evolution , 2009, Proceedings of the National Academy of Sciences.

[26]  Daniel Wegmann,et al.  Bayesian Computation and Model Selection Without Likelihoods , 2010, Genetics.

[27]  M. Beaumont.  Approximate Bayesian Computation in Evolution and Ecology , 2010 .

[28]  S. Wood.  Statistical inference for noisy nonlinear ecological dynamic systems , 2010, Nature.

[29]  Nando de Freitas,et al.  A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning , 2010, ArXiv.

[30]  D. Balding,et al.  Statistical Applications in Genetics and Molecular Biology On Optimal Selection of Summary Statistics for Approximate Bayesian Computation , 2011 .

[31]  Olivier François,et al.  Non-linear regression models for Approximate Bayesian Computation , 2008, Stat. Comput..

[32]  T. Stadler.  Inferring Epidemiological Parameters on the Basis of Allele Frequencies , 2011, Genetics.

[33]  R. Plevin,et al.  Approximate Bayesian Computation in Evolution and Ecology , 2011 .

[34]  Laura S Kubatko,et al.  Estimating species trees using approximate Bayesian computation. , 2011, Molecular phylogenetics and evolution.

[35]  Paul Fearnhead,et al.  Constructing summary statistics for approximate Bayesian computation: semi‐automatic approximate Bayesian computation , 2012 .

[36]  J. Møller.  Discussion on the paper by Feranhead and Prangle , 2012 .

[37]  Katia Koelle,et al.  Phylodynamic Inference and Model Assessment with Approximate Bayesian Computation: Influenza as a Case Study , 2012, PLoS Comput. Biol..

[38]  Arnaud Guyader,et al.  New insights into Approximate Bayesian Computation , 2012, 1207.6461.

[39]  Jean-Michel Marin,et al.  Approximate Bayesian computational methods , 2011, Statistics and Computing.

[40]  A. Futschik,et al.  A Novel Approach for Choosing Summary Statistics in Approximate Bayesian Computation , 2012, Genetics.

[41]  Daniel Wegmann,et al.  FITTING MODELS OF CONTINUOUS TRAIT EVOLUTION TO INCOMPLETELY SAMPLED COMPARATIVE DATA USING APPROXIMATE BAYESIAN COMPUTATION , 2012, Evolution; international journal of organic evolution.

[42]  L. Excoffier,et al.  Robust Demographic Inference from Genomic and SNP Data , 2013, PLoS genetics.

[43]  S. Filippi,et al.  Optimizing threshold-schedules for sequential approximate Bayesian computation: applications to molecular systems , 2013, Statistical applications in genetics and molecular biology.

[44]  Muhammad Faisal,et al.  A new approach to choose acceptance cutoff for approximate Bayesian computation , 2013 .

[45]  S. Sisson,et al.  A comparative review of dimension reduction methods in approximate Bayesian computation , 2012, 1202.3819.

[46]  Stuart Barber,et al.  The Rate of Convergence for Approximate Bayesian Computation , 2013, 1311.2038.

[47]  S. Sisson,et al.  Diagnostic tools for approximate Bayesian computation using the coverage property , 2013, 1301.3166.

[48]  Max Welling,et al.  GPS-ABC: Gaussian Process Surrogate Approximate Bayesian Computation , 2014, UAI.

[49]  M. Gutmann,et al.  Statistical Inference of Intractable Generative Models via Classification , 2014 .

[50]  Richard Wilkinson,et al.  Accelerating ABC methods using Gaussian processes , 2014, AISTATS.

[51]  M. Gutmann,et al.  Recombination produces coherent bacterial species clusters in both core and accessory genomes , 2015, Microbial genomics.

[52]  Christian P. Robert,et al.  Bayesian computation: a summary of the current state, and samples backwards and forwards , 2015, Statistics and Computing.

[53]  P. Crescenzi,et al.  Cophylogeny Reconstruction via an Approximate Bayesian Computation , 2014, Systematic biology.

[54]  Matthew A. Nunes,et al.  abctools: An R Package for Tuning Approximate Bayesian Computation Analyses , 2015, R J..

[55]  Aurélien Garivier,et al.  On the Complexity of Best-Arm Identification in Multi-Armed Bandit Models , 2014, J. Mach. Learn. Res..

[56]  Michael U. Gutmann,et al.  Bayesian Optimization for Likelihood-Free Inference of Simulator-Based Statistical Models , 2015, J. Mach. Learn. Res..

[57]  Jukka Corander,et al.  On the Identifiability of Transmission Dynamic Models for Infectious Diseases , 2015, Genetics.

[58]  Jukka Corander,et al.  Fundamentals and Recent Developments in Approximate Bayesian Computation. , 2016, Systematic biology.

[59]  Scott A. Sisson,et al.  Extending approximate Bayesian computation methods to high dimensions via a Gaussian copula model , 2015, 1504.04093.