Sequential Monte Carlo with Adaptive Weights for Approximate Bayesian Computation

Methods of approximate Bayesian computation (ABC) are increasingly used for analysis of complex models. A major challenge for ABC is over-coming the often inherent problem of high rejection rates in the accept/reject methods based on prior:predictive sampling. A number of recent developments aim to address this with extensions based on sequential Monte Carlo (SMC) strategies. We build on this here, introducing an ABC SMC method that uses data-based adaptive weights. This easily implemented and computationally trivial extension of ABC SMC can very substantially improve acceptance rates, as is demonstrated in a series of examples with simulated and real data sets, including a currently topical example from dynamic modelling in systems biology applications.

[1]  David Welch,et al.  Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems , 2009, Journal of The Royal Society Interface.

[2]  Jean-Marie Cornuet,et al.  Adaptive Multiple Importance Sampling , 2009, 0907.1254.

[3]  A. Cook,et al.  Inference in Epidemic Models without Likelihoods , 2009 .

[4]  D. Balding,et al.  Approximate Bayesian computation in population genetics. , 2002, Genetics.

[5]  J. Collins,et al.  Construction of a genetic toggle switch in Escherichia coli , 2000, Nature.

[6]  Brandon M. Turner,et al.  Journal of Mathematical Psychology a Tutorial on Approximate Bayesian Computation , 2022 .

[7]  S. Filippi,et al.  Optimizing threshold-schedules for sequential approximate Bayesian computation: applications to molecular systems , 2013, Statistical applications in genetics and molecular biology.

[8]  Correction for Sisson et al., Sequential Monte Carlo without likelihoods , 2009, Proceedings of the National Academy of Sciences.

[9]  D. W. Scott,et al.  Multidimensional Density Estimation , 2005 .

[10]  Arnaud Doucet,et al.  An adaptive sequential Monte Carlo method for approximate Bayesian computation , 2011, Statistics and Computing.

[11]  P. Moral,et al.  Sequential Monte Carlo samplers , 2002, cond-mat/0212648.

[12]  Michael A. West,et al.  Combined Parameter and State Estimation in Simulation-Based Filtering , 2001, Sequential Monte Carlo Methods in Practice.

[13]  Mike West,et al.  Bayesian Learning from Marginal Data in Bionetwork Models , 2011, Statistical applications in genetics and molecular biology.

[14]  Michael P. H. Stumpf,et al.  Simulation-based model selection for dynamical systems in systems and population biology , 2009, Bioinform..

[15]  Erika Cule,et al.  ABC-SysBio—approximate Bayesian computation in Python with GPU support , 2010, Bioinform..

[16]  Cliburn Chan,et al.  Understanding GPU Programming for Statistical Computation: Studies in Massively Parallel Massive Mixtures , 2010, Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America.

[17]  B. Silverman.  Density estimation for statistics and data analysis , 1986 .

[18]  O. François,et al.  Approximate Bayesian Computation (ABC) in practice. , 2010, Trends in ecology & evolution.

[19]  Mike West,et al.  Efficient Classification-Based Relabeling in Mixture Models , 2011, The American statistician.

[20]  K. Heggland,et al.  Estimating functions in indirect inference , 2004 .

[21]  Jun S. Liu,et al.  Monte Carlo strategies in scientific computing , 2001 .

[22]  Mark M. Tanaka,et al.  Sequential Monte Carlo without likelihoods , 2007, Proceedings of the National Academy of Sciences.

[23]  Olivier François,et al.  Non-linear regression models for Approximate Bayesian Computation , 2008, Stat. Comput..

[24]  M. West.  Approximating posterior distributions by mixtures , 1993 .

[25]  M. Feldman,et al.  Population growth of human Y chromosomes: a study of Y chromosome microsatellites. , 1999, Molecular biology and evolution.

[26]  Daniel Silk,et al.  Optimizing Threshold - Schedules for Approximate Bayesian Computation Sequential Monte Carlo Samplers: Applications to Molecular Systems , 2012 .

[27]  D. W. Scott,et al.  Multivariate Density Estimation, Theory, Practice and Visualization , 1992 .

[28]  Guillaume Deffuant,et al.  Adaptive approximate Bayesian computation for complex models , 2011, Computational Statistics.

[29]  Paul Fearnhead,et al.  Constructing summary statistics for approximate Bayesian computation: semi‐automatic approximate Bayesian computation , 2012 .

[30]  T. Amemiya.  Non-linear regression models , 1983 .

[31]  Julien Cornebise,et al.  On optimality of kernels for approximate Bayesian computation using sequential Monte Carlo , 2011, Statistical applications in genetics and molecular biology.

[32]  M. J. Fryer.  A Review of Some Non-parametric Methods of Density Estimation , 1977 .

[33]  A. N. Pettitt,et al.  Approximate Bayesian Computation for astronomical model analysis: a case study in galaxy demographics and morphological transformation at high redshift , 2012, 1202.1426.

[34]  Paul Marjoram,et al.  Markov chain Monte Carlo without likelihoods , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[35]  C. D. Kemp,et al.  Density Estimation for Statistics and Data Analysis , 1987 .