A Likelihood-Free Reverse Sampler of the Posterior Distribution

This paper considers properties of an optimization based sampler for targeting the posterior distribution when the likelihood is intractable and auxiliary statistics are used to summarize information in the data. Our reverse sampler approximates the likelihood-based posterior distribution by solving a sequence of simulated minimum distance problems. By a change of variable argument, these estimates are reweighted with a prior and the volume of the jacobian matrix to serve as draws from the desired posterior distribution. The sampler provides a conceptual framework to understand the difference between two types of likelihood free estimation. Because simulated minimum distance estimation always results in acceptable draws, the reverse sampler is potentially an alternative to existing approximate Bayesian methods that are computationally demanding because of a low acceptance rate.

[1]  A. Ullah,et al.  Nonparametric Econometrics: Semiparametric and Nonparametric Estimation of Simultaneous Equation Models , 1999 .

[2]  Aman Ullah,et al.  The second-order bias and mean squared error of nonlinear estimators , 1996 .

[3]  Jean-Jacques Forneron,et al.  The ABC of simulation estimation with auxiliary statistics , 2015, Journal of Econometrics.

[4]  D. Duffie,et al.  Simulated Moments Estimation of Markov Models of Asset Prices , 1990 .

[5]  Yong Bao,et al.  The Second-Order Bias and Mean Squared Error of Estimators in Time Series Models , 2007 .

[6]  Paul Marjoram,et al.  Markov chain Monte Carlo without likelihoods , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[7]  D. Balding,et al.  Approximate Bayesian computation in population genetics. , 2002, Genetics.

[8]  Mike West,et al.  Sequential Monte Carlo with Adaptive Weights for Approximate Bayesian Computation , 2015, 1503.07791.

[9]  S. Sisson,et al.  Likelihood-free Markov chain Monte Carlo , 2010, 1001.2058.

[10]  David Welch,et al.  Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems , 2009, Journal of The Royal Society Interface.

[11]  Dennis Kristensen,et al.  INDIRECT LIKELIHOOD INFERENCE , 2013 .

[12]  Wenxin Jiang,et al.  The Indirect Method: Inference Based on Intermediate Statistics—A Synthesis and Examples , 2004 .

[13]  Guillaume Deffuant,et al.  Adaptive approximate Bayesian computation for complex models , 2011, Computational Statistics.

[14]  P. Donnelly,et al.  Inferring coalescence times from DNA sequence data. , 1997, Genetics.

[15]  W. Newey,et al.  Large sample estimation and hypothesis testing , 1986 .

[16]  Edward Meeds,et al.  Optimization Monte Carlo: Efficient and Embarrassingly Parallel Likelihood-Free Inference , 2015, Neural Information Processing Systems.

[17]  Max Welling,et al.  Optimization Monte Carlo: Efficient and Embarrassingly Parallel Likelihood-Free Inference , 2015, NIPS.

[18]  Michael Creel,et al.  On selection of statistics for approximate Bayesian computing (or the method of simulated moments) , 2016, Comput. Stat. Data Anal..

[19]  M. Blum Approximate Bayesian Computation: A Nonparametric Perspective , 2009, 0904.0635.

[20]  Mark M. Tanaka,et al.  Sequential Monte Carlo without likelihoods , 2007, Proceedings of the National Academy of Sciences.

[21]  M. Feldman,et al.  Population growth of human Y chromosomes: a study of Y chromosome microsatellites. , 1999, Molecular biology and evolution.

[22]  R. Wilkinson Approximate Bayesian computation (ABC) gives exact results under the assumption of model error , 2008, Statistical applications in genetics and molecular biology.

[23]  Anthony N. Pettitt,et al.  Melanoma Cell Colony Expansion Parameters Revealed by Approximate Bayesian Computation , 2015, PLoS Comput. Biol..

[24]  Anthony A. Smith,et al.  Estimating Nonlinear Time-Series Models Using Simulated Vector Autoregressions , 1993 .

[25]  K. Pearson,et al.  Biometrika , 1902, The American Naturalist.

[26]  Adi Ben-Israel,et al.  The Change-of-Variables Formula Using Matrix Volume , 1999, SIAM J. Matrix Anal. Appl..

[27]  Joseph V. Roberti The Indirect Method , 1987 .

[28]  Adi Ben-Israel An application of the matrix volume in probability , 2000 .

[29]  Serena Ng,et al.  Estimating the rational expectations model of speculative storage: A Monte Carlo comparison of three simulation estimators , 2000 .

[30]  Andrew Gelman,et al.  Handbook of Markov Chain Monte Carlo , 2011 .

[31]  A. Gallant,et al.  Which Moments to Match? , 1995, Econometric Theory.