Bayesian parameter inference for partially observed stopped processes

We consider Bayesian parameter inference associated to partially-observed stochastic processes that start from a set B0 and are stopped or killed at the first hitting time of a known set A. Such processes occur naturally within the context of a wide variety of applications. The associated posterior distributions are highly complex and posterior parameter inference requires the use of advanced Markov chain Monte Carlo (MCMC) techniques. Our approach uses a recently introduced simulation methodology, particle Markov chain Monte Carlo (PMCMC) (Andrieu et al. 2010), where sequential Monte Carlo (SMC) (Doucet et al. 2001; Liu 2001) approximations are embedded within MCMC. However, when the parameter of interest is fixed, standard SMC algorithms are not always appropriate for many stopped processes. In Chen et al. (2005), Del Moral (2004), the authors introduce SMC approximations of multi-level Feynman-Kac formulae, which can lead to more efficient algorithms. This is achieved by devising a sequence of sets from B0 to A and then performing the resampling step only when the samples of the process reach intermediate sets in the sequence. The choice of the intermediate sets is critical to the performance of such a scheme. In this paper, we demonstrate that multi-level SMC algorithms can be used as a proposal in PMCMC. In addition, we introduce a flexible strategy that adapts the sets for different parameter proposals. Our methodology is illustrated on the coalescent model with migration.

[1]  P. Moral,et al.  Sequential Monte Carlo samplers , 2002, cond-mat/0212648.

[2]  C. Andrieu,et al.  The pseudo-marginal approach for efficient Monte Carlo computations , 2009, 0903.5480.

[3]  Yee Whye Teh,et al.  An Efficient Sequential Monte Carlo Algorithm for Coalescent Clustering , 2008, NIPS.

[4]  Jaroslav Krystul,et al.  Sampling per mode simulation for switching diffusions , 2010 .

[5]  Enrico Bibbona,et al.  Estimation in Discretely Observed Diffusions Killed at a Threshold , 2010, 1011.1356.

[6]  Jan M. Maciejowski,et al.  On Particle Methods for Parameter Estimation in General State-Space Models , 2015 .

[7]  J. Rosenthal,et al.  Coupling and Ergodicity of Adaptive Markov Chain Monte Carlo Algorithms , 2007, Journal of Applied Probability.

[8]  Gareth O. Roberts,et al.  Quantitative Non-Geometric Convergence Bounds for Independence Samplers , 2011 .

[9]  Neil J. Gordon,et al.  Editors: Sequential Monte Carlo Methods in Practice , 2001 .

[10]  J.S. Sadowsky,et al.  On large deviations theory and asymptotically efficient Monte Carlo estimation , 1990, IEEE Trans. Inf. Theory.

[11]  Arnaud Doucet,et al.  On the Utility of Graphics Cards to Perform Massively Parallel Simulation of Advanced Monte Carlo Methods , 2009, Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America.

[12]  P. Moral,et al.  Rare event simulation for a static distribution , 2009 .

[13]  A. Doucet,et al.  One-line Parameter Estimation in General State-Space Models using a Pseudo-Likelihood Approach , 2012 .

[14]  P. Moral,et al.  Genealogical particle analysis of rare events , 2005, math/0602525.

[15]  P. Moral,et al.  A non asymptotic variance theorem for unnormalized Feynman-Kac particle models , 2008 .

[16]  A. Doucet,et al.  On-Line Parameter Estimation in General State-Space Models , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[17]  P. Donnelly,et al.  Inference in molecular population genetics , 2000 .

[18]  Timothy J. Robinson,et al.  Sequential Monte Carlo Methods in Practice , 2003 .

[19]  O. Papaspiliopoulos,et al.  SMC^2: A sequential Monte Carlo algorithm with particle Markov chain Monte Carlo updates , 2011 .

[20]  P. Moral,et al.  A nonasymptotic theorem for unnormalized Feynman-Kac particle models , 2011 .

[21]  David J. Balding,et al.  Inferences from DNA data: population histories, evolutionary processes and forensic match probabilities , 2003 .

[22]  Nicolas Chopin,et al.  SMC2: an efficient algorithm for sequential analysis of state space models , 2011, 1101.1528.

[23]  Jun S. Liu,et al.  Monte Carlo strategies in scientific computing , 2001 .

[24]  C. Simulating Probability Distributions in the Coalescent * , 2022 .

[25]  A. Doucet,et al.  Efficient Bayesian Inference for Switching State-Space Models using Discrete Particle Markov Chain Monte Carlo Methods , 2010, 1011.2437.

[26]  Yuguo Chen,et al.  Stopping‐time resampling for sequential Monte Carlo methods , 2005 .

[27]  Enrico Bibbona,et al.  Estimation in discretely observed Markov processes killed at a threshold , 2010 .

[28]  S. J. Koopman Discussion of `Particle Markov chain Monte Carlo methods – C. Andrieu, A. Doucet and R. Holenstein’ [Review of: Particle Markov chain Monte Carlo methods] , 2010 .

[29]  Paul Glasserman,et al.  Multilevel Splitting for Estimating Rare Event Probabilities , 1999, Oper. Res..

[30]  P. Moral,et al.  Sequential Monte Carlo samplers for rare events , 2006 .

[31]  J. Kingman On the genealogy of large populations , 1982, Journal of Applied Probability.

[32]  Jeffrey S. Rosenthal,et al.  Coupling and Ergodicity of Adaptive MCMC , 2007 .

[33]  M. De Iorio,et al.  Importance sampling on coalescent histories. II: Subdivided population models , 2004, Advances in Applied Probability.

[34]  A. Doucet,et al.  Particle Markov chain Monte Carlo methods , 2010 .

[35]  Darren J. Wilkinson,et al.  Discussion of Particle Markov chain Monte Carlo , 2008 .

[36]  Robert C. Griffiths,et al.  Coalescence time for two genes from a subdivided population , 2001, Journal of mathematical biology.

[37]  Pierre Del Moral,et al.  Sequential Monte Carlo for rare event estimation , 2012, Stat. Comput..

[38]  Henk A. P. Blom,et al.  Probabilistic reachability analysis for large scale stochastic hybrid systems , 2007, 2007 46th IEEE Conference on Decision and Control.

[39]  P. Moral Feynman-Kac Formulae: Genealogical and Interacting Particle Systems with Applications , 2004 .

[40]  G. Roberts,et al.  Exact Monte Carlo simulation of killed diffusions , 2008, Advances in Applied Probability.

[41]  P. Dupuis,et al.  Splitting for rare event simulation : A large deviation approach to design and analysis , 2007, 0711.2037.

[42]  F. Cérou,et al.  Adaptive Multilevel Splitting for Rare Event Analysis , 2007 .