Unbiased Inference for Discretely Observed Hidden Markov Model Diffusions

We develop a Bayesian inference method for diffusions observed discretely and with noise, which is free of discretisation bias. Unlike existing unbiased inference methods, our method does not rely on exact simulation techniques. Instead, our method uses standard time-discretised approximations of diffusions, such as the Euler--Maruyama scheme. Our approach is based on particle marginal Metropolis--Hastings, a particle filter, randomised multilevel Monte Carlo, and importance sampling type correction of approximate Markov chain Monte Carlo. The resulting estimator leads to inference without a bias from the time-discretisation as the number of Markov chain iterations increases. We give convergence results and recommend allocations for algorithm inputs. Our method admits a straightforward parallelisation, and can be computationally efficient. The user-friendly approach is illustrated on three examples, where the underlying diffusion is an Ornstein--Uhlenbeck process, a geometric Brownian motion, and a 2d non-reversible Langevin equation.

[1]  P. Fearnhead,et al.  Exact and computationally efficient likelihood‐based estimation for discretely observed diffusion processes (with discussion) , 2006 .

[2]  A. Doucet,et al.  Particle Markov chain Monte Carlo methods , 2010 .

[3]  G. Pavliotis Stochastic Processes and Applications: Diffusion Processes, the Fokker-Planck and Langevin Equations , 2014 .

[4]  J. Blanchet,et al.  Exact simulation for multivariate Itô diffusions , 2017, Advances in Applied Probability.

[5]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[6]  A. Doucet,et al.  Efficient implementation of Markov chain Monte Carlo when using an unbiased likelihood estimator , 2012, 1210.1871.

[7]  Yan Zhou,et al.  Bayesian Static Parameter Estimation for Partially Observed Diffusions via Multilevel Monte Carlo , 2017, SIAM J. Sci. Comput..

[8]  M. Giles,et al.  Antithetic multilevel Monte Carlo estimation for multi-dimensional SDEs without Lévy area simulation , 2012, 1202.6283.

[9]  Ajay Jasra,et al.  Multilevel particle filters for Lévy-driven stochastic differential equations , 2018, Stat. Comput..

[10]  H. Haario,et al.  An adaptive Metropolis algorithm , 2001 .

[11]  Michael Sørensen,et al.  Importance sampling techniques for estimation of diffusion models , 2012 .

[12]  Don McLeish,et al.  A general method for debiasing a Monte Carlo estimator , 2010, Monte Carlo Methods Appl..

[13]  Michael B. Giles,et al.  Multilevel Monte Carlo Path Simulation , 2008, Oper. Res..

[14]  Haikady N. Nagaraja,et al.  Inference in Hidden Markov Models , 2006, Technometrics.

[15]  Matti Vihola,et al.  Unbiased Estimators and Multilevel Monte Carlo , 2015, Oper. Res..

[16]  Ajay Jasra,et al.  A MULTI-INDEX MARKOV CHAIN MONTE CARLO METHOD , 2017, 1704.00117.

[17]  K. A. Cliffe,et al.  Multilevel Monte Carlo methods and applications to elliptic PDEs with random coefficients , 2011, Comput. Vis. Sci..

[18]  Pierre Del Moral,et al.  Feynman-Kac formulae , 2004 .

[19]  P. Fearnhead,et al.  Random‐weight particle filtering of continuous time processes , 2010 .

[20]  P. Kloeden,et al.  Numerical Solution of Stochastic Differential Equations , 1992 .

[21]  Fredrik Lindsten,et al.  Coupling of Particle Filters , 2016, 1606.01156.

[22]  Eric Moulines,et al.  Inference in hidden Markov models , 2010, Springer series in statistics.

[23]  Yee Whye Teh,et al.  An Exact Auxiliary Variable Gibbs Sampler for a Class of Diffusions , 2019, J. Comput. Graph. Stat..

[24]  Yan Zhou,et al.  Multilevel Sequential Monte Carlo with Dimension-Independent Likelihood-Informed Proposals , 2017, SIAM/ASA J. Uncertain. Quantification.

[25]  Stefan Heinrich,et al.  Multilevel Monte Carlo Methods , 2001, LSSC.

[26]  Matti Vihola,et al.  Importance sampling correction versus standard averages of reversible MCMCs in terms of the asymptotic variance , 2017, 1706.09873.

[27]  Henrik Madsen,et al.  From State Dependent Diffusion to Constant Diffusion in Stochastic Differential Equations by the Lamperti Transform , 2010 .

[28]  Jouni Helske,et al.  Importance sampling type estimators based on approximate marginal Markov chain Monte Carlo , 2016, Scandinavian Journal of Statistics.

[29]  Paul Fearnhead,et al.  Continious-time Importance Sampling: Monte Carlo Methods which Avoid Time-discretisation Error , 2017, 1712.06201.

[30]  Sumeetpal S. Singh,et al.  On particle Gibbs sampling , 2013, 1304.1887.

[31]  Peter W. Glynn,et al.  Unbiased Estimation with Square Root Convergence for SDE Models , 2015, Oper. Res..

[32]  J. Rosenthal,et al.  Harris recurrence of Metropolis-within-Gibbs and trans-dimensional Markov chains , 2006, math/0702412.

[33]  M. Li,et al.  Particle Markov chain Monte Carlo methods , 2015 .

[34]  Ward Whitt,et al.  The Asymptotic Efficiency of Simulation Estimators , 1992, Oper. Res..

[35]  Yan Zhou,et al.  Multilevel Sequential Monte Carlo Samplers for Normalizing Constants , 2016, ACM Trans. Model. Comput. Simul..

[36]  P. Fearnhead,et al.  Particle filters for partially observed diffusions , 2007, 0710.4245.

[37]  William Feller,et al.  A Limit Theorem for Random Variables with Infinite Moments , 1946 .

[38]  Kody J. H. Law,et al.  Multilevel ensemble Kalman filtering , 2015, SIAM J. Numer. Anal..

[39]  Paul Fearnhead,et al.  Markov Chain Monte Carlo for Exact Inference for Diffusions , 2011, 1102.5541.

[40]  G. Roberts,et al.  Exact simulation of diffusions , 2005, math/0602523.

[41]  Yan Zhou,et al.  Multilevel Particle Filters , 2015, SIAM J. Numer. Anal..

[42]  Eric Moulines,et al.  Comparison of resampling schemes for particle filtering , 2005, ISPA 2005. Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, 2005..

[43]  Darren J Wilkinson,et al.  Bayesian parameter inference for stochastic biochemical network models using particle Markov chain Monte Carlo , 2011, Interface Focus.

[44]  Christophe Andrieu,et al.  A tutorial on adaptive MCMC , 2008, Stat. Comput..

[45]  H. Sørensen Parametric Inference for Diffusion Processes Observed at Discrete Points in Time: a Survey , 2004 .

[46]  J. Rosenthal,et al.  On the efficiency of pseudo-marginal random walk Metropolis algorithms , 2013, The Annals of Statistics.