A MULTI-INDEX MARKOV CHAIN MONTE CARLO METHOD

In this article we consider computing expectations w.r.t.~probability laws associated to a certain class of stochastic systems. In order to achieve such a task, one must not only resort to numerical approximation of the expectation, but also to a biased discretization of the associated probability. We are concerned with the situation for which the discretization is required in multiple dimensions, for instance in space and time. In such contexts, it is known that the multi-index Monte Carlo (MIMC) method can improve upon i.i.d.~sampling from the most accurate approximation of the probability law. Indeed by a non-trivial modification of the multilevel Monte Carlo (MLMC) method and it can reduce the work to obtain a given level of error, relative to the afore mentioned i.i.d.~sampling and relative even to MLMC. In this article we consider the case when such probability laws are too complex to sampled independently. We develop a modification of the MIMC method which allows one to use standard Markov chain Monte Carlo (MCMC) algorithms to replace independent and coupled sampling, in certain contexts. We prove a variance theorem which shows that using our MIMCMC method is preferable, in the sense above, to i.i.d.~sampling from the most accurate approximation, under assumptions. The method is numerically illustrated on a problem associated to a stochastic partial differential equation (SPDE).

[1]  G. Roberts,et al.  MCMC methods for diffusion bridges , 2008 .

[2]  A. Stuart,et al.  Data Assimilation: A Mathematical Introduction , 2015, 1506.07825.

[3]  R. Tempone,et al.  Multilevel ensemble Kalman filtering for spatially extended models , 2016, 1608.08558.

[4]  Yan Zhou,et al.  Multilevel particle filters: normalizing constant estimation , 2016, Stat. Comput..

[5]  Andrew M. Stuart,et al.  Inverse problems: A Bayesian perspective , 2010, Acta Numerica.

[6]  P. Kloeden,et al.  Overcoming the order barrier in the numerical approximation of stochastic partial differential equations with additive space–time noise , 2009, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[7]  Yan Zhou,et al.  Multilevel Particle Filters , 2015, SIAM J. Numer. Anal..

[8]  Alexandros Beskos,et al.  Particle Filtering for Stochastic Navier-Stokes Signal Observed with Linear Additive Noise , 2017, SIAM J. Sci. Comput..

[9]  Andrew M. Stuart,et al.  Complexity analysis of accelerated MCMC methods for Bayesian inversion , 2012, 1207.2411.

[10]  Fabio Nobile,et al.  Multi-index Monte Carlo: when sparsity meets sampling , 2014, Numerische Mathematik.

[11]  Michael B. Giles,et al.  Multilevel Monte Carlo Path Simulation , 2008, Oper. Res..

[12]  Kody J. H. Law,et al.  Determining white noise forcing from Eulerian observations in the Navier-Stokes equation , 2013, 1303.4677.

[13]  Ajay Jasra,et al.  Forward and Inverse Uncertainty Quantification using Multilevel Monte Carlo Algorithms for an Elliptic Nonlocal Equation , 2016, 1603.06381.

[14]  T. J. Dodwell,et al.  A Hierarchical Multilevel Markov Chain Monte Carlo Algorithm with Applications to Uncertainty Quantification in Subsurface Flow , 2013, SIAM/ASA J. Uncertain. Quantification.

[15]  Yan Zhou,et al.  Bayesian Static Parameter Estimation for Partially Observed Diffusions via Multilevel Monte Carlo , 2017, SIAM J. Sci. Comput..

[16]  A. Beskos,et al.  Multilevel sequential Monte Carlo samplers , 2015, 1503.07259.

[17]  Stefan Heinrich,et al.  Multilevel Monte Carlo Methods , 2001, LSSC.