Multilevel Monte Carlo for Smoothing via Transport Methods

In this article we consider recursive approximations of the smoothing distribution associated to partially observed stochastic differential equations (SDEs), which are observed discretely in time. Such models appear in a wide variety of applications including econometrics, finance and engineering. This problem is notoriously challenging, as the smoother is not available analytically and hence require numerical approximation. This usually consists by applying a time-discretization to the SDE, for instance the Euler method, and then applying a numerical (e.g. Monte Carlo) method to approximate the smoother. This has lead to a vast literature on methodology for solving such problems, perhaps the most popular of which is based upon the particle filter (PF) e.g. [9]. It is well-known that in the context of this problem, that when filtering, the cost to achieve a given mean squared error (MSE) for estimates, the particle filter can be improved upon. This in the sense that the computational effort can be reduced to achieve this target MSE, by using multilevel (ML) methods [12, 13, 18], via the multilevel particle filter (MLPF) [16, 20, 21]. For instance, under assumptions, for the filter, some diffusions and the specific scenario of Euler discretizations with non-constant diffusion coefficients, to obtain a MSE of $\mathcal{O}(\epsilon^2)$ for some $\epsilon>0$ the cost of the PF is $\mathcal{O}(\epsilon^{-3})$ and the MLPF is $\mathcal{O}(\epsilon^{-2}\log(\epsilon)^2)$. In this article we consider a new approach to replace the particle filter, using transport methods in [27]. The proposed method improves upon the MLPF in that one expects that under assumptions and for the filter in the same case mentioned above, to obtain a MSE of $\mathcal{O}(\epsilon^2)$ the cost is $\mathcal{O}(\epsilon^{-2})$. This is established theoretically in an "ideal" example and numerically in numerous examples.

[1]  Youssef M. Marzouk,et al.  Inference via Low-Dimensional Couplings , 2017, J. Mach. Learn. Res..

[2]  Youssef M. Marzouk,et al.  Bayesian inference with optimal maps , 2011, J. Comput. Phys..

[3]  Michael B. Giles,et al.  Multilevel Monte Carlo Path Simulation , 2008, Oper. Res..

[4]  Youssef M. Marzouk,et al.  A Multiscale Strategy for Bayesian Inference Using Transport Maps , 2015, SIAM/ASA J. Uncertain. Quantification.

[5]  Fredrik Lindsten,et al.  Coupling of Particle Filters , 2016, 1606.01156.

[6]  Jan M. Maciejowski,et al.  On Particle Methods for Parameter Estimation in General State-Space Models , 2015 .

[7]  K. Kamatani,et al.  Multilevel particle filter , 2015 .

[8]  P. Fearnhead,et al.  Particle filters for partially observed diffusions , 2007, 0710.4245.

[9]  Pierre Del Moral,et al.  Unbiased multi-index Monte Carlo , 2017, 1702.03057.

[10]  A. Doucet,et al.  Gibbs flow for approximate transport with applications to Bayesian computation , 2015, Journal of the Royal Statistical Society: Series B (Statistical Methodology).

[11]  Yan Zhou,et al.  Multilevel particle filters: normalizing constant estimation , 2016, Stat. Comput..

[12]  D. Crisan,et al.  Fundamentals of Stochastic Filtering , 2008 .

[13]  Stefan Heinrich,et al.  Multilevel Monte Carlo Methods , 2001, LSSC.

[14]  Rémi Bardenet,et al.  Monte Carlo Methods , 2013, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[15]  P. Fearnhead,et al.  Exact and computationally efficient likelihood‐based estimation for discretely observed diffusion processes (with discussion) , 2006 .

[16]  Desmond J. Higham,et al.  Analysing multi-level Monte Carlo for options with non-globally Lipschitz payoff , 2009, Finance Stochastics.

[17]  A. Doucet,et al.  A Tutorial on Particle Filtering and Smoothing: Fifteen years later , 2008 .

[18]  Jean-François Richard,et al.  Methods of Numerical Integration , 2000 .

[19]  G. Roberts,et al.  Exact simulation of diffusions , 2005, math/0602523.

[20]  A. GREGORY,et al.  Multilevel Ensemble Transform Particle Filtering , 2015, SIAM J. Sci. Comput..

[21]  M. Giles,et al.  Antithetic multilevel Monte Carlo estimation for multi-dimensional SDEs without Lévy area simulation , 2012, 1202.6283.

[22]  Fabio Nobile,et al.  Multi-index Monte Carlo: when sparsity meets sampling , 2014, Numerische Mathematik.

[23]  Yacine Ait-Sahalia Closed-Form Likelihood Expansions for Multivariate Diffusions , 2002, 0804.0758.

[24]  J. Stoyanov The Oxford Handbook of Nonlinear Filtering , 2012 .

[25]  C. Villani Optimal Transport: Old and New , 2008 .