Simulating Diffusion Bridges with Score Matching

We consider the problem of simulating diffusion bridges, which are diffusion processes that are conditioned to initialize and terminate at two given states. The simulation of diffusion bridges has applications in diverse scientific fields and plays a crucial role in the statistical inference of discretely-observed diffusions. This is known to be a challenging problem that has received much attention in the last two decades. This article contributes to this rich body of literature by presenting a new avenue to obtain diffusion bridge approximations. Our approach is based on a backward time representation of a diffusion bridge, which may be simulated if one can time-reverse the unconditioned diffusion. We introduce a variational formulation to learn this time-reversal with function approximation and rely on a score matching method to circumvent intractability. Another iteration of our proposed methodology approximates the Doob’s h -transform defining the forward time representation of a diffusion bridge. We dis-cuss algorithmic considerations and extensions, and present numerical results on an Ornstein– Uhlenbeck process, a model from financial econometrics for interest rates, and a model from genetics for cell differentiation and development to illustrate the effectiveness of our approach.

[1]  Diffusion Bridges for Stochastic Hamiltonian Systems and Shape Evolutions , 2020, SIAM Journal on Imaging Sciences.

[2]  Aaron C. Courville,et al.  A Variational Perspective on Diffusion-Based Generative Models and Score Matching , 2021, NeurIPS.

[3]  Valentin De Bortoli,et al.  Diffusion Schrödinger Bridge with Applications to Score-Based Generative Modeling , 2021, NeurIPS.

[4]  Iain Murray,et al.  Maximum Likelihood Training of Score-Based Diffusion Models , 2021, NeurIPS.

[5]  J. Bierkens,et al.  A piecewise deterministic Monte Carlo method for diffusion bridges , 2020, Stat. Comput..

[6]  Mogens Bladt,et al.  Corrigendum to “Simple simulation of diffusion bridges with application to likelihood inference for diffusions” , 2010, Bernoulli.

[7]  Doraiswami Ramkrishna,et al.  Exact sampling of polymer conformations using Brownian bridges. , 2020, The Journal of chemical physics.

[8]  Stefan Sommer,et al.  Diffusion bridges for stochastic Hamiltonian systems with applications to shape analysis , 2020, ArXiv.

[9]  Arnaud Doucet,et al.  Unbiased Smoothing using Particle Independent Metropolis-Hastings , 2019, AISTATS.

[10]  S. Shreve,et al.  Stochastic differential equations , 1955, Mathematical Proceedings of the Cambridge Philosophical Society.

[11]  Yukito Iba,et al.  Backward Simulation of Stochastic Process Using a Time Reverse Monte Carlo Method , 2018, Journal of the Physical Society of Japan.

[12]  Pieralberto Guarniero,et al.  The iterated auxiliary particle filter and applications to state space models and diffusion processes. , 2017 .

[13]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[14]  Richard J. Boys,et al.  Improved bridge constructs for stochastic differential equations , 2015, Statistics and Computing.

[15]  F. Meulen,et al.  Bayesian estimation of discretely observed multi-dimensional diffusion processes using guided proposals , 2014, Electronic Journal of Statistics.

[16]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[17]  Pierre Del Moral,et al.  Sequential Monte Carlo with Highly Informative Observations , 2014, SIAM/ASA J. Uncertain. Quantification.

[18]  Mogens Bladt,et al.  Simulation of multivariate diffusion bridges , 2014 .

[19]  Piergiacomo Sabino,et al.  Enhancing Least Squares Monte Carlo with Diffusion Bridges: An Application to Energy Facilities , 2014 .

[20]  Harry van Zanten,et al.  Guided proposals for simulating multi-dimensional diffusion bridges , 2013, 1311.3606.

[21]  G. Roberts,et al.  Data Augmentation for Diffusions , 2013 .

[22]  Michael Sørensen,et al.  Importance sampling techniques for estimation of diffusion models , 2012 .

[23]  Pascal Vincent,et al.  A Connection Between Score Matching and Denoising Autoencoders , 2011, Neural Computation.

[24]  Jin Wang,et al.  Quantifying the Waddington landscape and biological paths for development and differentiation , 2011, Proceedings of the National Academy of Sciences.

[25]  Rong Chen,et al.  On Generating Monte Carlo Samples of Continuous Diffusion Bridges , 2010 .

[26]  A. Doucet,et al.  Particle Markov chain Monte Carlo methods , 2010 .

[27]  G. Roberts,et al.  MCMC methods for diffusion bridges , 2008 .

[28]  Darren J. Wilkinson,et al.  Bayesian inference for nonlinear multivariate diffusion models observed with error , 2008, Comput. Stat. Data Anal..

[29]  O. Stramer,et al.  On Simulated Likelihood of Discretely Observed Diffusion Processes and Comparison to Closed-Form Approximation , 2007 .

[30]  G. Roberts,et al.  Retrospective exact simulation of diffusion sample paths with applications , 2006 .

[31]  B. Delyon,et al.  Simulation of conditioned diffusion and application to parameter estimation , 2006 .

[32]  P. Fearnhead,et al.  Exact and computationally efficient likelihood‐based estimation for discretely observed diffusion processes (with discussion) , 2006 .

[33]  Aapo Hyvärinen,et al.  Estimation of Non-Normalized Statistical Models by Score Matching , 2005, J. Mach. Learn. Res..

[34]  G. Roberts,et al.  Exact simulation of diffusions , 2005, math/0602523.

[35]  C. Dellago,et al.  Transition Path Sampling , 2005 .

[36]  A. Stuart,et al.  Conditional Path Sampling of SDEs and the Langevin MCMC Method , 2004 .

[37]  A. Gallant,et al.  Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes , 2002 .

[38]  David Chandler,et al.  Transition path sampling: throwing ropes over rough mountain passes, in the dark. , 2002, Annual review of physical chemistry.

[39]  G. Roberts,et al.  On inference for partially observed nonlinear diffusion models using the Metropolis–Hastings algorithm , 2001 .

[40]  Bjørn Eraker MCMC Analysis of Diffusion Models With Application to Finance , 2001 .

[41]  N. Shephard,et al.  Likelihood INference for Discretely Observed Non-linear Diffusions , 2001 .

[42]  Andrew W. Lo,et al.  Nonparametric estimation of state-price densities implicit in financial asset prices , 1995, Proceedings of 1995 Conference on Computational Intelligence for Financial Engineering (CIFEr).

[43]  A. Pedersen,et al.  Consistency and asymptotic normality of an approximate maximum likelihood estimator for discretely observed diffusion processes , 1995 .

[44]  J.M.C. Clark The simulation of pinned diffusions , 1990, 29th IEEE Conference on Decision and Control.

[45]  Annie Millet,et al.  Integration by Parts and Time Reversal for Diffusion Processes , 1989 .

[46]  M. Yor DIFFUSIONS, MARKOV PROCESSES AND MARTINGALES: Volume 2: Itô Calculus , 1989 .

[47]  U. Haussmann,et al.  TIME REVERSAL OF DIFFUSIONS , 1986 .