Data Augmentation for Diffusions

The problem of formal likelihood-based (either classical or Bayesian) inference for discretely observed multidimensional diffusions is particularly challenging. In principle, this involves data augmentation of the observation data to give representations of the entire diffusion trajectory. Most currently proposed methodology splits broadly into two classes: either through the discretization of idealized approaches for the continuous-time diffusion setup or through the use of standard finite-dimensional methodologies discretization of the diffusion model. The connections between these approaches have not been well studied. This article provides a unified framework that brings together these approaches, demonstrating connections, and in some cases surprising differences. As a result, we provide, for the first time, theoretical justification for the various methods of imputing missing data. The inference problems are particularly challenging for irreducible diffusions, and our framework is correspondingly more complex in that case. Therefore, we treat the reducible and irreducible cases differently within the article. Supplementary materials for the article are available online.

[1]  P. Kloeden,et al.  Numerical Solution of Stochastic Differential Equations , 1992 .

[2]  L. Rogers,et al.  Diffusions, Markov processes, and martingales , 1979 .

[3]  E. Helfand Numerical integration of stochastic differential equations , 1979, The Bell System Technical Journal.

[4]  K. Elworthy Stochastic Differential Equations on Manifolds , 1982 .

[5]  D. Florens-zmirou Approximate discrete-time schemes for statistics of diffusion processes , 1989 .

[6]  G. Milstein Numerical Integration of Stochastic Differential Equations , 1994 .

[7]  A. Pedersen,et al.  Consistency and asymptotic normality of an approximate maximum likelihood estimator for discretely observed diffusion processes , 1995 .

[8]  A. Pedersen A new approach to maximum likelihood estimation for stochastic differential equations based on discrete observations , 1995 .

[9]  L. Rogers,et al.  Diffusions, Markov Processes and Martingales, Vol. 1, Foundations. , 1996 .

[10]  Gareth O. Roberts,et al.  Convergence Properties of Perturbed Markov Chains , 1998, Journal of Applied Probability.

[11]  Tohru Ozaki,et al.  A statistical method of estimation and simulation for systems of stochastic differential equations , 1998 .

[12]  Gareth O. Roberts,et al.  A note on geometric ergodicity and floating-point roundoff error , 2001 .

[13]  G. Roberts,et al.  On inference for partially observed nonlinear diffusion models using the Metropolis–Hastings algorithm , 2001 .

[14]  A. Gallant,et al.  Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes , 2002 .

[15]  M. J. Bayarri,et al.  Non-Centered Parameterisations for Hierarchical Models and Data Augmentation , 2003 .

[16]  B. Delyon,et al.  Simulation of conditioned diffusion and application to parameter estimation , 2006 .

[17]  P. Fearnhead,et al.  Exact and computationally efficient likelihood‐based estimation for discretely observed diffusion processes (with discussion) , 2006 .

[18]  Gareth O. Roberts,et al.  A General Framework for the Parametrization of Hierarchical Models , 2007, 0708.3797.

[19]  E. Allen Modeling with Itô Stochastic Differential Equations , 2007 .

[20]  Susan A. Murphy,et al.  Monographs on statistics and applied probability , 1990 .

[21]  Céline Labart,et al.  Sharp estimates for the convergence of the density of the Euler scheme in small time , 2008 .

[22]  Darren J. Wilkinson,et al.  Bayesian inference for nonlinear multivariate diffusion models observed with error , 2008, Comput. Stat. Data Anal..

[23]  G. Roberts,et al.  Monte Carlo Maximum Likelihood Estimation for Discretely Observed Diffusion Processes , 2009, 0903.0290.

[24]  Gareth O. Roberts,et al.  Importance sampling techniques for estimation of diffusion models , 2009 .

[25]  S. Shreve Stochastic Calculus for Finance II: Continuous-Time Models , 2010 .

[26]  Isao Shoji A note on convergence rate of a linearization method for the discretization of stochastic differential equations , 2011 .

[27]  Paul Fearnhead,et al.  Markov Chain Monte Carlo for Exact Inference for Diffusions , 2011, 1102.5541.

[28]  Michael Sørensen,et al.  Importance sampling techniques for estimation of diffusion models , 2012 .

[29]  Michael Sørensen,et al.  Estimating functions for diffusion-type processes , 2012 .

[30]  Omiros Papaspiliopoulos,et al.  Markov chain Monte Carlo approach to parameter estimation in the FitzHugh-Nagumo model. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[31]  G. Roberts,et al.  MCMC Methods for Functions: ModifyingOld Algorithms to Make Them Faster , 2012, 1202.0709.