Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes

Stochastic differential equations often provide a convenient way to describe the dynamics of economic and financial data, and a great deal of effort has been expended searching for efficient ways to estimate models based on them. Maximum likelihood is typically the estimator of choice; however, since the transition density is generally unknown, one is forced to approximate it. The simulation-based approach suggested by Pedersen (1995) has great theoretical appeal, but previously available implementations have been computationally costly. We examine a variety of numerical techniques designed to improve the performance of this approach. Synthetic data generated by a Cox-Ingersoll-Ross model with parameters calibrated to match monthly observations of the U.S. short-term interest rate are used as a test case. Since the likelihood function of this process is known, the quality of the approximations can be easily evaluated. On datasets with 1,000 observations, we are able to approximate the maximum likelihood estimator with negligible error in well under 1 min. This represents something on the order of a 10,000-fold reduction in computational effort as compared to implementations without these enhancements. With other parameter settings designed to stress the methodology, performance remains strong. These ideas are easily generalized to multivariate settings and (with some additional work) to latent variable models. To illustrate, we estimate a simple stochastic volatility model of the U.S. short-term interest rate.

[1]  J. Hammersley,et al.  Monte Carlo Methods , 1965 .

[2]  Hani J. Doss,et al.  Liens entre equations di erentielles stochastiques et ordinaires , 1977 .

[3]  A. Ronald Gallant,et al.  Testing a Nonlinear Regression Specification: A Nonregular Case , 1977 .

[4]  G. Mil’shtein A Method of Second-Order Accuracy Integration of Stochastic Differential Equations , 1979 .

[5]  A. Lo Maximum Likelihood Estimation of Generalized Itô Processes with Discretely Sampled Data , 1986, Econometric Theory.

[6]  J. Geweke,et al.  Bayesian Inference in Econometric Models Using Monte Carlo Integration , 1989 .

[7]  D. Florens-zmirou Approximate discrete-time schemes for statistics of diffusion processes , 1989 .

[8]  D. Duffie,et al.  Simulated Moments Estimation of Markov Models of Asset Prices , 1990 .

[9]  D. Andrews,et al.  Optimal Tests When a Nuisance Parameter Is Present Only Under the Alternative , 1992 .

[10]  Campbell R. Harvey,et al.  An Empirical Comparison of Alternative Models of the Short-Term Interest Rate , 1992 .

[11]  Non‐stationarity in garch models: A bayesian analysis , 1993 .

[12]  L. Hansen,et al.  Back to the Future: Generating Moment Implications for Continuous-Time Markov Processes , 1993 .

[13]  J. Richard,et al.  Accelerated gaussian importance sampler with application to dynamic latent variable models , 1993 .

[14]  Peter E. Rossi,et al.  Bayesian Analysis of Stochastic Volatility Models , 1994 .

[15]  Jón Dańıelsson Stochastic volatility in asset prices estimation with simulated maximum likelihood , 1994 .

[16]  Danny Kopec,et al.  Additional References , 2003 .

[17]  N. Shephard,et al.  Stochastic Volatility: Likelihood Inference And Comparison With Arch Models , 1996 .

[18]  A. Pedersen,et al.  Consistency and asymptotic normality of an approximate maximum likelihood estimator for discretely observed diffusion processes , 1995 .

[19]  M. Sørensen,et al.  Martingale estimation functions for discretely observed diffusion processes , 1995 .

[20]  A. Gallant,et al.  Which Moments to Match? , 1995, Econometric Theory.

[21]  Yacine Ait-Sahalia Testing Continuous-Time Models of the Spot Interest Rate , 1995 .

[22]  S. Chib,et al.  Understanding the Metropolis-Hastings Algorithm , 1995 .

[23]  A. Pedersen A new approach to maximum likelihood estimation for stochastic differential equations based on discrete observations , 1995 .

[24]  George Tauchen New Minimum Chi-Square Methods in Empirical Finance , 1996 .

[25]  A. Harvey,et al.  5 Stochastic volatility , 1996 .

[26]  T. Andersen,et al.  Estimating continuous-time stochastic volatility models of the short-term interest rate , 1997 .

[27]  P. Glasserman,et al.  Monte Carlo methods for security pricing , 1997 .

[28]  Rómulo A. Chumacero,et al.  Finite Sample Properties of the Efficient Method of Moments , 1997 .

[29]  Mathieu Kessler Estimation of an Ergodic Diffusion from Discrete Observations , 1997 .

[30]  A. Gallant,et al.  Estimating stochastic differential equations efficiently by minimum chi-squared , 1997 .

[31]  K. Nowman,et al.  Gaussian Estimation of Single‐Factor Continuous Time Models of The Term Structure of Interest Rates , 1997 .

[32]  P. Honoré Maximum Likelihood Estimation of Non-Linear Continuous-Time Term-Structure Models , 1997 .

[33]  R. Harkema,et al.  A new approach to maximum likelihood estimation of sum-constrained linear models in case of undersized samples , 1997 .

[34]  Timothy G. Conley,et al.  Short-term interest rates as subordinated diffusions , 1997 .

[35]  A. Gallant,et al.  ESTIMATION OF CONTINUOUS-TIME MODELS FOR STOCK RETURNS AND INTEREST RATES , 1997, Macroeconomic Dynamics.

[36]  K. Judd Numerical methods in economics , 1998 .

[37]  Tohru Ozaki,et al.  Estimation for nonlinear stochastic differential equations by a local linearization method 1 , 1998 .

[38]  Yacine Aït-Sahalia Maximum Likelihood Estimation of Discretely Sampled Diffusions: A Closed-Form Approach , 1998 .

[39]  N. Shephard,et al.  Likelihood INference for Discretely Observed Non-linear Diffusions , 2001 .

[40]  Siem Jan Koopman,et al.  Estimation of stochastic volatility models via Monte Carlo maximum likelihood , 1998 .

[41]  A. Gallant,et al.  Reprojecting Partially Observed Systems with Application to Interest Rate Diffusions , 1998 .

[42]  Ola Elerian,et al.  A note on the existence of a closed form conditional transition density for the Milstein scheme , 1998 .

[43]  Maximum-Likelihood Estimation of Discretely Sampled Diffusions: A Closed-Form Approach , 1998 .

[44]  Michael W. Brandt,et al.  Simulated Likelihood Estimation of Multivariate Diffusions with an Application to Interest Rates and , 1999 .

[45]  Luis M. Viceira,et al.  Spectral GMM Estimation of Continuous-Time Processes , 1999 .

[46]  M. Pitt,et al.  Filtering via Simulation: Auxiliary Particle Filters , 1999 .

[47]  Bent E. Sørensen,et al.  Efficient method of moments estimation of a stochastic volatility model: A Monte Carlo study , 1999 .

[48]  Yacine Aït-Sahalia Transition Densities for Interest Rate and Other Nonlinear Diffusions , 1999 .

[49]  Simon,et al.  Bayesian Estimation of Continuous-Time Finance Models 1 Introduction , 1999 .

[50]  Anthony S. Tay,et al.  Multivariate Density Forecast Evaluation and Calibration In Financial Risk Management: High-Frequency Returns on Foreign Exchange , 1999, Review of Economics and Statistics.

[51]  Ola Elerian,et al.  Simulation estimation of continuous-time models with applications to finance , 1999 .

[52]  A. Gallant,et al.  Using Daily Range Data to Calibrate Volatility Diffusions and Extract the Forward Integrated Variance , 1999, Review of Economics and Statistics.

[53]  N. Shephard,et al.  Econometric Analysis of Realised Volatility and Its Use in Estimating Levy Based Non-Gaussian OU Type Stochastic Volatility Models , 2000 .

[54]  N. Meddahi,et al.  Série Scientifique Scientific Series Temporal Aggregation of Volatility Models , 2022 .

[55]  J. Richard,et al.  Simulation-based Inference in Econometrics: Accelerated Monte Carlo integration: an application to dynamic latent variables models , 2000 .

[56]  Christopher S. Jones,et al.  Bayesian investigation of continuous -time finance models , 2000 .

[57]  Tim B. Swartz,et al.  Approximating Integrals Via Monte Carlo and Deterministic Methods , 2000 .

[58]  Michael W. Brandt,et al.  Simulated Likelihood Estimation of Diffusions with an Application to Exchange Rate Dynamics in Incomplete Markets , 2001 .

[59]  N. Shephard,et al.  Non‐Gaussian Ornstein–Uhlenbeck‐based models and some of their uses in financial economics , 2001 .

[60]  Hao Zhou Finite sample properties of EMM, GMM, QMLE and MLE for a square-root interest rate diffusion model , 2001 .

[61]  Bjørn Eraker MCMC Analysis of Diffusion Models With Application to Finance , 2001 .

[62]  K. Singleton Estimation of affine asset pricing models using the empirical characteristic function , 2001 .

[63]  Larry L. Constantine,et al.  Back to the future , 2001, CACM.

[64]  M. Pitt Smooth Particle Filters for Likelihood Evaluation and Maximisation , 2002 .

[65]  Charles S. Bos,et al.  Time Series Models with a Common Stochastic Variance for Analysing Economic Time Series , 2002 .

[66]  George Tauchen Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes: Comment , 2002 .

[67]  T. Bollerslev,et al.  Estimating Stochastic Volatility Diffusion Using Conditional Moments of Integrated Volatility , 2001 .

[68]  Yacine Aït-Sahalia Maximum Likelihood Estimation of Discretely Sampled Diffusions: A Closed‐form Approximation Approach , 2002 .

[69]  Luis M. Viceira,et al.  Spectral GMM Estimation of Continuous-Time Processes , 1999 .

[70]  P. Glynn,et al.  Estimation of Continuous-Time Markov Processes Sampled at Random Time Intervals , 2004 .

[71]  T. Alderweireld,et al.  A Theory for the Term Structure of Interest Rates , 2004, cond-mat/0405293.

[72]  Bjørn Eraker Do Stock Prices and Volatility Jump? Reconciling Evidence from Spot and Option Prices , 2004 .