Linear and non-linear filtering in mathematical finance: a review

The problem of estimating unobserved latent variables from observed market data arises frequently in mathematical finance. Kalman filter, first proposed in Kalman (1960), and its generalizations have been the main tools for estimating the unobserved variables from the observed ones in econometrics and in engineering for several decades and their use is now becoming common in finance. Kalman filter is a conditional moment estimator for linear Gaussian systems. It is used in calibration of time series models, forecasting of variables and also in data smoothing applications. The purpose of this paper is to provide an introductory and accessible exposition of applications of filtering in finance to operational researchers. It gives a brief overview of Kalman filtering theory and presents recent empirical results on two applications in finance. Some recent developments in approximate nonlinear filtering are also reviewed. The rest of the paper is organized as follows. In section 2, basic linear Gaussian filtering methodology is described, along with its application to maximum likelihood-based calibration to time series models. Sections 3.1 and 3.2 present two case studies for applications of Kalman filtering in mathematical finance. Section 4 outlines some recent approaches for approximate filtering in nonlinear time series and also presents a brief overview of an empirical application on calibration and forecasting using a nonlinear interest rate model. Finally, section 5 summarises the contributions discussed in the paper and outlines promising directions for future research.

[1]  T. Bollerslev,et al.  Generalized autoregressive conditional heteroskedasticity , 1986 .

[2]  Gonzalo Cortazar,et al.  Implementing a stochastic model for oil futures prices , 2003 .

[3]  Paresh Date,et al.  A new moment matching algorithm for sampling from partially specified symmetric distributions , 2008, Oper. Res. Lett..

[4]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[5]  T. Bollerslev,et al.  A CONDITIONALLY HETEROSKEDASTIC TIME SERIES MODEL FOR SPECULATIVE PRICES AND RATES OF RETURN , 1987 .

[6]  Arnaud Doucet,et al.  A survey of convergence results on particle filtering methods for practitioners , 2002, IEEE Trans. Signal Process..

[7]  Andrew Harvey,et al.  Forecasting, Structural Time Series Models and the Kalman Filter , 1990 .

[8]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[9]  Richard Hawkes,et al.  Medium-term horizon volatility forecasting: A comparative study , 2007 .

[10]  M. Pitt,et al.  Filtering via Simulation: Auxiliary Particle Filters , 1999 .

[11]  G. Grimmett,et al.  Probability and random processes , 2002 .

[12]  S. H. Babbs,et al.  Kalman Filtering of Generalized Vasicek Term Structure Models , 1999, Journal of Financial and Quantitative Analysis.

[13]  N. Webber,et al.  Interest Rate Modelling , 2000 .

[14]  Carl Chiarella,et al.  The Volatility Structure of the Fixed Income Market Under the Hjm Framework: A Nonlinear Filtering Approach , 2005, Comput. Stat. Data Anal..

[15]  Siem Jan Koopman,et al.  Time Series Analysis by State Space Methods , 2001 .

[16]  Eduardo F. Camacho,et al.  Bounded error identification of systems with time-varying parameters , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[17]  Michal Kaut,et al.  A Heuristic for Moment-Matching Scenario Generation , 2003, Comput. Optim. Appl..

[18]  Narasimhan Jegadeesh,et al.  The Behavior of Interest Rates Implied by the Term Structure of Eurodollar Futures , 1996 .

[19]  Giuliano De Rossi.  Kalman Filtering of Consistent Forward Rate Curves: A Tool to Estimate and Model Dynamically the Term Structure , 2004 .

[20]  S. Ross,et al.  A theory of the term structure of interest rates'', Econometrica 53, 385-407 , 1985 .

[21]  P. Hansen,et al.  A Forecast Comparison of Volatility Models: Does Anything Beat a Garch(1,1)? , 2004 .

[22]  Oldrich A. Vasicek.  An equilibrium characterization of the term structure , 1977 .

[23]  M. Monoyios.  Optimal hedging and parameter uncertainty , 2007 .

[24]  Richard Hawkes.  Linear state models for volatility estimation and prediction , 2007 .

[25]  Paresh Date,et al.  A new algorithm for latent state estimation in non-linear time series models , 2008, Appl. Math. Comput..

[26]  S. Heston.  A Closed-Form Solution for Options with Stochastic Volatility with Applications to Bond and Currency Options , 1993 .

[27]  G. Kallianpur.  Stochastic Filtering Theory , 1980 .

[28]  Alain Galli,et al.  Filtering in Finance , 2003 .

[29]  B. Øksendal.  Stochastic differential equations : an introduction with applications , 1987 .

[30]  M. Manoliu,et al.  Energy futures prices: term structure models with Kalman filter estimation , 2002 .

[31]  G. Evensen.  Sequential data assimilation with a nonlinear quasi‐geostrophic model using Monte Carlo methods to forecast error statistics , 1994 .

[32]  L. Glosten,et al.  On the Relation between the Expected Value and the Volatility of the Nominal Excess Return on Stocks , 1993 .

[33]  P. Fearnhead.  Using Random Quasi-Monte-Carlo Within Particle Filters, With Application to Financial Time Series , 2005 .

[34]  H. Kushner.  Numerical Methods for Stochastic Control Problems in Continuous Time , 2000 .

[35]  F. Daum.  Nonlinear filters: beyond the Kalman filter , 2005, IEEE Aerospace and Electronic Systems Magazine.

[36]  Alois Geyer,et al.  A State-Space Approach to Estimate and Test Multifactor Cox-Ingersoll-Ross Models of the Term Structure , 1999 .

[37]  M. Martens.  Measuring and Forecasting S&P 500 Index-Futures Volatility Using High-Frequency Data , 2002 .

[38]  A. Javaheri,et al.  Inside Volatility Arbitrage : The Secrets of Skewness , 2005 .

[39]  A. Galli,et al.  Simple and extended Kalman filters: an application to term structures of commodity prices , 2004 .

[40]  D. Brigo,et al.  Interest Rate Models , 2001 .

[41]  Eduardo S. Schwartz.  The stochastic behavior of commodity prices: Implications for valuation and hedging , 1997 .

[42]  Paresh Date,et al.  Linear Gaussian affine term structure models with unobservable factors: Calibration and yield forecasting , 2009, Eur. J. Oper. Res..

[43]  Jim Gatheral.  The Volatility Surface: A Practitioner's Guide , 2006 .

[44]  N. Shephard,et al.  Econometric analysis of realized volatility and its use in estimating stochastic volatility models , 2002 .

[45]  Rudolf Kulhavý,et al.  Recursive nonlinear estimation: A geometric approach , 1996, Autom..

[46]  P. Houtekamer,et al.  Data Assimilation Using an Ensemble Kalman Filter Technique , 1998 .

[47]  Jeffrey K. Uhlmann,et al.  Unscented filtering and nonlinear estimation , 2004, Proceedings of the IEEE.

[48]  Bernard Hanzon,et al.  A differential geometric approach to nonlinear filtering: the projection filter , 1998, IEEE Trans. Autom. Control..

[49]  Paresh Date,et al.  A partially linearized sigma point filter for latent state estimation in nonlinear time series models , 2010, J. Comput. Appl. Math..

[50]  D. Beaglehole,et al.  General Solutions of Some Interest Rate-Contingent Claim Pricing Equations , 1991 .

[51]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.