Particle rejuvenation of Rao-Blackwellized sequential Monte Carlo smoothers for conditionally linear and Gaussian models

This paper focuses on sequential Monte Carlo approximations of smoothing distributions in conditionally linear and Gaussian state spaces. To reduce Monte Carlo variance of smoothers, it is typical in these models to use Rao-Blackwellization: particle approximation is used to sample sequences of hidden regimes while the Gaussian states are explicitly integrated conditional on the sequence of regimes and observations, using variants of the Kalman filter/smoother. The first successful attempt to use Rao-Blackwellization for smoothing extends the Bryson-Frazier smoother for Gaussian linear state space models using the generalized two-filter formula together with Kalman filters/smoothers. More recently, a forward-backward decomposition of smoothing distributions mimicking the Rauch-Tung-Striebel smoother for the regimes combined with backward Kalman updates has been introduced. This paper investigates the benefit of introducing additional rejuvenation steps in all these algorithms to sample at each time instant new regimes conditional on the forward and backward particles. This defines particle-based approximations of the smoothing distributions whose support is not restricted to the set of particles sampled in the forward or backward filter. These procedures are applied to commodity markets which are described using a two-factor model based on the spot price and a convenience yield for crude oil data.

[1]  Simon J. Godsill,et al.  Rao-Blackwellized particle smoothers for mixed linear/nonlinear state-space models , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[2]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[3]  Eduardo S. Schwartz,et al.  Stochastic Convenience Yield and the Pricing of Oil Contingent Claims , 1990 .

[4]  Henrik Andersson,et al.  The stochastic behaviour of commodity prices , 2003 .

[5]  Jun S. Liu,et al.  Mixture Kalman filters , 2000 .

[6]  M. Shubik,et al.  Some dynamics of a strategic market game with a large number of agents , 1994 .

[7]  Simo Srkk,et al.  Bayesian Filtering and Smoothing , 2013 .

[8]  Thomas B. Schön,et al.  Marginalized particle filters for mixed linear/nonlinear state-space models , 2005, IEEE Transactions on Signal Processing.

[9]  Simon J. Godsill,et al.  Rao-Blackwellized Particle Smoothers for Conditionally Linear Gaussian Models , 2015, IEEE Journal of Selected Topics in Signal Processing.

[10]  Eduardo S. Schwartz The stochastic behavior of commodity prices: Implications for valuation and hedging , 1997 .

[11]  Simo Särkkä,et al.  Bayesian Filtering and Smoothing , 2013, Institute of Mathematical Statistics textbooks.

[12]  P. Fearnhead,et al.  A sequential smoothing algorithm with linear computational cost. , 2010 .

[13]  S. Godsill,et al.  A Backward-Simulation Based Rao-Blackwellized Particle Smoother for Conditionally Linear Gaussian Models , 2012 .

[14]  Nikolaus Hansen,et al.  Evaluating the CMA Evolution Strategy on Multimodal Test Functions , 2004, PPSN.

[15]  Arnaud Doucet,et al.  Particle filters for state estimation of jump Markov linear systems , 2001, IEEE Trans. Signal Process..

[16]  David Barber,et al.  Expectation Correction for Smoothed Inference in Switching Linear Dynamical Systems , 2006, J. Mach. Learn. Res..

[17]  Markus Hürzeler,et al.  Monte Carlo Approximations for General State-Space Models , 1998 .

[18]  C. Striebel,et al.  On the maximum likelihood estimates for linear dynamic systems , 1965 .

[19]  Chang‐Jin Kim,et al.  Dynamic linear models with Markov-switching , 1994 .

[20]  Simon J. Godsill,et al.  On sequential Monte Carlo sampling methods for Bayesian filtering , 2000, Stat. Comput..

[21]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[22]  Aurélien Garivier,et al.  On optimal sampling for particle filtering in digital communication , 2008, 2008 IEEE 9th Workshop on Signal Processing Advances in Wireless Communications.

[23]  A. Doucet,et al.  Smoothing algorithms for state–space models , 2010 .

[24]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[25]  Pierre Del Moral,et al.  Mean Field Simulation for Monte Carlo Integration , 2013 .

[26]  Abdullah Almansour,et al.  Convenience yield in commodity price modeling: A regime switching approach , 2016 .

[27]  Simon J. Godsill,et al.  Monte Carlo smoothing with application to audio signal enhancement , 2002, IEEE Trans. Signal Process..

[28]  G. Peters,et al.  Monte Carlo Approximations for General State-Space Models , 1998 .

[29]  P. Fearnhead,et al.  On‐line inference for hidden Markov models via particle filters , 2003 .