Following a moving target—Monte Carlo inference for dynamic Bayesian models

Markov chain Monte Carlo (MCMC) sampling is a numerically intensive simulation technique which has greatly improved the practicality of Bayesian inference and prediction. However, MCMC sampling is too slow to be of practical use in problems involving a large number of posterior (target) distributions, as in dynamic modelling and predictive model selection. Alternative simulation techniques for tracking moving target distributions, known as particle filters, which combine importance sampling, importance resampling and MCMC sampling, tend to suffer from a progressive degeneration as the target sequence evolves. We propose a new technique, based on these same simulation methodologies, which does not suffer from this progressive degeneration.

[1]  D. Mayne,et al.  Monte Carlo techniques to estimate the conditional expectation in multi-stage non-linear filtering† , 1969 .

[2]  Hiroshi Tanaka,et al.  Central limit theorem for a system of Markovian particles with mean field interactions , 1985 .

[3]  Patrick Billingsley,et al.  Probability and Measure. , 1986 .

[4]  D. Rubin.  Using the SIR algorithm to simulate posterior distributions , 1988 .

[5]  J. Geweke,et al.  Bayesian Inference in Econometric Models Using Monte Carlo Integration , 1989 .

[6]  L. N. Kanal,et al.  Uncertainty in Artificial Intelligence 5 , 1990 .

[7]  Alan E. Gelfand,et al.  Bayesian statistics without tears: A sampling-resampling perspective , 1992 .

[8]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[9]  Jun S. Liu,et al.  Sequential Imputations and Bayesian Missing Data Problems , 1994 .

[10]  L. Tierney.  Markov Chains for Exploring Posterior Distributions , 1994 .

[11]  Jun S. Liu,et al.  Blind Deconvolution via Sequential Imputations , 1995 .

[12]  Peter Green,et al.  Markov chain Monte Carlo in Practice , 1996 .

[13]  Michael Isard,et al.  Contour Tracking by Stochastic Propagation of Conditional Density , 1996, ECCV.

[14]  Jun S. Liu,et al.  Sequential Monte Carlo methods for dynamic systems , 1997 .

[15]  N. G. Best,et al.  Dynamic conditional independence models and Markov chain Monte Carlo methods , 1997 .

[16]  Simon J. Godsill,et al.  On sequential simulation-based methods for Bayesian filtering , 1998 .

[17]  P. Fearnhead,et al.  Improved particle filter for nonlinear problems , 1999 .

[18]  M. Pitt,et al.  Filtering via Simulation: Auxiliary Particle Filters , 1999 .

[19]  P. Moral,et al.  Central limit theorem for nonlinear filtering and interacting particle systems , 1999 .

[20]  Niclas Bergman,et al.  Recursive Bayesian Estimation : Navigation and Tracking Applications , 1999 .

[21]  Hoon Kim,et al.  Monte Carlo Statistical Methods , 2000, Technometrics.

[22]  Walter R. Gilks,et al.  RESAMPLE-MOVE Filtering with Cross-Model Jumps , 2001, Sequential Monte Carlo Methods in Practice.