Sequential Bayesian Filtering via Minimum Distortion Quantization

Bayes Rule provides a conceptually simple, closed form, solution to the sequential Bayesian nonlinear filtering problem. The solution, in general, depends upon the evaluation of high dimensional multivariable integrals and is thus computationally intractable save in a small number of special cases. Hence some form of approximation is inevitably required. An approximation in common use is based upon the use of Monte Carlo sampling techniques. This general class of methods is referred to as Particle Filtering. In this paper we advocate an alternative deterministic approach based on the use of minimum distortion quantization. Accordingly we use the term Minimum Distortion Nonlinear Filtering (MDNF) for this alternative class of algorithms. Here we review the theoretical support for MDNF and illustrate its performance via simulation studies.

[1]  S. Haykin Kalman Filtering and Neural Networks , 2001 .

[2]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[3]  M. West,et al.  Bayesian forecasting and dynamic models , 1989 .

[4]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[5]  G. Pagès,et al.  Optimal quantization methods for nonlinear filtering with discrete-time observations , 2005 .

[6]  Petya I. Ivanova,et al.  Quo vadis, Bayesian identification? , 1999 .

[7]  Graham C. Goodwin,et al.  A vector quantization approach to scenario generation for stochastic NMPC , 2009 .

[8]  H. Sorenson,et al.  Recursive bayesian estimation using gaussian sums , 1971 .

[9]  Harold W. Sorenson,et al.  On the development of practical nonlinear filters , 1974, Inf. Sci..

[10]  Afef Sellami,et al.  Comparative survey on nonlinear filtering methods: the quantization and the particle filtering approaches , 2008 .

[11]  D. Mayne,et al.  Monte Carlo techniques to estimate the conditional expectation in multi-stage non-linear filtering† , 1969 .

[12]  A. H. Wang,et al.  Optimal quadrature formula nonlinear estimators , 1978, Inf. Sci..

[13]  Michael A. West,et al.  Bayesian forecasting and dynamic models (2nd ed.) , 1997 .

[14]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[15]  Rudolph van der Merwe,et al.  The Unscented Kalman Filter , 2002 .

[16]  Gillis Pagés,et al.  A space quantization method for numerical integration , 1998 .

[17]  Graham C. Goodwin,et al.  Open-cut Mine Planning via Closed-loop Receding-horizon Optimal Control , 2007 .

[18]  J. Hammersley,et al.  Monte Carlo Methods , 1965 .

[19]  Y. Ho,et al.  A Bayesian approach to problems in stochastic estimation and control , 1964 .

[20]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[21]  S. Graf,et al.  Foundations of Quantization for Probability Distributions , 2000 .