Nonlinear Bayesian estimation with compactly supported wavelets

Bayesian estimation for nonlinear systems is still a challenging problem, as in general the type of the true probability density changes and the complexity increases over time. Hence, approximations of the occurring equations and/or of the underlying probability density functions are inevitable. In this paper, we propose an approximation of the conditional densities by wavelet expansions. This kind of representation allows a sparse set of characterizing coefficients, especially for smooth or piecewise smooth density functions. Besides its good approximation properties, fast algorithms operating on sparse vectors are applicable and thus, a good trade-off between approximation quality and run-time can be achieved. Moreover, due to its highly generic nature, it can be applied to a large class of nonlinear systems with a high modeling accuracy. In particular, the noise acting upon the system can be modeled by an arbitrary probability distribution and can influence the system in any way.

[1]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[2]  H. Sorenson,et al.  Nonlinear Bayesian estimation using Gaussian sum approximations , 1972 .

[3]  I. Daubechies Ten Lectures on Wavelets , 1992 .

[4]  G. Beylkin On the fast algorithm for multiplication of functions in the wavelet bases , 1993 .

[5]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[6]  E. Candès,et al.  Curvelets: A Surprisingly Effective Nonadaptive Representation for Objects with Edges , 2000 .

[7]  D. Brunn,et al.  Nonlinear Multidimensional Bayesian Estimation with Fourier Densities , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[8]  Stphane Mallat,et al.  A Wavelet Tour of Signal Processing, Third Edition: The Sparse Way , 2008 .

[9]  Darryl Morrell,et al.  Implementation of Continuous Bayesian Networks Using Sums of Weighted Gaussians , 1995, UAI.

[10]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[11]  R. Kronmal,et al.  The Estimation of Probability Densities and Cumulatives by Fourier Series Methods , 1968 .

[12]  Dan Simon,et al.  Optimal State Estimation: Kalman, H∞, and Nonlinear Approaches , 2006 .

[13]  M.F. Huber,et al.  Efficient Nonlinear Measurement Updating based on Gaussian Mixture Approximation of Conditional Densities , 2007, 2007 American Control Conference.

[14]  Jeffrey K. Uhlmann,et al.  Unscented filtering and nonlinear estimation , 2004, Proceedings of the IEEE.

[15]  Marco F. Huber,et al.  Gaussian Filter based on Deterministic Sampling for High Quality Nonlinear Estimation , 2008 .

[16]  S. Mallat A wavelet tour of signal processing , 1998 .

[17]  D. Simon Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches , 2006 .