Progressive Bayesian Filtering with Coupled Gaussian and Dirac Mixtures

Nonlinear filtering is the most important aspect in state estimation with real-world systems. While the Kalman filter provides a simple though optimal estimate for linear systems, feasible filters for general systems are still subject of intensive research. The previously proposed Progressive Gaussian Filter PGF42 marked a new milestone, as it was able to efficiently compute an optimal Gaussian approximation of the posterior density in nonlinear systems [1]. However, for highly nonlinear systems where true posteriors are “banana-shaped” (e.g., cubic sensor problem) or multimodal (e.g., extended object tracking), even an optimal Gaussian approximation is an inadequate representation. Therefore, we generalize the established framework around the PGF42 from Gaussian to Gaussian mixture densities that are better able to approximate arbitrary density functions. Our filter simultaneously holds approximate Gaussian mixture and Dirac mixture representations of the same density, what we call coupled discrete and continuous densities (CoDiCo). For conversion between discrete and continuous representation, we employ deterministic sampling and the expectation-maximization (EM) algorithm, which we extend to deal with weighted particles.

[1]  Uwe D. Hanebeck,et al.  A closed-form likelihood for Particle Filters to track extended objects with star-convex RHMs , 2015, 2015 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[2]  H. Sorenson,et al.  Nonlinear Bayesian estimation using Gaussian sum approximations , 1972 .

[3]  Uwe D. Hanebeck,et al.  PGF 42: Progressive Gaussian filtering with a twist , 2013, Proceedings of the 16th International Conference on Information Fusion.

[4]  Uwe D. Hanebeck,et al.  Progressive Gaussian filtering based on Dirac Mixture approximations , 2012, 2012 15th International Conference on Information Fusion.

[5]  Uwe D. Hanebeck,et al.  The Smart Sampling Kalman Filter with Symmetric Samples , 2015, ArXiv.

[6]  New York Dover,et al.  ON THE CONVERGENCE PROPERTIES OF THE EM ALGORITHM , 1983 .

[7]  Fred Daum,et al.  Exact particle flow for nonlinear filters , 2010, Defense + Commercial Sensing.

[8]  Uwe D. Hanebeck,et al.  Progressive Bayesian estimation for nonlinear discrete-time systems:the filter step for scalar measurements and multidimensional states , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[9]  Uwe D. Hanebeck,et al.  Progressive Bayes: a new framework for nonlinear state estimation , 2003, SPIE Defense + Commercial Sensing.

[10]  Uwe D. Hanebeck,et al.  Progressive Gaussian filtering using explicit likelihoods , 2014, 17th International Conference on Information Fusion (FUSION).

[11]  Uwe D. Hanebeck,et al.  Tracking elongated extended objects using splines , 2016, 2016 19th International Conference on Information Fusion (FUSION).

[12]  Joni-Kristian Kämäräinen,et al.  Feature representation and discrimination based on Gaussian mixture model probability densities - Practices and algorithms , 2006, Pattern Recognit..

[13]  Mark Coates,et al.  Particle Flow Particle Filter for Gaussian Mixture Noise Models , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Daniel L. Alspach,et al.  Gaussian sum approximations for nonlinear filtering , 1970 .

[15]  Radu Horaud,et al.  EM Algorithms for Weighted-Data Clustering with Application to Audio-Visual Scene Analysis , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Uwe D. Hanebeck,et al.  Progressive Bayesian estimation with deterministic particles , 2016, 2016 19th International Conference on Information Fusion (FUSION).

[17]  Fred Daum,et al.  Particle flow for nonlinear filters with log-homotopy , 2008, SPIE Defense + Commercial Sensing.

[18]  Uwe D. Hanebeck,et al.  S2KF: The Smart Sampling Kalman Filter , 2013, Proceedings of the 16th International Conference on Information Fusion.

[19]  Uwe D. Hanebeck,et al.  Localized Cumulative Distributions and a multivariate generalization of the Cramér-von Mises distance , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[20]  H. Sorenson,et al.  Recursive bayesian estimation using gaussian sums , 1971 .

[21]  Mark R. Morelande,et al.  Comparison of angle-only filtering algorithms in 3D using Cartesian and modified spherical coordinates , 2012, 2012 15th International Conference on Information Fusion.

[22]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[23]  Uwe D. Hanebeck FLUX: Progressive State Estimation Based on Zakai-type Distributed Ordinary Differential Equations , 2018, ArXiv.

[24]  Peter Willett,et al.  Discussion and application of the homotopy filter , 2011, Defense + Commercial Sensing.

[25]  Simon J. Julier,et al.  The scaled unscented transformation , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[26]  D. Simon Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches , 2006 .

[27]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[28]  Uwe D. Hanebeck,et al.  Semi-analytic progressive Gaussian filtering , 2016, 2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[29]  Anil K. Jain,et al.  Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Christian Musso,et al.  Improving Regularised Particle Filters , 2001, Sequential Monte Carlo Methods in Practice.

[31]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[32]  Mark R. Morelande,et al.  Comparison of angle-only filtering algorithms in 3D using EKF, UKF, PF, PFF, and ensemble KF , 2015, 2015 18th International Conference on Information Fusion (Fusion).

[33]  Fred Daum,et al.  Nonlinear filters with particle flow induced by log-homotopy , 2009, Defense + Commercial Sensing.

[34]  Mark Coates,et al.  Gaussian sum particle flow filter , 2017, 2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[35]  Krishna R. Pattipati,et al.  A look at Gaussian mixture reduction algorithms , 2011, 14th International Conference on Information Fusion.

[36]  Uwe D. Hanebeck,et al.  State estimation considering negative information with switching Kalman and ellipsoidal filtering , 2016, 2016 19th International Conference on Information Fusion (FUSION).

[37]  Uwe D. Hanebeck Optimal Reduction of Multivariate Dirac Mixture Densities , 2015, Autom..

[38]  Ben J. A. Kröse,et al.  Efficient Greedy Learning of Gaussian Mixture Models , 2003, Neural Computation.

[39]  Uwe D. Hanebeck,et al.  Progressive correction for deterministic Dirac mixture approximations , 2011, 14th International Conference on Information Fusion.

[40]  M.F. Huber,et al.  Efficient Nonlinear Measurement Updating based on Gaussian Mixture Approximation of Conditional Densities , 2007, 2007 American Control Conference.

[41]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[42]  Uwe D. Hanebeck,et al.  Progressive Gaussian mixture reduction , 2008, 2008 11th International Conference on Information Fusion.

[43]  Uwe D. Hanebeck,et al.  Association-free tracking of two closely spaced targets , 2010, 2010 IEEE Conference on Multisensor Fusion and Integration.

[44]  Uwe D. Hanebeck,et al.  GPU-accelerated progressive Gaussian filtering with applications to extended object tracking , 2015, 2015 18th International Conference on Information Fusion (Fusion).

[45]  Petar M. Djuric,et al.  Gaussian sum particle filtering , 2003, IEEE Trans. Signal Process..

[46]  U. Hanebeck,et al.  LRKF Revisited: The Smart Sampling Kalman Filter (S2KF) , 2015 .

[47]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[48]  Uwe D. Hanebeck,et al.  Dirac mixture approximation of multivariate Gaussian densities , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.