Progressive Gaussian mixture reduction

For estimation and fusion tasks it is inevitable to approximate a Gaussian mixture by one with fewer components to keep the complexity bounded. Appropriate approximations can be typically generated by exploiting the redundancy in the shape description of the original mixture. In contrast to the common approach of successively merging pairs of components to maintain a desired complexity, the novel Gaussian mixture reduction algorithm introduced in this paper avoids to directly reduce the original Gaussian mixture. Instead, an approximate mixture is generated from scratch by employing homotopy continuation. This allows starting the approximation with a single Gaussian, which is constantly adapted to the progressively incorporated true Gaussian mixture. Whenever a user-defined bound on the deviation of the approximation cannot be maintained during the continuation, further components are added to the approximation. This facilitates significantly reducing the number of components even for complex Gaussian mixtures.

[1]  Uwe D. Hanebeck,et al.  Progressive Bayes: a new framework for nonlinear state estimation , 2003, SPIE Defense + Commercial Sensing.

[2]  D. Catlin Estimation, Control, and the Discrete Kalman Filter , 1988 .

[3]  David A. Cohn,et al.  Active Learning with Statistical Models , 1996, NIPS.

[4]  V. Hasselblad Estimation of parameters for a mixture of normal distributions , 1966 .

[5]  D. Salmond Mixture reduction algorithms for target tracking , 1989 .

[6]  Miguel Á. Carreira-Perpiñán,et al.  Mode-Finding for Mixtures of Gaussian Distributions , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  H. Sorenson,et al.  Nonlinear Bayesian estimation using Gaussian sum approximations , 1972 .

[8]  P. S. Maybeck,et al.  Cost-function-based gaussian mixture reduction for target tracking , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[9]  M. West Approximating posterior distributions by mixtures , 1993 .

[10]  A. Izenman Recent Developments in Nonparametric Density Estimation , 1991 .

[11]  Yakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Principles and Techniques , 1995 .

[12]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[13]  David J. Salmond Mixture reduction algorithms for target tracking in clutter , 1990 .

[14]  A.R. Runnalls,et al.  Kullback-Leibler Approach to Gaussian Mixture Reduction , 2007, IEEE Transactions on Aerospace and Electronic Systems.

[15]  Matthew J. Beal Variational algorithms for approximate Bayesian inference , 2003 .

[16]  Uwe D. Hanebeck,et al.  Dirac Mixture Density Approximation Based on Minimization of the Weighted Cramer-von Mises Distance , 2006, 2006 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[17]  Eugene L. Allgower,et al.  Numerical continuation methods - an introduction , 1990, Springer series in computational mathematics.

[18]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[19]  O. C. Schrempf,et al.  Optimal mixture approximation of the product of mixtures , 2005, 2005 7th International Conference on Information Fusion.

[20]  P. Mahalanobis On the generalized distance in statistics , 1936 .