Superficial Gaussian Mixture Reduction

Many information fusion tasks involve the processing of Gaussian mixtures with simple underlying shape, but many components. This paper addresses the problem of reducing the number of components, allowing for faster density processing. The proposed approach is based on identifying components irrelevant for the overall density’s shape by means of the curvature of the density’s surface. The key idea is to minimize an upper bound of the curvature while maintaining a low global reduction error by optimizing the weights of the original Gaussian mixture only. The mixture is reduced by assigning zero weights to reducible components. The main advantages are an alleviation of the model selection problem, as the number of components is chosen by the algorithm automatically, the derivation of simple curvature-based penalty terms, and an easy, efficient implementation. A series of experiments shows the approach to provide a good trade-off between quality and sparsity.

[1]  Uwe D. Hanebeck,et al.  Progressive Bayes: a new framework for nonlinear state estimation , 2003, SPIE Defense + Commercial Sensing.

[2]  David A. Cohn,et al.  Active Learning with Statistical Models , 1996, NIPS.

[3]  A.R. Runnalls,et al.  A Kullback-Leibler Approach to Gaussian Mixture Reduction , 2007 .

[4]  David J. Salmond.  Mixture reduction algorithms for target tracking in clutter , 1990 .

[5]  T. Banchoff,et al.  Differential Geometry of Curves and Surfaces , 2010 .

[6]  D. J. Salmond,et al.  Mixture reduction algorithms for target tracking in clutter , 1990, Defense + Commercial Sensing.

[7]  B. Silverman,et al.  Functional Data Analysis , 1997 .

[8]  Bernard W. Silverman,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[9]  Uwe D. Hanebeck,et al.  Closed-Form Prediction of Nonlinear Dynamic Systems by Means of Gaussian Mixture Approximation of the Transition Density , 2006, 2006 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[10]  V. Maz'ya,et al.  On approximate approximations using Gaussian kernels , 1996 .

[11]  Uwe D. Hanebeck,et al.  Progressive Gaussian mixture reduction , 2008, 2008 11th International Conference on Information Fusion.

[12]  Stephen P. Boyd,et al.  Graph Implementations for Nonsmooth Convex Programs , 2008, Recent Advances in Learning and Control.

[13]  H. Sorenson,et al.  Nonlinear Bayesian estimation using Gaussian sum approximations , 1972 .

[14]  P. S. Maybeck,et al.  Cost-function-based gaussian mixture reduction for target tracking , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[15]  M. West.  Approximating posterior distributions by mixtures , 1993 .

[16]  Yakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Principles and Techniques , 1995 .

[17]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[18]  Marco F. Huber,et al.  Gaussian mixture reduction via clustering , 2009, 2009 12th International Conference on Information Fusion.

[19]  Samuel S. Blackman,et al.  Multiple-Target Tracking with Radar Applications , 1986 .

[20]  J. O. Ramsay,et al.  Functional Data Analysis (Springer Series in Statistics) , 1997 .