Gaussian mixture reduction via clustering

Recursive processing of Gaussian mixture functions inevitably leads to a large number of mixture components. In order to keep the computational complexity at a feasible level, the number of their components has to be reduced periodically. There already exists a variety of algorithms for this purpose, bottom-up and top-down approaches, methods that take the global structure of the mixture into account or that work locally and consider few mixture components at the same time. The mixture reduction algorithm presented in this paper can be categorized as global top-down approach. It takes a clustering algorithm originating from the field of theoretical computer science and adapts it for the problem of Gaussian mixture reduction. The achieved results are on the same scale as the results of the current “state-of-the-art” algorithm PGMR, but, depending on the input size, the whole procedure performs significantly faster.

[1]  Alan M. Frieze,et al.  Clustering Large Graphs via the Singular Value Decomposition , 2004, Machine Learning.

[2]  Uwe D. Hanebeck,et al.  Progressive Gaussian mixture reduction , 2008, 2008 11th International Conference on Information Fusion.

[3]  Douglas A. Reynolds,et al.  Text independent speaker identification using automatic acoustic segmentation , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[4]  A. Izenman Recent Developments in Nonparametric Density Estimation , 1991 .

[5]  V. Maz'ya,et al.  On approximate approximations using Gaussian kernels , 1996 .

[6]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[7]  David J. Salmond Mixture reduction algorithms for target tracking in clutter , 1990 .

[8]  M. West Approximating posterior distributions by mixtures , 1993 .

[9]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[10]  David A. Cohn,et al.  Active Learning with Statistical Models , 1996, NIPS.

[11]  Johan Schubert,et al.  Clustering belief functions based on attracting and conflicting metalevel evidence using Potts spin mean field theory , 2003, Inf. Fusion.

[12]  A.R. Runnalls,et al.  A Kullback-Leibler Approach to Gaussian Mixture Reduction , 2007 .

[13]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[14]  Yakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Principles and Techniques , 1995 .

[15]  David W. Scott,et al.  From Kernels to Mixtures , 2001, Technometrics.

[16]  P. S. Maybeck,et al.  Cost-function-based gaussian mixture reduction for target tracking , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.