Projection Pursuit Fitting Gaussian Mixture Models

Gaussian mixture models (GMMs) are widely used to model complex distributions. Usually the parameters of the GMMs are determined in a maximum likelihood (ML) framework. A practical deficiency of ML fitting of the GMMs is the poor performance when dealing with high-dimensional data since a large sample size is needed to match the numerical accuracy that is possible in low dimensions. In this paper we propose a method for fitting the GMMs based on the projection pursuit (PP) strategy. By means of simulations we show that the proposed method outperforms ML fitting of the GMMs for small sizes of training sets.

[1]  Jiayang Sun Some Practical Aspects of Exploratory Projection Pursuit , 1993, SIAM J. Sci. Comput..

[2]  Perry D. Moerland A comparison of mixture models for density estimation , 1999 .

[3]  Christopher M. Bishop Latent Variable Models , 1998, Learning in Graphical Models.

[4]  Mayer Aladjem Nonparametric discriminant analysis via recursive optimization of Patrick-Fisher distance , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[5]  M. C. Jones,et al.  Comparison of Smoothing Parameterizations in Bivariate Kernel Density Estimation , 1993 .

[6]  Mayer Aladjem Recursive training of neural networks for classification , 2000, IEEE Trans. Neural Networks Learn. Syst..

[7]  Jirí Benes,et al.  On neural networks , 1990, Kybernetika.

[8]  J. Friedman,et al.  PROJECTION PURSUIT DENSITY ESTIMATION , 1984 .

[9]  J. Friedman Exploratory Projection Pursuit , 1987 .

[10]  Mayer Aladjem Linear Discriminant Analysis for Two Classes via Removal of Classification Structure , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[12]  Michael I. Jordan Learning in Graphical Models , 1999, NATO ASI Series.

[13]  Adrian E. Raftery,et al.  How Many Clusters? Which Clustering Method? Answers Via Model-Based Cluster Analysis , 1998, Comput. J..

[14]  Jenq-Neng Hwang,et al.  Nonparametric multivariate density estimation: a comparative study , 1994, IEEE Trans. Signal Process..