Estimation of the Parameters of a Gaussian Mixture Using the Method of Moments

Given a general n-dimensional bimodal Gaussian mixture, this paper shows how unknown parameters may be found by the method of moments. Three cases are considered-equal modal probabilities, known but not necessarily equal probabilities, and all parameters unknown. The solution involves sample moments no higher than fourth order. For Gaussian mixtures where the number of modes is unknown, fourth-order moments can be used to count them, provided all modes have the same covariance matrix, and their multiplicity is not greater than data dimensionality. Examples of mode-counting and the determination of bimodal parameters are included.

[1]  Sidney J. Yakowitz,et al.  Unsupervised learning and the identification of finite mixtures , 1970, IEEE Trans. Inf. Theory.

[2]  A. F. M. Smith,et al.  A quasi-Bayes unsupervised learning procedure for priors (Corresp.) , 1977, IEEE Trans. Inf. Theory.

[3]  Edward A. Patrick,et al.  Decision-Directed Estimation of a Two-Class Decision Boundary , 1970, IEEE Transactions on Computers.

[4]  K. Pearson.  Contributions to the Mathematical Theory of Evolution , 1894 .

[5]  Tzay Y. Young,et al.  Stochastic estimation of a mixture of normal density functions using an information criterion , 1970, IEEE Trans. Inf. Theory.

[6]  John C. Hancock,et al.  Nonsupervised sequential classification and recognition of patterns , 1966, IEEE Trans. Inf. Theory.

[7]  Jack-Gérard Postaire,et al.  An Approximate Solution to Normal Mixture Identification with Application to Unsupervised Pattern Classification , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Demetrios Kazakos,et al.  Recursive estimation of prior probabilities using a mixture , 1977, IEEE Trans. Inf. Theory.

[9]  David B. Cooper,et al.  Nonsupervised Adaptive Signal Detection and Pattern Recognition , 1964, Inf. Control..

[10]  Demetrios Kazakos,et al.  An improved decision-directed detector (Corresp.) , 1980, IEEE Trans. Inf. Theory.

[11]  Stanley C. Fralick,et al.  Learning to recognize patterns without a teacher , 1967, IEEE Trans. Inf. Theory.

[12]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[13]  David Lindley,et al.  Advanced Statistical Methods in Biometric Research. , 1953 .

[14]  Riichiro Mizoguchi,et al.  An Approach to Unsupervised Learning Classification , 1975, IEEE Transactions on Computers.

[15]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[16]  A. Cohen,et al.  Finite Mixture Distributions , 1982 .