Estimating Components of Univariate Gaussian Mixtures Using Prony's Method

A new technique for estimating the component parameters of a mixture of univariate Gaussian distributions using the method of moments is presented. The method of moments basically involves equating the sample moments to the corresponding mixture moments expressed in terms of component parameters and solving these equations for the unknown parameters. These moment equations, however, are nonlinear in the unknown parameters, and heretofore, an analytic solution of these equations has been obtained only for two-component mixtures [2]. Numerical solutions also tend to be unreliable for more than two components, due to the large number of nonlinear equations and parameters to be solved for. In this correspondence, under the condition that the component distributions have equal variances or equal means, the nonlinear moment equations are transformed into a set of linear equations using Prony's method. The solution of these equations for the unknown parameters is analytically feasible and numerically reliable for mixtures with several components. Numerous examples using the proposed technique for two-, three-, and four-component mixtures are presented.

[1]  David B. Cooper,et al.  Nonsupervised Adaptive Signal Detection and Pattern Recognition , 1964, Inf. Control..

[2]  Tzay Y. Young,et al.  Stochastic estimation of a mixture of normal density functions using an information criterion , 1970, IEEE Trans. Inf. Theory.

[3]  N. Sheibani,et al.  Paris , 1894, The Hospital.

[4]  Demetrios Kazakos,et al.  Recursive estimation of prior probabilities using a mixture , 1977, IEEE Trans. Inf. Theory.

[5]  K. Pearson Contributions to the Mathematical Theory of Evolution , 1894 .

[6]  C G Bhattacharya,et al.  A simple method of resolution of a distribution into gaussian components. , 1967, Biometrics.

[7]  Jack-Gérard Postaire,et al.  An Approximate Solution to Normal Mixture Identification with Application to Unsupervised Pattern Classification , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Demetrios Kazakos,et al.  An improved decision-directed detector (Corresp.) , 1980, IEEE Trans. Inf. Theory.

[9]  Bhattacharya Cg A simple method of resolution of a distribution into gaussian components. , 1967 .

[10]  A. Cohen,et al.  Finite Mixture Distributions , 1982 .

[11]  N. E. Day Estimating the components of a mixture of normal distributions , 1969 .

[12]  Keinosuke Fukunaga,et al.  Estimation of the Parameters of a Gaussian Mixture Using the Method of Moments , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  A. Cohen,et al.  Estimation in Mixtures of Two Normal Distributions , 1967 .