论文信息 - An Enhanced EM algorithm using maximum entropy distribution as initial condition

An Enhanced EM algorithm using maximum entropy distribution as initial condition

The conventional EM algorithms may suffer from the following two problems. First, it may converge to a local maximum. Second, the algorithm may suffer from singularity. A novel Enhanced EM algorithm (EEM) using a realization of maximum-entropy uniform distribution as initial condition is proposed. A global optimal solution can be obtained. In addition, a positive perturbation scheme is adopted to avoid singularity. Experimental results have demonstrated that the EEM is simple and effective compared with some prior arts.

Yun Q. Shi | Patchara Sutthiwan | Guorong Xuan | Peiqi Chai

[1] Jeff A. Bilmes,et al. A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models , 1998 .

[2] Anil K. Jain,et al. Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3] K. Rose. Deterministic annealing for clustering, compression, classification, regression, and related optimization problems , 1998, Proc. IEEE.

[4] Wei Zhang,et al. EM algorithms of Gaussian mixture model and hidden Markov model , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).