Simple Example: Clustering Images Using Expectation Maximization

This paper gives an example of a novel simple implementation of the EM algorithm for clustering images. Here we use a simple gray scale color feature to describe an image. When compared to results of other methods using the same simple feature, we found that the proposed method performs well. These comparison results imply that this simple model can be extended to cluster images using more complex features such as texture, shape, and other color descriptors to further improve the precision and recall of the results in order to outperform the existing methods. Further research can prove that this simplified EM algorithm achieves robust classification of unrestricted image domain.

[1]  Jun Zhang,et al.  Expectation-maximization algorithms for image processing using multiscale models and mean- field theory, with applications to laser radar range profiling and segmentation , 2001 .

[2]  Lei Zhang,et al.  A Novel Earth Mover's Distance Methodology for Image Matching with Gaussian Mixture Models , 2013, 2013 IEEE International Conference on Computer Vision.

[3]  Alfred Stein,et al.  Application of the EM-algorithm for Bayesian Network Modelling to Improve Forest Growth Estimates , 2011 .

[4]  Chuong B Do,et al.  What is the expectation maximization algorithm? , 2008, Nature Biotechnology.

[5]  D. Champion,et al.  Application of the Gaussian mixture model in pulsar astronomy – pulsar classification and candidates ranking for the Fermi 2FGL catalogue , 2012, 1205.6221.

[6]  David A. Forsyth,et al.  Learning the semantics of words and pictures , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[7]  Volodymyr Melnykov,et al.  Finite mixture modelling in mass spectrometry analysis , 2013 .

[8]  Joshua R. Smith,et al.  Image retrieval evaluation , 1998, Proceedings. IEEE Workshop on Content-Based Access of Image and Video Libraries (Cat. No.98EX173).

[9]  S. Islam,et al.  Implementation of Image Segmentation for Natural Images using Clustering Methods , 2013 .

[10]  Andrea Kutics,et al.  Segment-based image classifcaton using Layered-SOM , 2013, 2013 IEEE International Conference on Image Processing.

[11]  Qi Tian,et al.  Discriminant-EM algorithm with application to image retrieval , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[12]  Changshui Zhang,et al.  Multi-view EM algorithm and its application to color image segmentation , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[13]  Hiroyuki Shinnou Application of unsupervised learning using EM algorithm to Japanese Translation Task. , 2003 .

[14]  Jeff A. Bilmes,et al.  A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models , 1998 .

[15]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[16]  David A. Forsyth,et al.  Matching Words and Pictures , 2003, J. Mach. Learn. Res..

[17]  Michael C. Ferris,et al.  Interior-Point Methods for Massive Support Vector Machines , 2002, SIAM J. Optim..

[18]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .