A Nonsymmetric Mixture Model for Unsupervised Image Segmentation

Finite mixture models with symmetric distribution have been widely used for many computer vision and pattern recognition problems. However, in many applications, the distribution of the data has a non-Gaussian and nonsymmetric form. This paper presents a new nonsymmetric mixture model for image segmentation. The advantage of our method is that it is simple, easy to implement, and intuitively appealing. In this paper, each label is modeled with multiple D-dimensional Student's t-distribution, which is heavily tailed and more robust than Gaussian distribution. Expectation-maximization algorithm is adopted to estimate model parameters and to maximize the lower bound on the data log-likelihood from observations. Numerical experiments on various data types are conducted. The performance of the proposed model is compared with that of other mixture models, demonstrating the robustness, accuracy, and effectiveness of our method.

[1]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[3]  Alberto Leon-Garcia,et al.  Estimation of shape parameter for generalized Gaussian distributions in subband decompositions of video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[4]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[6]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[7]  Mongi A. Abidi,et al.  Reliable Location and Regression Estimates with Application to Range Image Segmentation , 1994, Other Conferences.

[8]  Martial Hebert,et al.  A Measure for Objective Evaluation of Image Segmentation Algorithms , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[9]  D. Rubin,et al.  ML ESTIMATION OF THE t DISTRIBUTION USING EM AND ITS EXTENSIONS, ECM AND ECME , 1999 .

[10]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[11]  Geoffrey J. McLachlan,et al.  Robust Cluster Analysis via Mixtures of Multivariate t-Distributions , 1998, SSPR/SPR.

[12]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[14]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[15]  Nizar Bouguila,et al.  Image and Video Segmentation by Combining Unsupervised Generalized Gaussian Mixture Modeling and Feature Selection , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Sylvain Meignen,et al.  On the modeling of small sample distributions with generalized Gaussian density in a maximum likelihood framework , 2006, IEEE Transactions on Image Processing.

[17]  Nizar Bouguila,et al.  Bayesian learning of finite generalized Gaussian mixture models on images , 2011, Signal Process..

[18]  A. F. Smith,et al.  Statistical analysis of finite mixture distributions , 1986 .

[19]  Q. M. Jonathan Wu,et al.  Robust Student's-t Mixture Model With Spatial Constraints and Its Application in Medical Image Segmentation , 2012, IEEE Transactions on Medical Imaging.

[20]  John A. D. Aston,et al.  MR Image Segmentation Using a Power Transformation Approach , 2009, IEEE Transactions on Medical Imaging.

[21]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[22]  Geoffrey J. McLachlan,et al.  Robust mixture modelling using the t distribution , 2000, Stat. Comput..

[23]  Q. M. Jonathan Wu,et al.  An Extension of the Standard Mixture Model for Image Segmentation , 2010, IEEE Transactions on Neural Networks.

[24]  Nikolas P. Galatsanos,et al.  Robust Image Segmentation with Mixtures of Student's t-Distributions , 2007, 2007 IEEE International Conference on Image Processing.

[25]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[26]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[27]  Shy Shoham,et al.  Robust clustering by deterministic agglomeration EM of mixtures of multivariate t-distributions , 2002, Pattern Recognit..

[28]  Jitendra Malik,et al.  Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Marina Meila,et al.  Comparing clusterings: an axiomatic view , 2005, ICML.

[30]  Nizar Bouguila,et al.  Finite Generalized Gaussian Mixture Modeling and Applications to Image and Video Foreground Segmentation , 2007, Fourth Canadian Conference on Computer and Robot Vision (CRV '07).

[31]  Q. M. Jonathan Wu,et al.  Dirichlet Gaussian mixture model: Application to image segmentation , 2011, Image Vis. Comput..

[32]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  Karl J. Friston,et al.  Unified segmentation , 2005, NeuroImage.