Bounded Asymmetrical Student's-t Mixture Model

The finite mixture model based on the Student's-t distribution, which is heavily tailed and more robust than the Gaussian mixture model (GMM), is a flexible and powerful tool to address many computer vision and pattern recognition problems. However, the Student's-t distribution is unbounded and symmetrical around its mean. In many applications, the observed data are digitalized and have bounded support. The distribution of the observed data usually has an asymmetric form. A new finite bounded asymmetrical Student's-t mixture model (BASMM), which includes the GMM and the Student's-t mixture model (SMM) as special cases, is presented in this paper. We propose an extension of the Student's-t distribution in this paper. This new distribution is sufficiently flexible to fit different shapes of observed data, such as non-Gaussian, nonsymmetric, and bounded support data. Another advantage of the proposed model is that each of its components can model the observed data with different bounded support regions. In order to estimate the model parameters, previous models represent the Student's-t distributions as an infinite mixture of scaled Gaussians. We propose an alternate approach in order to minimize the higher bound on the data negative log-likelihood function, and directly deal with the Student's-t distribution. As an application, our method has been applied to image segmentation with promising results.

[1]  Nikolas P. Galatsanos,et al.  Robust Image Segmentation with Mixtures of Student's t-Distributions , 2007, 2007 IEEE International Conference on Image Processing.

[2]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[3]  Q. M. Jonathan Wu,et al.  A Nonsymmetric Mixture Model for Unsupervised Image Segmentation , 2013, IEEE Transactions on Cybernetics.

[4]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[5]  Q. M. Jonathan Wu,et al.  An Extension of the Standard Mixture Model for Image Segmentation , 2010, IEEE Transactions on Neural Networks.

[6]  W. Rudin.  Real and complex analysis , 1968 .

[7]  Jan Skoglund,et al.  Vector quantization based on Gaussian mixture models , 2000, IEEE Trans. Speech Audio Process..

[8]  Karl J. Friston,et al.  Unified segmentation , 2005, NeuroImage.

[9]  Geoffrey J. McLachlan,et al.  Robust mixture modelling using the t distribution , 2000, Stat. Comput..

[10]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[11]  Jitendra Malik,et al.  Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Andrew R. Webb,et al.  Statistical Pattern Recognition , 1999 .

[13]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[14]  Jonas Samuelsson,et al.  Bounded support Gaussian mixture modeling of speech spectra , 2003, IEEE Trans. Speech Audio Process..

[15]  Nizar Bouguila,et al.  Image and Video Segmentation by Combining Unsupervised Generalized Gaussian Mixture Modeling and Feature Selection , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[17]  Mohand Saïd Allili,et al.  Wavelet Modeling Using Finite Mixtures of Generalized Gaussian Distributions: Application to Texture Discrimination and Retrieval , 2012, IEEE Transactions on Image Processing.

[18]  Koenraad Van Leemput,et al.  Automated model-based tissue classification of MR images of the brain , 1999, IEEE Transactions on Medical Imaging.

[19]  Reza Nezafat,et al.  Wavelet-Domain Medical Image Denoising Using Bivariate Laplacian Mixture Model , 2009, IEEE Transactions on Biomedical Engineering.

[20]  Nizar Bouguila,et al.  Bayesian learning of finite generalized Gaussian mixture models on images , 2011, Signal Process..

[21]  Q. M. Jonathan Wu,et al.  Robust Student's-t Mixture Model With Spatial Constraints and Its Application in Medical Image Segmentation , 2012, IEEE Transactions on Medical Imaging.

[22]  Nizar Bouguila,et al.  Finite Generalized Gaussian Mixture Modeling and Applications to Image and Video Foreground Segmentation , 2007, Fourth Canadian Conference on Computer and Robot Vision (CRV '07).

[23]  Martin J. Wainwright,et al.  Image denoising using scale mixtures of Gaussians in the wavelet domain , 2003, IEEE Trans. Image Process..

[24]  Salvatore Tabbone,et al.  Asymmetric Generalized Gaussian Mixture Models and EM Algorithm for Image Segmentation , 2010, 2010 20th International Conference on Pattern Recognition.

[25]  D. Rubin,et al.  ML ESTIMATION OF THE t DISTRIBUTION USING EM AND ITS EXTENSIONS, ECM AND ECME , 1999 .

[26]  Anil K. Jain,et al.  Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[28]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[29]  Martial Hebert,et al.  A Measure for Objective Evaluation of Image Segmentation Algorithms , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.