Accurate image segmentation using Gaussian mixture model with saliency map

Gaussian mixture model (GMM) is a flexible tool for image segmentation and image classification. However, one main limitation of GMM is that it does not consider spatial information. Some authors introduced global spatial information from neighbor pixels into GMM without taking the image content into account. The technique of saliency map, which is based on the human visual system, enhances the image regions with high perceptive information. In this paper, we propose a new model, which incorporates the image content-based spatial information extracted from saliency map into the conventional GMM. The proposed method has several advantages: It is easy to implement into the expectation–maximization algorithm for parameters estimation, and therefore, there is only little impact in computational cost. Experimental results performed on the public Berkeley database show that the proposed method outperforms the state-of-the-art methods in terms of accuracy and computational time.

[1]  Thomas J. Hebert,et al.  Bayesian pixel classification using spatially variant finite mixtures and the generalized EM algorithm , 1998, IEEE Trans. Image Process..

[2]  G. McLachlan,et al.  Extensions of the EM Algorithm , 2007 .

[3]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[4]  D. Ruderman The statistics of natural images , 1994 .

[5]  Theo Gevers,et al.  A Spatially Constrained Generative Model and an EM Algorithm for Image Segmentation , 2007, IEEE Transactions on Neural Networks.

[6]  Christof Koch,et al.  Attentional Selection for Object Recognition - A Gentle Way , 2002, Biologically Motivated Computer Vision.

[7]  Thierry Bouwmans,et al.  Background Modeling using Mixture of Gaussians for Foreground Detection - A Survey , 2008 .

[8]  Nizar Bouguila,et al.  Finite Generalized Gaussian Mixture Modeling and Applications to Image and Video Foreground Segmentation , 2007, Fourth Canadian Conference on Computer and Robot Vision (CRV '07).

[9]  Thierry Denœux Maximum likelihood estimation from fuzzy data using the EM algorithm , 2011 .

[10]  Brendon J. Woodford,et al.  Illumination Invariant Background Model Using Mixture of Gaussians and SURF Features , 2012, ACCV Workshops.

[11]  Ronald A. Rensink,et al.  Preemption effects in visual search: evidence for low-level grouping. , 1995, Psychological review.

[12]  Hui Zhang,et al.  Incorporating Mean Template Into Finite Mixture Model for Image Segmentation , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Eero P. Simoncelli,et al.  On Advances in Statistical Modeling of Natural Images , 2004, Journal of Mathematical Imaging and Vision.

[14]  Nizar Bouguila,et al.  Finite Generalized Gaussian Mixture Modeling and Applications to Image and Video Foreground Segmentation , 2007, Fourth Canadian Conference on Computer and Robot Vision (CRV '07).

[15]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[16]  Jeff A. Bilmes,et al.  A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models , 1998 .

[17]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[18]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[19]  Limin Luo,et al.  A vectorial image soft segmentation method based on neighborhood weighted Gaussian mixture model , 2009, Comput. Medical Imaging Graph..

[20]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[21]  Thierry Denoeux,et al.  Maximum likelihood estimation from fuzzy data using the EM algorithm , 2011, Fuzzy Sets Syst..

[22]  Joseph N. Wilson,et al.  Twenty Years of Mixture of Experts , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Nikolas P. Galatsanos,et al.  A spatially constrained mixture model for image segmentation , 2005, IEEE Transactions on Neural Networks.

[24]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[25]  Thierry Bouwmans,et al.  Type-2 Fuzzy Mixture of Gaussians Model: Application to Background Modeling , 2008, ISVC.

[26]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[27]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[28]  Ali Borji,et al.  State-of-the-Art in Visual Attention Modeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Ronald A. Rensink Seeing, sensing, and scrutinizing , 2000, Vision Research.

[30]  Hui Zhang,et al.  Image segmentation by a robust Modified Gaussian Mixture Model , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[31]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Nizar Bouguila,et al.  Count Data Modeling and Classification Using Finite Mixtures of Distributions , 2011, IEEE Transactions on Neural Networks.

[33]  Stelios Krinidis,et al.  A Robust Fuzzy Local Information C-Means Clustering Algorithm , 2010, IEEE Transactions on Image Processing.

[34]  Martial Hebert,et al.  Toward Objective Evaluation of Image Segmentation Algorithms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Anil K. Jain,et al.  Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[37]  Q. M. Jonathan Wu,et al.  Gaussian-Mixture-Model-Based Spatial Neighborhood Relationships for Pixel Labeling Problem , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[38]  Nizar Bouguila,et al.  A Robust Video Foreground Segmentation by Using Generalized Gaussian Mixture Modeling , 2007, Fourth Canadian Conference on Computer and Robot Vision (CRV '07).

[39]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[40]  Sotirios Chatzis,et al.  A Fuzzy Clustering Approach Toward Hidden Markov Random Field Models for Enhanced Spatially Constrained Image Segmentation , 2008, IEEE Transactions on Fuzzy Systems.