Variational and PCA based natural image segmentation

This paper introduces a novel variational segmentation method within the fuzzy framework, which solves the problem of segmenting multi-region color-scale images of natural scenes. We call this kind of images as natural images. The advantages of our segmentation method are: (1) by introducing the PCA descriptors, our segmentation model can partition color-texture images better than classical variational-based segmentation models, (2) to preserve geometrical structure of each fuzzy membership function, we propose a nonconvex regularization term in our model, (3) to solve our segmentation model more efficiently, we design a fast iteration algorithm in which we integrate the augmented Lagrange multiplier method and the iterative reweighting. We conduct comprehensive experiments to measure the segmentation performance of our model in terms of visual evaluation, and we also demonstrate the efficiency of the corresponding algorithm in terms of a variety of quantitative indices. The proposed model achieves better segmentation results compared with some other well-known models, such as the level-set model and the fuzzy region competition model, while the proposed algorithm is much more efficient than the algorithm of the state-of-the-art natural image segmentation model.

[1]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[2]  Xuelong Li,et al.  Mammographic mass segmentation: Embedding multiple features in vector-valued level set in ambiguous regions , 2011, Pattern Recognit..

[3]  Michael I. Jordan,et al.  Variational inference for Dirichlet process mixtures , 2006 .

[4]  Xinbo Gao,et al.  A novel fuzzy clustering algorithm with non local adaptive spatial constraint for image segmentation , 2011, Signal Process..

[5]  Chunming Li,et al.  Active contours driven by local Gaussian distribution fitting energy , 2009, Signal Process..

[6]  Hossein Mobahi,et al.  Natural Image Segmentation with Adaptive Texture and Boundary Encoding , 2009, ACCV.

[7]  Chunming Li,et al.  A Level Set Method for Image Segmentation in the Presence of Intensity Inhomogeneities With Application to MRI , 2011, IEEE Transactions on Image Processing.

[8]  Cewu Lu,et al.  Image smoothing via L0 gradient minimization , 2011, ACM Trans. Graph..

[9]  Lei Zhang,et al.  Active contours driven by local image fitting energy , 2010, Pattern Recognit..

[10]  Jianhong Shen,et al.  A Stochastic-Variational Model for Soft Mumford-Shah Segmentation , 2005, Int. J. Biomed. Imaging.

[11]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[12]  Xuelong Li,et al.  A Unified Tensor Level Set for Image Segmentation , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[14]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Jerry L. Prince,et al.  Snakes, shapes, and gradient vector flow , 1998, IEEE Trans. Image Process..

[16]  Rong Yan,et al.  Interactive Image Segmentation Using Dirichlet Process Multiple-View Learning , 2012, IEEE Transactions on Image Processing.

[17]  Q. M. Jonathan Wu,et al.  Dirichlet Gaussian mixture model: Application to image segmentation , 2011, Image Vis. Comput..

[18]  Iasonas Kokkinos,et al.  Synergy between Object Recognition and Image Segmentation Using the Expectation-Maximization Algorithm , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Liangliang Cao,et al.  Image Segmentation by MAP-ML Estimations , 2010, IEEE Transactions on Image Processing.

[20]  Xavier Bresson,et al.  Fast Global Minimization of the Active Contour/Snake Model , 2007, Journal of Mathematical Imaging and Vision.

[21]  Rachid Deriche,et al.  Active unsupervised texture segmentation on a diffusion based feature space , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[22]  Yizhou Yu,et al.  Example-based image color and tone style enhancement , 2011, SIGGRAPH 2011.

[23]  Shuicheng Yan,et al.  Multi-task low-rank affinity pursuit for image segmentation , 2011, 2011 International Conference on Computer Vision.

[24]  BressonXavier,et al.  Geometric Applications of the Split Bregman Method , 2010 .

[25]  Xiangchu Feng,et al.  A new fast multiphase image segmentation algorithm based on nonconvex regularizer , 2012, Pattern Recognit..

[26]  LiuJun,et al.  A fast segmentation method based on constraint optimization and its applications , 2011 .

[27]  Shigang Liu,et al.  A local region-based Chan-Vese model for image segmentation , 2012, Pattern Recognit..

[28]  Amar Mitiche,et al.  Polarimetric image segmentation via maximum-likelihood approximation and efficient multiphase level-sets , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Yoon Mo Jung,et al.  Multiphase Image Segmentation via Modica-Mortola Phase Transition , 2007, SIAM J. Appl. Math..

[30]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Jian Yang,et al.  Image segmentation by iterated region merging with localized graph cuts , 2011, Pattern Recognit..

[32]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[33]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[34]  Zhenhua Guo,et al.  Rotation invariant texture classification using LBP variance (LBPV) with global matching , 2010, Pattern Recognit..

[35]  I. Daubechies,et al.  Iteratively reweighted least squares minimization for sparse recovery , 2008, 0807.0575.

[36]  Michael K. Ng,et al.  A Multiphase Image Segmentation Method Based on Fuzzy Region Competition , 2010, SIAM J. Imaging Sci..

[37]  A. Chambolle Practical, Unified, Motion and Missing Data Treatment in Degraded Video , 2004, Journal of Mathematical Imaging and Vision.

[38]  Honghai Liu,et al.  Fuzzy Gaussian Mixture Models , 2012, Pattern Recognit..

[39]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[40]  Xavier Bresson,et al.  Geometric Applications of the Split Bregman Method: Segmentation and Surface Reconstruction , 2010, J. Sci. Comput..

[41]  John C. Gore,et al.  A robust parametric method for bias field estimation and segmentation of MR images , 2009, CVPR.

[42]  Liang Xiao,et al.  An improved region-based model with local statistical features for image segmentation , 2012, Pattern Recognit..

[43]  Takashi Naito,et al.  Multiband Image Segmentation and Object Recognition for Understanding Road Scenes , 2011, IEEE Transactions on Intelligent Transportation Systems.

[44]  Yee Whye Teh,et al.  Linear Response Algorithms for Approximate Inference in Graphical Models , 2004, Neural Computation.

[45]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[46]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[47]  Nikolas P. Galatsanos,et al.  A Bayesian Framework for Image Segmentation With Spatially Varying Mixtures , 2010, IEEE Transactions on Image Processing.

[48]  Fuhua Chen,et al.  A soft multiphase segmentation model via Gaussian mixture , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[49]  Chunming Li,et al.  Image segmentation with simultaneous illumination and reflectance estimation: An energy minimization approach , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[50]  Xue-Cheng Tai,et al.  A fast segmentation method based on constraint optimization and its applications: Intensity inhomogeneity and texture segmentation , 2011, Pattern Recognit..

[51]  Mohamed-Jalal Fadili,et al.  Region-based active contours and sparse representations for texture segmentation , 2008, 2008 19th International Conference on Pattern Recognition.

[52]  Chunming Li,et al.  Implicit Active Contours Driven by Local Binary Fitting Energy , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[53]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[54]  Jean-Philippe Thiran,et al.  Variational Segmentation using Fuzzy Region Competition and Local Non-Parametric Probability Density Functions , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[55]  Shuicheng Yan,et al.  Latent Low-Rank Representation for subspace segmentation and feature extraction , 2011, 2011 International Conference on Computer Vision.