Nonlocal variational image segmentation models on graphs using the Split Bregman

Abstract Variational functionals such as Mumford-Shah and Chan-Vese methods have a major impact on various areas of image processing. After over 10 years of investigation, they are still in widespread use today. These formulations optimize contours by evolution through gradient descent, which is known for its overdependence on initialization and the tendency to produce undesirable local minima. In this paper, we propose an image segmentation model in a variational nonlocal means framework based on a weighted graph. The advantages of this model are twofold. First, the convexity global minimum (optimum) information is taken into account to achieve better segmentation results. Second, the proposed global convex energy functionals combine nonlocal regularization and local intensity fitting terms. The nonlocal total variational regularization term based on the graph is able to preserve the detailed structure of target objects. At the same time, the modified local binary fitting term introduced in the model as the local fitting term can efficiently deal with intensity inhomogeneity in images. Finally, we apply the Split Bregman method to minimize the proposed energy functional efficiently. The proposed model has been applied to segmentation of real medical and remote sensing images. Compared with other methods, the proposed model is superior in terms of both accuracy and efficient.

[1]  Yi Yang,et al.  Interactive Video Indexing With Statistical Active Learning , 2012, IEEE Transactions on Multimedia.

[2]  Peng Zhang,et al.  A new deformable model using level sets for shape segmentation , 2009 .

[3]  J. S. Sahambi,et al.  Modified active contour model and Random Walk approach for left ventricular cardiac MR image segmentation , 2011 .

[4]  Olivier D. Faugeras,et al.  Statistical shape influence in geodesic active contours , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[5]  Ke Lu,et al.  Nonlocal Means-Based Denoising for Medical Images , 2012, Comput. Math. Methods Medicine.

[6]  Tao Mei,et al.  Joint multi-label multi-instance learning for image classification , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Yang Xiang,et al.  An active contour model for image segmentation based on elastic interaction , 2006, J. Comput. Phys..

[8]  L. Cohen,et al.  Multi-resolution algorithms for active contour models , 1996 .

[9]  A. Wyner,et al.  Analysis and Optimization of Systems , 1988 .

[10]  T. Chan NON-LOCAL UNSUPERVISED VARIATIONAL IMAGE SEGMENTATION MODELS , 2008 .

[11]  Meng Wang,et al.  Visual query suggestion , 2009, ACM Multimedia.

[12]  Boying Wu,et al.  Convex Image Segmentation Model Based on Local and Global Intensity Fitting Energy and Split Bregman Method , 2012, J. Appl. Math..

[13]  Yue Gao,et al.  Camera Constraint-Free View-Based 3-D Object Retrieval , 2012, IEEE Transactions on Image Processing.

[14]  Xuelong Li,et al.  Visual-Textual Joint Relevance Learning for Tag-Based Social Image Search , 2013, IEEE Transactions on Image Processing.

[15]  Ning He,et al.  Content-based similarity for 3D model retrieval and classification , 2009 .

[16]  Baba C. Vemuri,et al.  Front Propagation: A Framework for Topology Independent Shape Modeling and Recovery , 1994 .

[17]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[18]  Wei Chen,et al.  Efficiently Solving the Piecewise Constant Mumford-Shah Model using Graph Cuts , 2005 .

[19]  Meng Wang,et al.  Visual query suggestion , 2010, ACM Trans. Multim. Comput. Commun. Appl..

[20]  Meng Wang,et al.  Event Driven Web Video Summarization by Tag Localization and Key-Shot Identification , 2012, IEEE Transactions on Multimedia.

[21]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[22]  Laurent D. Cohen,et al.  Non-local Regularization of Inverse Problems , 2008, ECCV.

[23]  Laurent D. Cohen,et al.  Non-local segmentation and inpaiting , 2011, 2011 18th IEEE International Conference on Image Processing.

[24]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[25]  Qian Wang,et al.  Kernel Optimization for Blind Motion Deblurring with Image Edge Prior , 2012 .

[26]  Anthony J. Yezzi,et al.  Gradient flows and geometric active contour models , 1995, Proceedings of IEEE International Conference on Computer Vision.

[27]  Chunming Li,et al.  Level set evolution without re-initialization: a new variational formulation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[28]  Guy Gilboa,et al.  Nonlocal Operators with Applications to Image Processing , 2008, Multiscale Model. Simul..

[29]  Tao Mei,et al.  Graph-based semi-supervised learning with multiple labels , 2009, J. Vis. Commun. Image Represent..

[30]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[31]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[32]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[33]  Laurent D. Cohen,et al.  Finite-Element Methods for Active Contour Models and Balloons for 2-D and 3-D Images , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Xiaofeng Wang,et al.  An efficient local Chan-Vese model for image segmentation , 2010, Pattern Recognit..

[35]  Christopher V. Alvino,et al.  The Piecewise Smooth Mumford–Shah Functional on an Arbitrary Graph , 2009, IEEE Transactions on Image Processing.

[36]  Jerry L. Prince,et al.  Generalized gradient vector flow external forces for active contours , 1998, Signal Process..

[37]  Hung-Khoon Tan,et al.  Beyond search: Event-driven summarization for web videos , 2011, TOMCCAP.

[38]  Daniel Cremers,et al.  An Integral Solution to Surface Evolution PDEs Via Geo-cuts , 2006, ECCV.

[39]  Yue Gao,et al.  3-D Object Retrieval and Recognition With Hypergraph Analysis , 2012, IEEE Transactions on Image Processing.

[40]  Laurent D. Cohen,et al.  Nonlocal Active Contours , 2012, SIAM J. Imaging Sci..