Generalizing Mumford-Shah Model for Multiphase Piecewise Smooth Image Segmentation

This paper concerns multiphase piecewise smooth image segmentation with intensity inhomogeneities. Traditional methods based on the Mumford–Shah (MS) model require solving complicated diffusion equations evolving in irregular subdomains, leading to significant difficulties in efficient and accurate segmentation, especially in multiphase scenarios. In this paper, we propose a general framework to modify the MS model by using smoothing operators that can avoid the complicated implementation and inaccurate segmentation of traditional approaches. A detailed analysis connecting the smoothing operators and the diffusion equations is given to justify the modification. In addition, we present an efficient algorithm based on the direct augmented Lagrangian method, which requires fewer parameters than the commonly used augmented Lagrangian method. Typically, the smoothing operator in the general model is chosen to be Gaussian kernel, the bilateral kernel, and the directional diffusion kernel, respectively. Ample numerical results are provided to demonstrate the efficiency and accuracy of the modified model and the proposed minimization algorithm through various comparisons with existing approaches.

[1]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[2]  Ronald Fedkiw,et al.  Level set methods and dynamic implicit surfaces , 2002, Applied mathematical sciences.

[3]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[4]  Ke Chen,et al.  Stabilised bias field: segmentation with intensity inhomogeneity , 2016 .

[5]  Guy Gilboa,et al.  Nonlocal Operators with Applications to Image Processing , 2008, Multiscale Model. Simul..

[6]  Jean-Michel Morel,et al.  Variational methods in image segmentation , 1995 .

[7]  David Zhang,et al.  A Local Active Contour Model for Image Segmentation with Intensity Inhomogeneity , 2013, ArXiv.

[8]  Ying Gu,et al.  A Direct Approach Toward Global Minimization for Multiphase Labeling and Segmentation Problems , 2012, IEEE Transactions on Image Processing.

[9]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[10]  Yue Wang,et al.  A new Mumford-Shah type model involvinga smoothing operator for multiphase image segmentation , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[11]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[12]  Ke Chen,et al.  A variational model with hybrid images data fitting energies for segmentation of images with intensity inhomogeneity , 2016, Pattern Recognit..

[13]  Rachid Deriche,et al.  Geodesic Active Contours and Level Sets for the Detection and Tracking of Moving Objects , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[15]  Jean-Michel Morel,et al.  The staircasing effect in neighborhood filters and its solution , 2006, IEEE Transactions on Image Processing.

[16]  V. YingjieZhang Fast Segmentation for the Piecewise Smooth Mumford-Shah Functional , 2012 .

[17]  David Zhang,et al.  A Level Set Approach to Image Segmentation With Intensity Inhomogeneity , 2016, IEEE Transactions on Cybernetics.

[18]  Michael K. Ng,et al.  Variational Fuzzy Mumford--Shah Model for Image Segmentation , 2010, SIAM J. Appl. Math..

[19]  Antonin Chambolle,et al.  Image Segmentation by Variational Methods: Mumford and Shah Functional and the Discrete Approximations , 1995, SIAM J. Appl. Math..

[20]  Nikos Paragios,et al.  Handbook of Mathematical Models in Computer Vision , 2005 .

[21]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[22]  Daniel Cremers,et al.  On the Statistical Interpretation of the Piecewise Smooth Mumford-Shah Functional , 2007, SSVM.

[23]  J. Morel,et al.  Variational Methods in Image Segmentation: with seven image processing experiments , 1994 .

[24]  Max K. Agoston,et al.  Computer graphics and geometric modelling - implementation and algorithms , 2005 .

[25]  Anthony J. Yezzi,et al.  Curve evolution implementation of the Mumford-Shah functional for image segmentation, denoising, interpolation, and magnification , 2001, IEEE Trans. Image Process..

[26]  Jianzhong Wang,et al.  Construction of local nonlinear filter without staircase effect in image restoration , 2011 .

[27]  R. B. Potts Some generalized order-disorder transformations , 1952, Mathematical Proceedings of the Cambridge Philosophical Society.

[28]  Allen R. Tannenbaum,et al.  Localizing Region-Based Active Contours , 2008, IEEE Transactions on Image Processing.

[29]  Chunming Li,et al.  Minimization of Region-Scalable Fitting Energy for Image Segmentation , 2008, IEEE Transactions on Image Processing.

[30]  W. Eric L. Grimson,et al.  Adaptive Segmentation of MRI Data , 1995, CVRMed.

[31]  L. P. I︠A︡roslavskiĭ Digital picture processing : an introduction , 1985 .

[32]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[33]  Kaleem Siddiqi,et al.  Geometric heat equation and nonlinear diffusion of shapes and images , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Wei Xiong,et al.  A new approach for multiphase piecewise smooth image segmentation , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[35]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[36]  Max K. Agoston Computer Graphics And Geometric Modelling: Implementation & Algorithms , 2005 .

[37]  Xue-Cheng Tai,et al.  A binary level set model and some applications to Mumford-Shah image segmentation , 2006, IEEE Transactions on Image Processing.

[38]  Jianzhong Wang,et al.  Approximation of weighted local mean operators , 2014 .

[39]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[40]  Théodore Papadopoulo,et al.  Efficient Segmentation of Piecewise Smooth Images , 2007, SSVM.

[41]  Ross T. Whitaker,et al.  A multi-scale approach to nonuniform diffusion , 1993 .

[42]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[43]  Danny Barash,et al.  A Fundamental Relationship between Bilateral Filtering, Adaptive Smoothing, and the Nonlinear Diffusion Equation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  Jie Shen,et al.  Spectral Methods: Algorithms, Analysis and Applications , 2011 .

[45]  Miyoun Jung,et al.  Piecewise-Smooth Image Segmentation Models with $$L^1$$L1 Data-Fidelity Terms , 2017, J. Sci. Comput..

[46]  Pierre Kornprobst,et al.  Mathematical problems in image processing - partial differential equations and the calculus of variations , 2010, Applied mathematical sciences.

[47]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Wei Xiong,et al.  Efficient and robust image segmentation with a new piecewise-smooth decomposition model , 2013, 2013 IEEE International Conference on Image Processing.

[49]  Chunming Li,et al.  A Variational Level Set Approach to Segmentation and Bias Correction of Images with Intensity Inhomogeneity , 2008, MICCAI.

[50]  Xavier Bresson,et al.  Fast Global Minimization of the Active Contour/Snake Model , 2007, Journal of Mathematical Imaging and Vision.

[51]  Guy Gilboa,et al.  Nonlocal Linear Image Regularization and Supervised Segmentation , 2007, Multiscale Model. Simul..