A new variational model for joint restoration and segmentation based on the Mumford-Shah model

Abstract Due to the typical challenges including image noise or blurriness, intensity inhomogeneity or various image modalities, image segmentation is still an open problem. In this paper, a new variational model is proposed for multiphase segmentation of gray and color images corrupted by noise or blur. Based on the aspects of image restoration, the coupled fidelity terms are utilized in order to effectively and robustly tackle images with a high level of noise or blurriness. For intensity inhomogeneous images, we use the bias-corrected fuzzy c-means method to eliminate the effect of bias field before our implementation. A partial result for the energy minimization problem is established. For solving the new variational model, the alternating minimization algorithm is studied. Experiments demonstrate that our method gives excellent results in terms of segmentation quality in comparison with other state-of-the-art segmentation methods.

[1]  I. Ekeland,et al.  Convex analysis and variational problems , 1976 .

[2]  Arvid Lundervold,et al.  Noise removal using fourth-order partial differential equation with applications to medical magnetic resonance images in space and time , 2003, IEEE Trans. Image Process..

[3]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[4]  Lei Zhang,et al.  Active contours driven by local image fitting energy , 2010, Pattern Recognit..

[5]  Lei Wang,et al.  An efficient level set method for simultaneous intensity inhomogeneity correction and segmentation of MR images , 2016, Comput. Medical Imaging Graph..

[6]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[7]  Tony F. Chan,et al.  High-Order Total Variation-Based Image Restoration , 2000, SIAM J. Sci. Comput..

[8]  Aly A. Farag,et al.  A modified fuzzy c-means algorithm for bias field estimation and segmentation of MRI data , 2002, IEEE Transactions on Medical Imaging.

[9]  B. Vemuri,et al.  Image denoising and segmentation via nonlinear diffusion , 2000 .

[10]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[11]  Chunming Li,et al.  Minimization of Region-Scalable Fitting Energy for Image Segmentation , 2008, IEEE Transactions on Image Processing.

[12]  Raymond H. Chan,et al.  A Two-Stage Image Segmentation Method Using a Convex Variant of the Mumford-Shah Model and Thresholding , 2013, SIAM J. Imaging Sci..

[13]  Ivo F. Sbalzarini,et al.  Coupling Image Restoration and Segmentation: A Generalized Linear Model/Bregman Perspective , 2013, International Journal of Computer Vision.

[14]  Nahum Kiryati,et al.  Variational Pairing of Image Segmentation and Blind Restoration , 2004, ECCV.

[15]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[16]  Chunming Li,et al.  Computerized Medical Imaging and Graphics Active Contours Driven by Local and Global Intensity Fitting Energy with Application to Brain Mr Image Segmentation , 2022 .

[17]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[18]  W. Fleming,et al.  An integral formula for total gradient variation , 1960 .

[19]  Anthony J. Yezzi,et al.  Curve evolution implementation of the Mumford-Shah functional for image segmentation, denoising, interpolation, and magnification , 2001, IEEE Trans. Image Process..

[20]  Chunming Li,et al.  MRI Tissue Classification and Bias Field Estimation Based on Coherent Local Intensity Clustering: A Unified Energy Minimization Framework , 2009, IPMI.

[21]  Benoit Mory,et al.  Fuzzy Region Competition: A Convex Two-Phase Segmentation Framework , 2007, SSVM.

[22]  Xiaohao Cai,et al.  Variational image segmentation model coupled with image restoration achievements , 2014, Pattern Recognit..

[23]  Pierre Kornprobst,et al.  Mathematical problems in image processing - partial differential equations and the calculus of variations , 2010, Applied mathematical sciences.

[24]  Michael K. Ng,et al.  A Multiphase Image Segmentation Method Based on Fuzzy Region Competition , 2010, SIAM J. Imaging Sci..

[25]  Chunming Li,et al.  A Level Set Method for Image Segmentation in the Presence of Intensity Inhomogeneities With Application to MRI , 2011, IEEE Transactions on Image Processing.

[26]  Xiao Han,et al.  Atlas Renormalization for Improved Brain MR Image Segmentation Across Scanner Platforms , 2007, IEEE Transactions on Medical Imaging.

[27]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[28]  Weimin Huang,et al.  The $L_{0}$ Regularized Mumford–Shah Model for Bias Correction and Segmentation of Medical Images , 2015, IEEE Transactions on Image Processing.

[29]  Gabriele Steidl,et al.  A new fuzzy c-means method with total variation regularization for segmentation of images with noisy and incomplete data , 2012, Pattern Recognit..