A Two-Stage Image Segmentation Method for Blurry Images with Poisson or Multiplicative Gamma Noise

In this paper, a two-stage method for segmenting blurry images in the presence of Poisson or multiplicative Gamma noise is proposed. The method is inspired by a previous work on two-stage segmentation and the usage of an I-divergence term to handle the noise. The first stage of our method is to find a smooth solution $u$ to a convex variant of the Mumford--Shah model where the $\ell_2$ data-fidelity term is replaced by an I-divergence term. A primal-dual algorithm is adopted to efficiently solve the minimization problem. We prove the convergence of the algorithm and the uniqueness of the solution $u$. Once $u$ is obtained, in the second stage, the segmentation is done by thresholding $u$ into different phases. The thresholds can be given by the users or can be obtained automatically by using any clustering method. In our method, we can obtain any $K$-phase segmentation ($K\geq 2$) by choosing $(K-1)$ thresholds after $u$ is found. Changing $K$ or the thresholds does not require $u$ to be recomputed. Exper...

[1]  Gilles Aubert,et al.  A Variational Approach to Removing Multiplicative Noise , 2008, SIAM J. Appl. Math..

[2]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[3]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Christophe Chesnaud,et al.  Statistical Region Snake-Based Segmentation Adapted to Different Physical Noise Models , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  F. J. Anscombe,et al.  THE TRANSFORMATION OF POISSON, BINOMIAL AND NEGATIVE-BINOMIAL DATA , 1948 .

[6]  Xue-Cheng Tai,et al.  A Continuous Max-Flow Approach to Potts Model , 2010, ECCV.

[7]  M. Ng,et al.  EFFICIENT BOX-CONSTRAINED TV-TYPE-l^1 ALGORITHMS FOR RESTORING IMAGES WITH IMPULSE NOISE , 2013 .

[8]  Simon Just Kjeldgaard Pedersen Circular Hough Transform , 2009, Encyclopedia of Biometrics.

[9]  Stanley Osher,et al.  Multiplicative Denoising and Deblurring: Theory and Algorithms , 2003 .

[10]  Xiaoyi Jiang,et al.  A Variational Framework for Region-Based Segmentation Incorporating Physical Noise Models , 2013, Journal of Mathematical Imaging and Vision.

[11]  Alessandro Foi,et al.  Optimal Inversion of the Anscombe Transformation in Low-Count Poisson Image Denoising , 2011, IEEE Transactions on Image Processing.

[12]  Xue-Cheng Tai,et al.  A study on continuous max-flow and min-cut approaches , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  A. Chambolle,et al.  Discrete approximation of the Mumford-Shah functional in dimension two , 1999, ESAIM: Mathematical Modelling and Numerical Analysis.

[14]  Christoph Schnörr,et al.  Continuous Multiclass Labeling Approaches and Algorithms , 2011, SIAM J. Imaging Sci..

[15]  Aichi Chien,et al.  Frame based segmentation for medical images , 2011 .

[16]  Daniel Cremers,et al.  An algorithm for minimizing the Mumford-Shah functional , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[17]  Raymond H. Chan,et al.  Parameter selection for total-variation-based image restoration using discrepancy principle , 2012, IEEE Transactions on Image Processing.

[18]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[19]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[20]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[21]  Gene H. Golub,et al.  A Nonlinear Primal-Dual Method for Total Variation-Based Image Restoration , 1999, SIAM J. Sci. Comput..

[22]  OsherStanley,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[23]  Mohamed-Jalal Fadili,et al.  Multiplicative Noise Removal Using L1 Fidelity on Frame Coefficients , 2008, Journal of Mathematical Imaging and Vision.

[24]  Mingqiang Zhu,et al.  An Efficient Primal-Dual Hybrid Gradient Algorithm For Total Variation Image Restoration , 2008 .

[25]  Philippe Réfrégier,et al.  Influence of the noise model on level set active contour segmentation , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Jing Yuan,et al.  Simultaneous Higher-Order Optical Flow Estimation and Decomposition , 2007, SIAM J. Sci. Comput..

[27]  Raymond H. Chan,et al.  A Two-Stage Image Segmentation Method Using a Convex Variant of the Mumford-Shah Model and Thresholding , 2013, SIAM J. Imaging Sci..

[28]  A. Chambolle FINITE-DIFFERENCES DISCRETIZATIONS OF THE MUMFORD-SHAH FUNCTIONAL , 1999 .

[29]  G. David,et al.  Singular Sets of Minimizers for the Mumford-Shah Functional , 2005 .

[30]  Tony F. Chan,et al.  Unsupervised Multiphase Segmentation: A Phase Balancing Model , 2010, IEEE Transactions on Image Processing.

[31]  Thomas J. Asaki,et al.  A Variational Approach to Reconstructing Images Corrupted by Poisson Noise , 2007, Journal of Mathematical Imaging and Vision.

[32]  I. Ekeland,et al.  Convex analysis and variational problems , 1976 .

[33]  Frédéric Galland,et al.  Multi-component image segmentation in homogeneous regions based on description length minimization: Application to speckle, Poisson and Bernoulli noise , 2005, Pattern Recognit..

[34]  G. M.,et al.  Partial Differential Equations I , 2023, Applied Mathematical Sciences.

[35]  Segmentation and denoising via an adaptive threshold Mumford-Shah-like functional , 2004, ICPR 2004.

[36]  Gabriele Steidl,et al.  Segmentation of images with separating layers by fuzzy c-means and convex optimization , 2012, J. Vis. Commun. Image Represent..

[37]  Jianing Shi,et al.  A Nonlinear Inverse Scale Space Method for a Convex Multiplicative Noise Model , 2008, SIAM J. Imaging Sci..

[38]  ANTONIN CHAMBOLLE,et al.  An Algorithm for Total Variation Minimization and Applications , 2004, Journal of Mathematical Imaging and Vision.

[39]  Yunho Kim Strictly convex realization in two-phase image segmentation , 2013 .

[40]  Luigi Ambrosio,et al.  ON THE APPROXIMATION OF FREE DISCONTINUITY PROBLEMS , 1992 .

[41]  O Ruch,et al.  Minimal-complexity segmentation with a polygonal snake adapted to different optical noise models. , 2001, Optics letters.

[42]  Irving H. Shames,et al.  Introduction to the Calculus of Variations , 2013 .

[43]  Tony F. Chan,et al.  Mumford and Shah Model and Its Applications to Image Segmentation and Image Restoration , 2015, Handbook of Mathematical Methods in Imaging.

[44]  José M. Bioucas-Dias,et al.  Restoration of Poissonian Images Using Alternating Direction Optimization , 2010, IEEE Transactions on Image Processing.

[45]  Xuecheng Tai,et al.  Simultaneous Convex Optimization of Regions and Region Parameters in Image Segmentation Models , 2013, Innovations for Shape Analysis, Models and Algorithms.

[46]  Xue-Cheng Tai,et al.  A binary level set model and some applications to Mumford-Shah image segmentation , 2006, IEEE Transactions on Image Processing.

[47]  Antonin Chambolle,et al.  The Discontinuity Set of Solutions of the TV Denoising Problem and Some Extensions , 2007, Multiscale Model. Simul..

[48]  Gabriele Steidl,et al.  Removing Multiplicative Noise by Douglas-Rachford Splitting Methods , 2010, Journal of Mathematical Imaging and Vision.

[49]  Xavier Bresson,et al.  Fast Global Minimization of the Active Contour/Snake Model , 2007, Journal of Mathematical Imaging and Vision.

[50]  Christin Wirth,et al.  Geometric Level Set Methods In Imaging Vision And Graphics , 2016 .

[51]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[52]  Michael K. Ng,et al.  A Multiphase Image Segmentation Method Based on Fuzzy Region Competition , 2010, SIAM J. Imaging Sci..

[53]  Daniel Cremers,et al.  A convex relaxation approach for computing minimal partitions , 2009, CVPR.

[54]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[55]  S. Esedoglu,et al.  Threshold dynamics for the piecewise constant Mumford-Shah functional , 2006 .

[56]  Chunming Li,et al.  Multiphase Soft Segmentation with Total Variation and H1 Regularization , 2010, Journal of Mathematical Imaging and Vision.

[57]  Antonin Chambolle,et al.  Image Segmentation by Variational Methods: Mumford and Shah Functional and the Discrete Approximations , 1995, SIAM J. Appl. Math..

[58]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[59]  Michael Hintermüller,et al.  An Infeasible Primal-Dual Algorithm for Total Bounded Variation-Based Inf-Convolution-Type Image Restoration , 2006, SIAM J. Sci. Comput..

[60]  Anthony J. Yezzi,et al.  Curve evolution implementation of the Mumford-Shah functional for image segmentation, denoising, interpolation, and magnification , 2001, IEEE Trans. Image Process..

[61]  Christopher V. Alvino,et al.  Reformulating and Optimizing the Mumford-Shah Functional on a Graph - A Faster, Lower Energy Solution , 2008, ECCV.

[62]  R. Waterston,et al.  Automated cell lineage tracing in Caenorhabditis elegans. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[63]  Massimo Gobbino Finite Difference Approximation of the Mumford-Shah Functional , 1998 .

[64]  Mila Nikolova,et al.  Algorithms for Finding Global Minimizers of Image Segmentation and Denoising Models , 2006, SIAM J. Appl. Math..

[65]  L. Ambrosio,et al.  Approximation of functional depending on jumps by elliptic functional via t-convergence , 1990 .

[66]  J. Morel,et al.  A multiscale algorithm for image segmentation by variational method , 1994 .

[67]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[68]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[69]  M. Morini,et al.  Mumford–Shah Functional as Γ-Limit of Discrete Perona–Malik Energies , 2003 .