B-Spline based globally optimal segmentation combining low-level and high-level information

Abstract Image segmentation is an important step for large-scale image analysis and object recognition. Variational-based segmentation methods are widely studied due to their good performance, but they still suffer from incapability to deal with images bearing weak contrast, overlapped noise and cluttered texture. To tackle this problem, we propose a new statistical information analysis based multi-scale and global optimization method for image segmentation. This multi-scale processing which is consistent with human’s cognition mechanism enables us identify target at coarse scale. The high-level prior is obtained by the multiple Gaussian kernel gray equalization and used as shape constraint in following fine-scale. An efficient energy functional is proposed with convexity and improved TV regularization in order to segment inhomogeneous target from noisy background. A convex relaxation function is explicitly represented by cubic B-Spline basis for fast convergence and intrinsic smooth segmentation. Finally, the energy functional is minimized by standard methods of Split Bregman, Gradient Descent Flow and the corresponding Euler–Lagrange Equation. Experimental results on synthetic and real world images validate the robustness and high accuracy boundaries detection for low contrast, noisy and texture images.

[1]  Chunming Li,et al.  Level set evolution without re-initialization: a new variational formulation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[2]  Rachid Deriche,et al.  A Review of Statistical Approaches to Level Set Segmentation: Integrating Color, Texture, Motion and Shape , 2007, International Journal of Computer Vision.

[3]  Chunming Li,et al.  Minimization of Region-Scalable Fitting Energy for Image Segmentation , 2008, IEEE Transactions on Image Processing.

[4]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[5]  Lei Zhu,et al.  Multiscale geodesic active contours for ultrasound image segmentation using speckle reducing anisotropic diffusion , 2014 .

[6]  Hai Min,et al.  Multi-scale local region based level set method for image segmentation in the presence of intensity inhomogeneity , 2015, Neurocomputing.

[7]  Tony F. Chan,et al.  Aspects of Total Variation Regularized L[sup 1] Function Approximation , 2005, SIAM J. Appl. Math..

[8]  Michael Unser,et al.  Variational B-spline level-set method for fast image segmentation , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[9]  Mila Nikolova,et al.  Algorithms for Finding Global Minimizers of Image Segmentation and Denoising Models , 2006, SIAM J. Appl. Math..

[10]  Rachid Deriche,et al.  Geodesic active regions for supervised texture segmentation , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[11]  Hui Wang,et al.  An active contour model and its algorithms with local and global Gaussian distribution fitting energies , 2014, Inf. Sci..

[12]  Daniel Cremers,et al.  A Convex Approach to Minimal Partitions , 2012, SIAM J. Imaging Sci..

[13]  Kap Luk Chan,et al.  Piecewise Linear Patch Reconstruction for Segmentation and Description of Non-smooth Image Structures , 2012, ArXiv.

[14]  Johan Montagnat,et al.  Shape and Topology Constraints on Parametric Active Contours , 2001, Comput. Vis. Image Underst..

[15]  Olivier D. Faugeras,et al.  Statistical shape influence in geodesic active contours , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[16]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[17]  David Zhang,et al.  A Level Set Approach to Image Segmentation With Intensity Inhomogeneity , 2016, IEEE Transactions on Cybernetics.

[18]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[19]  Siau-Chuin Liew,et al.  A Review of Image Segmentation Methodologies in Medical Image , 2015 .

[20]  Jian Yang,et al.  Inhomogeneity-embedded active contour for natural image segmentation , 2015, Pattern Recognit..

[21]  Nikos Paragios,et al.  Non-rigid registration using distance functions , 2003, Comput. Vis. Image Underst..

[22]  Kap Luk Chan,et al.  Incorporating Patch Subspace Model in Mumford–Shah Type Active Contours , 2013, IEEE Transactions on Image Processing.

[23]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[24]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[25]  Laurent D. Cohen,et al.  Nonlocal Active Contours , 2012, SIAM J. Imaging Sci..

[26]  Xuelong Li,et al.  An Efficient MRF Embedded Level Set Method for Image Segmentation , 2015, IEEE Transactions on Image Processing.

[27]  Li Zeng,et al.  Robust image segmentation using local robust statistics and correntropy-based K-means clustering , 2015 .

[28]  Xavier Cufí,et al.  Yet Another Survey on Image Segmentation: Region and Boundary Information Integration , 2002, ECCV.

[29]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[30]  Jing Huang,et al.  Rotation invariant iris feature extraction using Gaussian Markov random fields with non-separable wavelet , 2010, Neurocomputing.

[31]  Chunming Li,et al.  Active contours driven by local Gaussian distribution fitting energy , 2009, Signal Process..

[32]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[33]  Xavier Bresson,et al.  Fast Global Minimization of the Active Contour/Snake Model , 2007, Journal of Mathematical Imaging and Vision.

[34]  Xuelong Li,et al.  A Variational Approach to Simultaneous Image Segmentation and Bias Correction , 2015, IEEE Transactions on Cybernetics.

[35]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[36]  Huihui Song Active contours driven by regularised gradient flux flows for image segmentation , 2014 .

[37]  Ghassan Hamarneh,et al.  Incorporating prior knowledge in medical image segmentation: a survey , 2016, ArXiv.

[38]  Tony F. Chan,et al.  Level set based shape prior segmentation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[39]  Yuhui Zheng,et al.  An Efficient Algorithm for the Piecewise-Smooth Model with Approximately Explicit Solutions , 2016, ArXiv.

[40]  David Zhang,et al.  Reinitialization-Free Level Set Evolution via Reaction Diffusion , 2011, IEEE Transactions on Image Processing.

[41]  Jerry L. Prince,et al.  Snakes, shapes, and gradient vector flow , 1998, IEEE Trans. Image Process..

[42]  V. Caselles,et al.  A geometric model for active contours in image processing , 1993 .

[43]  Rachid Deriche,et al.  Unifying boundary and region-based information for geodesic active tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[44]  Z. Zivkovic Improved adaptive Gaussian mixture model for background subtraction , 2004, ICPR 2004.

[45]  Hui Wang,et al.  An efficient active contour with Gaussian distribution fitting energy , 2013, 2013 IEEE Third International Conference on Information Science and Technology (ICIST).

[46]  Xavier Bresson,et al.  Efficient Algorithm for Level Set Method Preserving Distance Function , 2012, IEEE Transactions on Image Processing.

[47]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Chunming Li,et al.  Computerized Medical Imaging and Graphics Active Contours Driven by Local and Global Intensity Fitting Energy with Application to Brain Mr Image Segmentation , 2022 .