Active contours driven by local likelihood image fitting energy for image segmentation

Accurate image segmentation is an essential step in image analysis and understanding, where active contour models play an important part. Due to the noise, low contrast and intensity inhomogeneity in images, many segmentation algorithms suffer from limited accuracy. This paper presents a novel region-based active contour model for image segmentation by using the variational level set formulation. In this model, we construct the local likelihood image fitting (LLIF) energy functional by describing the neighboring intensities with local Gaussian distributions. The means and variances of local intensities in the LLIF energy functional are spatially varying functions, which can be iteratively estimated during an energy minimization process to guide the contour evolving toward object boundaries. To address diverse image segmentation needs, we also expand this model to the multiphase level set, multi-scale Gaussian kernels and narrowband formulations. The proposed model has been compared with several state-of-the-art active contour models on images with different modalities. Our results indicate that the proposed LLIF model achieves superior performance in image segmentation.

[1]  Josiane Zerubia,et al.  A Variational Model for Image Classification and Restoration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Xun Wang,et al.  A comparative study of deformable contour methods on medical image segmentation , 2008, Image Vis. Comput..

[3]  Rachid Deriche,et al.  A Review of Statistical Approaches to Level Set Segmentation: Integrating Color, Texture, Motion and Shape , 2007, International Journal of Computer Vision.

[4]  Chunhong Pan,et al.  Robust level set image segmentation via a local correntropy-based K-means clustering , 2014, Pattern Recognit..

[5]  David Zhang,et al.  A Local Active Contour Model for Image Segmentation with Intensity Inhomogeneity , 2013, ArXiv.

[6]  Lei Zhang,et al.  Active contours driven by local image fitting energy , 2010, Pattern Recognit..

[7]  Kaleem Siddiqi,et al.  Flux maximizing geometric flows , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[8]  Anthony Yezzi,et al.  Hybrid geodesic region-based curve evolutions for image segmentation , 2007, SPIE Medical Imaging.

[9]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[10]  Théodore Papadopoulo,et al.  Efficient Segmentation of Piecewise Smooth Images , 2007, SSVM.

[11]  Xinbo Gao,et al.  A shape-initialized and intensity-adaptive level set method for auroral oval segmentation , 2014, Inf. Sci..

[12]  Hai Min,et al.  A novel level set method for image segmentation by incorporating local statistical analysis and global similarity measurement , 2015, Pattern Recognit..

[13]  Shigang Liu,et al.  A local region-based Chan-Vese model for image segmentation , 2012, Pattern Recognit..

[14]  A. Evans,et al.  MRI simulation-based evaluation of image-processing and classification methods , 1999, IEEE Transactions on Medical Imaging.

[15]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[16]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[17]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[18]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[19]  Martial Hebert,et al.  A Measure for Objective Evaluation of Image Segmentation Algorithms , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[20]  Anthony J. Yezzi,et al.  Curve evolution implementation of the Mumford-Shah functional for image segmentation, denoising, interpolation, and magnification , 2001, IEEE Trans. Image Process..

[21]  Alan C. Evans,et al.  MRI Simulation Based Evaluation and Classifications Methods , 1999, IEEE Trans. Medical Imaging.

[22]  Julien Mille,et al.  Narrow band region-based active contours and surfaces for 2D and 3D segmentation , 2009, Comput. Vis. Image Underst..

[23]  Junaed Sattar Snakes , Shapes and Gradient Vector Flow , 2022 .

[24]  David Dagan Feng,et al.  Robust Model for Segmenting Images With/Without Intensity Inhomogeneities , 2013, IEEE Transactions on Image Processing.

[25]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[26]  Xuelong Li,et al.  A Unified Tensor Level Set for Image Segmentation , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[27]  C. Lamberti,et al.  Maximum likelihood segmentation of ultrasound images with Rayleigh distribution , 2005, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[28]  R. Kimmel,et al.  Finding shortest paths on surfaces , 1994 .

[29]  Weifeng Li,et al.  Active contours driven by local and global probability distributions , 2013, J. Vis. Commun. Image Represent..

[30]  Lei Zhang,et al.  Evaluation of Image Segmentation Quality by Adaptive Ground Truth Composition , 2012, ECCV.

[31]  Qi Zhang,et al.  Adaptive segmentation of magnetic resonance images with intensity inhomogeneity using level set method. , 2013, Magnetic resonance imaging.

[32]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[33]  Enqing Dong,et al.  Narrow Band Active Contour Model for Local Segmentation of Medical and Texture Images , 2013 .

[34]  Bin Wang,et al.  A Fast and Robust Level Set Method for Image Segmentation Using Fuzzy Clustering and Lattice Boltzmann Method , 2013, IEEE Transactions on Cybernetics.

[35]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Gabriel Cristóbal,et al.  Texture descriptor approaches to level set segmentation in medical images , 2014, Photonics Europe.

[37]  Chunming Li,et al.  Active contours driven by local Gaussian distribution fitting energy , 2009, Signal Process..

[38]  Nikolas P. Galatsanos,et al.  A Class-Adaptive Spatially Variant Mixture Model for Image Segmentation , 2007, IEEE Transactions on Image Processing.

[39]  Yong Yin,et al.  A Likelihood and Local Constraint Level Set Model for Liver Tumor Segmentation from CT Volumes , 2013, IEEE Transactions on Biomedical Engineering.

[40]  Chunming Li,et al.  Computerized Medical Imaging and Graphics Active Contours Driven by Local and Global Intensity Fitting Energy with Application to Brain Mr Image Segmentation , 2022 .

[41]  Allen R. Tannenbaum,et al.  Localizing Region-Based Active Contours , 2008, IEEE Transactions on Image Processing.

[42]  Chunming Li,et al.  Minimization of Region-Scalable Fitting Energy for Image Segmentation , 2008, IEEE Transactions on Image Processing.

[43]  Akinobu Shimizu,et al.  A conditional statistical shape model with integrated error estimation of the conditions; Application to liver segmentation in non-contrast CT images , 2014, Medical Image Anal..

[44]  Dinggang Shen,et al.  Automatic segmentation of neonatal images using convex optimization and coupled level sets , 2011, NeuroImage.

[45]  Hui Wang,et al.  An active contour model and its algorithms with local and global Gaussian distribution fitting energies , 2014, Inf. Sci..

[46]  S. Osher,et al.  Algorithms Based on Hamilton-Jacobi Formulations , 1988 .

[47]  Wei Jia,et al.  An Intensity-Texture model based level set method for image segmentation , 2015, Pattern Recognit..

[48]  Yaozong Gao,et al.  Segmentation of neonatal brain MR images using patch-driven level sets , 2014, NeuroImage.

[49]  Chunming Li,et al.  A Level Set Method for Image Segmentation in the Presence of Intensity Inhomogeneities With Application to MRI , 2011, IEEE Transactions on Image Processing.

[50]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[51]  Huimin Yu,et al.  Shape Sparse Representation for Joint Object Classification and Segmentation , 2013, IEEE Transactions on Image Processing.

[52]  Pierre Kornprobst,et al.  Mathematical problems in image processing - partial differential equations and the calculus of variations , 2010, Applied mathematical sciences.

[53]  Xuelong Li,et al.  Improving Level Set Method for Fast Auroral Oval Segmentation , 2014, IEEE Transactions on Image Processing.

[54]  J. Sethian,et al.  A Fast Level Set Method for Propagating Interfaces , 1995 .

[55]  Chunming Li,et al.  Implicit Active Contours Driven by Local Binary Fitting Energy , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[56]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Rémi Ronfard,et al.  Region-based strategies for active contour models , 1994, International Journal of Computer Vision.

[58]  Xuelong Li,et al.  A Nonlinear Adaptive Level Set for Image Segmentation , 2014, IEEE Transactions on Cybernetics.

[59]  Rachid Deriche,et al.  Geodesic Active Regions and Level Set Methods for Supervised Texture Segmentation , 2002, International Journal of Computer Vision.

[60]  Lei Zhang,et al.  Active contours with selective local or global segmentation: A new formulation and level set method , 2010, Image Vis. Comput..

[61]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[62]  David Dagan Feng,et al.  Corrections to "Robust Model for Segmenting Images With/Without Intensity Inhomogeneities" [August 13 3296-3309] , 2013, IEEE Trans. Image Process..

[63]  Chenyang Xu,et al.  Gamma -Convergence Approximation to Piecewise Smooth Medical Image Segmentation , 2007, MICCAI.

[64]  James A. Sethian,et al.  The Fast Construction of Extension Velocities in Level Set Methods , 1999 .

[65]  Alfred M. Bruckstein,et al.  Finding Shortest Paths on Surfaces Using Level Sets Propagation , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[66]  Ying Wang,et al.  Level set evolution with locally linear classification for image segmentation , 2011, ICIP.