RESLS: Region and Edge Synergetic Level Set Framework for Image Segmentation

The active contour models with level set evolution have been visited with a vast number of methods for image segmentation. They can be mainly classified into region-based and edge-based models, and it has been validated that the hybrid variants combining both region and edge information can improve the segmentation performance. However, to the best of our knowledge, the theoretical foundation of collaboration mechanism between the region and the edge information is limited. Specifically, most existing hybrid models are just combining all the energy terms together, resulting in great challenges of choosing an appropriate weight coefficient for each term and accommodating different modalities of imaging. To overcome these difficulties, this paper proposes a region and edge synergetic level set framework named RESLS. It provides an approach to construct new hybrid level set models using a normalized intensity indicator function that allows the region information easily embedding into the edge-based model. In this case, the energy weights of region and edge terms can be constrained by the global optimization condition deduced from the framework. Some representative as well as state-of-the-art models are taken as examples to demonstrate the generality of our method. The experiments validate that under the guidance of the optimization condition, the weighting parameter of each term can be reliably chosen. Meanwhile, the segmentation accuracy, robustness, and computational efficiency of RESLS can be improved compared with its component models.

[1]  Jian Yang,et al.  A Coastline Detection Method in Polarimetric SAR Images Mixing the Region-Based and Edge-Based Active Contour Models , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Dwarikanath Mahapatra,et al.  Semi-supervised learning and graph cuts for consensus based medical image segmentation , 2016, Pattern Recognit..

[3]  Guosheng Lin,et al.  Exploring Context with Deep Structured Models for Semantic Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Hanqing Lu,et al.  Collaborative Deconvolutional Neural Networks for Joint Depth Estimation and Semantic Segmentation , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Chunming Li,et al.  Implicit Active Contours Driven by Local Binary Fitting Energy , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Junaed Sattar Snakes , Shapes and Gradient Vector Flow , 2022 .

[8]  Ke Chen,et al.  A variational model with hybrid images data fitting energies for segmentation of images with intensity inhomogeneity , 2016, Pattern Recognit..

[9]  King Ngi Ngan,et al.  Hierarchical Parsing Net: Semantic Scene Parsing From Global Scene to Objects , 2018, IEEE Transactions on Multimedia.

[10]  Chang-Tsun Li,et al.  Weighted Level Set Evolution Based on Local Edge Features for Medical Image Segmentation , 2017, IEEE Transactions on Image Processing.

[11]  Truong Q. Nguyen,et al.  Depth-Adaptive Deep Neural Network for Semantic Segmentation , 2017, IEEE Transactions on Multimedia.

[12]  Chunming Li,et al.  Level set evolution without re-initialization: a new variational formulation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Allen R. Tannenbaum,et al.  Localizing Region-Based Active Contours , 2008, IEEE Transactions on Image Processing.

[14]  Wai Lok Woo,et al.  Physics-Based Image Segmentation Using First Order Statistical Properties and Genetic Algorithm for Inductive Thermography Imaging , 2017, IEEE Transactions on Image Processing.

[15]  Bin Wang,et al.  GPU Accelerated Edge-Region Based Level Set Evolution Constrained by 2D Gray-Scale Histogram , 2013, IEEE Transactions on Image Processing.

[16]  Baba C. Vemuri,et al.  Shape Modeling with Front Propagation: A Level Set Approach , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Wei Jia,et al.  LATE: A Level-Set Method Based on Local Approximation of Taylor Expansion for Segmenting Intensity Inhomogeneous Images , 2018, IEEE Transactions on Image Processing.

[18]  Chunxiao Liu,et al.  Weighted variational model for selective image segmentation with application to medical images , 2018, Pattern Recognit..

[19]  Marios Savvides,et al.  Reformulating Level Sets as Deep Recurrent Neural Network Approach to Semantic Segmentation , 2017, IEEE Transactions on Image Processing.

[20]  Lavdie Rada,et al.  Image Segmentation for Intensity Inhomogeneity in Presence of High Noise , 2018, IEEE Transactions on Image Processing.

[21]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[22]  David Zhang,et al.  A Level Set Approach to Image Segmentation With Intensity Inhomogeneity , 2016, IEEE Transactions on Cybernetics.

[23]  Meng Wang,et al.  Hierarchical Scene Parsing by Weakly Supervised Learning with Image Descriptions , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Eduardo Romera,et al.  ERFNet: Efficient Residual Factorized ConvNet for Real-Time Semantic Segmentation , 2018, IEEE Transactions on Intelligent Transportation Systems.

[25]  V. Caselles,et al.  A geometric model for active contours in image processing , 1993 .

[26]  Junwei Han,et al.  Scene parsing using inference Embedded Deep Networks , 2016, Pattern Recognit..

[27]  Yun Tian,et al.  Active contour model combining region and edge information , 2011, Machine Vision and Applications.

[28]  Christopher Joseph Pal,et al.  Learning normalized inputs for iterative estimation in medical image segmentation , 2017, Medical Image Anal..

[29]  Jian Yang,et al.  When Dijkstra Meets Vanishing Point: A Stereo Vision Approach for Road Detection , 2018, IEEE Transactions on Image Processing.

[30]  Qiang Chen,et al.  Robust noise region-based active contour model via local similarity factor for image segmentation , 2017, Pattern Recognit..

[31]  Hassan Khotanlou,et al.  Segmentation of medical images using mean value guided contour , 2017, Medical Image Anal..

[32]  Gang Wang,et al.  Scene Parsing With Integration of Parametric and Non-Parametric Models , 2016, IEEE Transactions on Image Processing.

[33]  Zhifeng Wang,et al.  Active contour model by combining edge and region information discrete dynamic systems , 2017 .

[34]  Pierre Kornprobst,et al.  Mathematical problems in image processing - partial differential equations and the calculus of variations , 2010, Applied mathematical sciences.

[35]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Xavier Bresson,et al.  Fast Global Minimization of the Active Contour/Snake Model , 2007, Journal of Mathematical Imaging and Vision.

[37]  Anthony J. Yezzi,et al.  Active geodesics: Region-based active contour segmentation with a global edge-based constraint , 2011, 2011 International Conference on Computer Vision.

[38]  Domenec Puig,et al.  Active contours driven by difference of Gaussians , 2017, Scientific Reports.

[39]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[40]  Laurent D. Cohen,et al.  Finite-Element Methods for Active Contour Models and Balloons for 2-D and 3-D Images , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Martin Kleinsteuber,et al.  Model-Based Learning of Local Image Features for Unsupervised Texture Segmentation , 2017, IEEE Transactions on Image Processing.

[42]  Chunming Li,et al.  A Level Set Method for Image Segmentation in the Presence of Intensity Inhomogeneities With Application to MRI , 2011, IEEE Transactions on Image Processing.

[43]  Tolga Tasdizen,et al.  Disjunctive Normal Parametric Level Set With Application to Image Segmentation , 2017, IEEE Transactions on Image Processing.

[44]  Xiaoxiao Li,et al.  Deep Learning Markov Random Field for Semantic Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[46]  Lei Wang,et al.  An active contour model based on local fitted images for image segmentation , 2017, Inf. Sci..