Saliency-Driven Active Contour Model for Image Segmentation

Active contour models have achieved prominent success in the area of image segmentation, allowing complex objects to be segmented from the background for further analysis. Existing models can be divided into region-based active contour models and edge-based active contour models. However, both models use direct image data to achieve segmentation and face many challenging problems in terms of the initial contour position, noise sensitivity, local minima and inefficiency owing to the in-homogeneity of image intensities. The saliency map of an image changes the image representation, making it more visual and meaningful. In this study, we propose a novel model that uses the advantages of a saliency map with local image information (LIF) and overcomes the drawbacks of previous models. The proposed model is driven by a saliency map of an image and the local image information to enhance the progress of the active contour models. In this model, the saliency map of an image is first computed to find the saliency driven local fitting energy. Then, the saliency-driven local fitting energy is combined with the LIF model, resulting in a final novel energy functional. This final energy functional is formulated through a level set formulation, and regulation terms are added to evolve the contour more precisely across the object boundaries. The quality of the proposed method was verified on different synthetic images, real images and publicly available datasets, including medical images. The image segmentation results, and quantitative comparisons confirmed the contour initialization independence, noise insensitivity, and superior segmentation accuracy of the proposed model in comparison to the other segmentation models.

[1]  Tao Xie,et al.  Inshore Ship Detection Based on Level Set Method and Visual Saliency for SAR Images , 2018, Sensors.

[2]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[3]  Gueesang Lee,et al.  Fast automatic saliency map driven geometric active contour model for color object segmentation , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[4]  Hamid A. Jalab,et al.  A new deformable model based on fractional Wright energy function for tumor segmentation of volumetric brain MRI scans , 2018, Comput. Methods Programs Biomed..

[5]  Wenbing Tao,et al.  Integration of the saliency-based seed extraction and random walks for image segmentation , 2014, Neurocomputing.

[6]  Wenjian Wang,et al.  Saliency-SVM: An automatic approach for image segmentation , 2014, Neurocomputing.

[7]  Hideyuki Yamamoto,et al.  Tadalafil improves bladder dysfunction and object recognition in rats with pelvic venous congestion , 2019, International journal of urology : official journal of the Japanese Urological Association.

[8]  Jun Liu,et al.  Active Contour Driven by Weighted Hybrid Signed Pressure Force for Image Segmentation , 2019, IEEE Access.

[9]  Rama Sushil,et al.  An Improved PSO-Based Multilevel Image Segmentation Technique Using Minimum Cross-Entropy Thresholding , 2018, Arabian Journal for Science and Engineering.

[10]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[11]  Stefan Hildebrandt,et al.  Partial Differential Equations and Calculus of Variations , 1989 .

[12]  Yong Wang,et al.  Active Contours Driven by Local and Global Region-Based Information for Image Segmentation , 2020, IEEE Access.

[13]  Rachid Deriche,et al.  Geodesic Active Contours and Level Sets for the Detection and Tracking of Moving Objects , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[15]  Lei Wang,et al.  Active contours driven by edge entropy fitting energy for image segmentation , 2018, Signal Process..

[16]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[17]  Weibin Liu,et al.  An improved edge-based level set method combining local regional fitting information for noisy image segmentation , 2017, Signal Process..

[18]  R. S. Anand,et al.  A hybrid edge-based segmentation approach for ultrasound medical images , 2017, Biomed. Signal Process. Control..

[19]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Haixia Xu,et al.  Local region-based level set approach for fast synthetic aperture radar image segmentation , 2018 .

[21]  Chunming Li,et al.  Level set evolution without re-initialization: a new variational formulation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[22]  Pedro M. Ferreira,et al.  PH2 - A dermoscopic image database for research and benchmarking , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[23]  Chunming Li,et al.  Minimization of Region-Scalable Fitting Energy for Image Segmentation , 2008, IEEE Transactions on Image Processing.

[24]  Asad Munir,et al.  Hybrid Active Contour Based on Local and Global Statistics Parameterized by Weight Coefficients for Inhomogeneous Image Segmentation , 2020, IEEE Access.

[25]  Hesheng Liu,et al.  Fuzzy Region-Based Active Contours Driven by Weighting Global and Local Fitting Energy , 2019, IEEE Access.

[26]  Zhong Yang,et al.  A New Iterative Triclass Thresholding Technique in Image Segmentation , 2014, IEEE Transactions on Image Processing.

[27]  Sabine Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  DingKeyan,et al.  Active contours driven by region-scalable fitting and optimized Laplacian of Gaussian energy for image segmentation , 2017 .

[29]  Hong-Bin Shen,et al.  Saliency driven region-edge-based top down level set evolution reveals the asynchronous focus in image segmentation , 2018, Pattern Recognit..

[30]  Zhuowen Tu,et al.  Deeply Supervised Salient Object Detection with Short Connections , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  N. Nakamichi,et al.  Hydrolyzed Salmon Milt Extract Enhances Object Recognition and Location Memory Through an Increase in Hippocampal Cytidine Nucleoside Levels in Normal Mice. , 2019, Journal of medicinal food.

[32]  Wei Liu,et al.  Saliency propagation from simple to difficult , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Jon Atli Benediktsson,et al.  Multilevel Image Segmentation Based on Fractional-Order Darwinian Particle Swarm Optimization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Weibin Liu,et al.  A weighted edge-based level set method based on multi-local statistical information for noisy image segmentation , 2019, J. Vis. Commun. Image Represent..

[35]  Sebastian Nowozin,et al.  Higher-Order Correlation Clustering for Image Segmentation , 2011, NIPS.

[36]  Shu-Guang Zhao,et al.  Cervical image classification based on image segmentation preprocessing and a CapsNet network model , 2018, Int. J. Imaging Syst. Technol..

[37]  Khaled Jelassi,et al.  Intelligent Selective Compliance Articulated Robot Arm robot with object recognition in a multi-agent manufacturing system , 2019, International Journal of Advanced Robotic Systems.

[38]  Ben Glocker,et al.  Automated quality control in image segmentation: application to the UK Biobank cardiovascular magnetic resonance imaging study , 2019, Journal of Cardiovascular Magnetic Resonance.

[39]  Jing Li,et al.  An adaptive-scale active contour model for inhomogeneous image segmentation and bias field estimation , 2018, Pattern Recognit..

[40]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[41]  Chunming Li,et al.  Implicit Active Contours Driven by Local Binary Fitting Energy , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Lei Zhang,et al.  Active contours driven by local image fitting energy , 2010, Pattern Recognit..

[43]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[44]  Mita Nasipuri,et al.  Suspicious-Region Segmentation From Breast Thermogram Using DLPE-Based Level Set Method , 2019, IEEE Transactions on Medical Imaging.

[45]  Fang Yuan,et al.  Active Contours Driven by Visual Saliency Fitting Energy for Image Segmentation in SAR Images , 2019, 2019 IEEE 4th International Conference on Cloud Computing and Big Data Analysis (ICCCBDA).