Saliency-guided level set model for automatic object segmentation

Abstract The level set model is a popular method for object segmentation. However, most existing level set models perform poorly in color images since they only use grayscale intensity information to defined their energy functions. To address this shortcoming, in this paper, we propose a new saliency-guided level set model (SLSM), which can automatically segment objects in color images guided by visual saliency. Specifically, we first define a global saliency-guided energy term to extract the color objects approximately. Then, by integrating information from different color channels, we define a novel local multichannel based energy term to extract the color objects in detail. In addition, unlike using a length regularization term in the conventional level set models, we achieve segmentation smoothness by incorporating our SLSM into a graph cuts formulation. More importantly, the proposed SLSM is automatically initialized by saliency detection. Finally, the evaluation on public benchmark databases and our collected database demonstrates that the new SLSM consistently outperforms many state-of-the-art level set models and saliency detecting methods in accuracy and robustness.

[1]  Junwei Han,et al.  DHSNet: Deep Hierarchical Saliency Network for Salient Object Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Huchuan Lu,et al.  Deep networks for saliency detection via local estimation and global search , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Jing-Yu Yang,et al.  Exploiting Intensity Inhomogeneity to Extract Textured Objects from Natural Scenes , 2009, ACCV.

[4]  Yizhou Yu,et al.  Deep Contrast Learning for Salient Object Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Jian Sun,et al.  Saliency Optimization from Robust Background Detection , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[7]  Chunming Li,et al.  Implicit Active Contours Driven by Local Binary Fitting Energy , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Huchuan Lu,et al.  Saliency Detection via Graph-Based Manifold Ranking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[10]  Yiquan Wu,et al.  Active contours driven by global and local weighted signed pressure force for image segmentation , 2019, Pattern Recognit..

[11]  Lei Wang,et al.  An active contour model based on local fitted images for image segmentation , 2017, Inf. Sci..

[12]  Huchuan Lu,et al.  Learning Uncertain Convolutional Features for Accurate Saliency Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[13]  Yizhou Yu,et al.  Visual saliency based on multiscale deep features , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Xiaofeng Wang,et al.  An efficient local Chan-Vese model for image segmentation , 2010, Pattern Recognit..

[15]  Jian Yang,et al.  Inhomogeneity-embedded active contour for natural image segmentation , 2015, Pattern Recognit..

[16]  Qi Tian,et al.  Improving context-sensitive similarity via smooth neighborhood for object retrieval , 2018, Pattern Recognit..

[17]  Jing Li,et al.  An adaptive-scale active contour model for inhomogeneous image segmentation and bias field estimation , 2018, Pattern Recognit..

[18]  R. Venkatesh Babu,et al.  Salient object detection via objectness measure , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[19]  David Zhang,et al.  A Level Set Approach to Image Segmentation With Intensity Inhomogeneity , 2016, IEEE Transactions on Cybernetics.

[20]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[21]  Li Xu,et al.  Hierarchical Saliency Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Annupan Rodtook,et al.  Automatic initialization of active contours and level set method in ultrasound images of breast abnormalities , 2018, Pattern Recognit..

[23]  Lei Wang,et al.  Simultaneous segmentation and bias field estimation using local fitted images , 2018, Pattern Recognit..

[24]  Zhi Xu,et al.  A two-stage image segmentation via global and local region active contours , 2016, Neurocomputing.

[25]  Jian Sun,et al.  Geodesic Saliency Using Background Priors , 2012, ECCV.

[26]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[27]  Minglun Gong,et al.  Unsupervised hierarchical image segmentation through fuzzy entropy maximization , 2017, Pattern Recognit..

[28]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[31]  Hong-Bin Shen,et al.  Saliency driven region-edge-based top down level set evolution reveals the asynchronous focus in image segmentation , 2018, Pattern Recognit..

[32]  Jing Li,et al.  Local and Global Active Contour Model for Image Segmentation With Intensity Inhomogeneity , 2018, IEEE Access.

[33]  Minglun Gong,et al.  Integrated Foreground Segmentation and Boundary Matting for Live Videos , 2015, IEEE Transactions on Image Processing.

[34]  Gang Wang,et al.  Deep Level Sets for Salient Object Detection , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Yihong Gong,et al.  Correntropy-based level set method for medical image segmentation and bias correction , 2017, Neurocomputing.

[37]  Yihong Gong,et al.  Active contour model based on local and global intensity information for medical image segmentation , 2016, Neurocomputing.

[38]  Chunming Li,et al.  Level set evolution without re-initialization: a new variational formulation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[39]  Philip H. S. Torr,et al.  BING: Binarized normed gradients for objectness estimation at 300fps , 2014, Computational Visual Media.

[40]  Massimo Gobbino Finite Difference Approximation of the Mumford-Shah Functional , 1998 .