Saliency detection based on seed propagation in a multilayer graph

This paper presents a saliency detection algorithm based on the seed propagation in graph representation of image. First, the image is divided into over-segmented regions and a graph of the connected regions (nodes) with color similarity (edge weight) is constructed. Second, saliency seeds and background seeds are extracted based on contrast and boundary prior respectively. The contrast prior is used to select the regions to be used as saliency seeds, because salient regions usually have high contrast. Meanwhile, the regions for the background seeds are extracted from image boundaries, based on the observation that salient objects are seldom located on the image boundaries. Finally, using a semi-supervised learning framework, both saliency and background seeds are propagated to the entire nodes and the saliency of each node is calculated from the propagated results. In addition, we introduce a multilayer graph to further improve the performance, which makes the saliency values within an object more uniform. Comparison with the state-of-the-art methods shows that our algorithm yields comparable or better results on several datasets in terms of precision-recall curve, ROC curve, F-measure and area under ROC curve, and also show visually plausible results.

[1]  Nuno Vasconcelos,et al.  Learning Optimal Seeds for Diffusion-Based Salient Object Detection , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Chang-Su Kim,et al.  Multiscale Saliency Detection Using Random Walk With Restart , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Huchuan Lu,et al.  Saliency Detection via Graph-Based Manifold Ranking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Li Xu,et al.  Hierarchical Saliency Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Yong Zhao,et al.  Local stereo matching with canny segmentation and reliable seed propagation , 2012, 2012 International Conference on Computer Vision in Remote Sensing.

[7]  Shi-Min Hu,et al.  SalientShape: group saliency in image collections , 2013, The Visual Computer.

[8]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[9]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[10]  Deepu Rajan,et al.  Random Walks on Graphs for Salient Object Detection in Images , 2010, IEEE Transactions on Image Processing.

[11]  Liming Zhang,et al.  Spatio-temporal Saliency detection using phase spectrum of quaternion fourier transform , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Vibhav Vineet,et al.  Efficient Salient Region Detection with Soft Image Abstraction , 2013, 2013 IEEE International Conference on Computer Vision.

[13]  Ariel Shamir,et al.  Seam Carving for Content-Aware Image Resizing , 2007, ACM Trans. Graph..

[14]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[15]  Sang Uk Lee,et al.  Learning full pairwise affinities for spectral segmentation , 2010, CVPR.

[16]  Jian Sun,et al.  Geodesic Saliency Using Background Priors , 2012, ECCV.

[17]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[18]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[20]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Ali Borji,et al.  Salient Object Detection: A Benchmark , 2015, IEEE Transactions on Image Processing.

[22]  Hsiao-Hwa Chen,et al.  Energy-Spectrum Efficiency Tradeoff for Video Streaming over Mobile Ad Hoc Networks , 2013, IEEE Journal on Selected Areas in Communications.

[23]  Huchuan Lu,et al.  Graph-Regularized Saliency Detection With Convex-Hull-Based Center Prior , 2013, IEEE Signal Processing Letters.

[24]  Huchuan Lu,et al.  Saliency Detection via Absorbing Markov Chain , 2013, 2013 IEEE International Conference on Computer Vision.

[25]  Sabine Süsstrunk,et al.  Salient Region Detection and Segmentation , 2008, ICVS.

[26]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[27]  Luc Van Gool,et al.  Visibility Maps for Improving Seam Carving , 2010, ECCV Workshops.

[28]  Kiriakos N. Kutulakos Trends and Topics in Computer Vision , 2010, Lecture Notes in Computer Science.

[29]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .