Saliency detection framework via linear neighbourhood propagation

In this study, a novel saliency detection algorithm based on linear neighbourhood propagation is proposed. The proposed algorithm is divided into three steps. First, the authors segment an input image into superpixels which are represented as the nodes in a graph. The weight matrix of the graph, which indicates the similarities between the nodes, is calculated by linear neighbourhood reconstruction. Second, the nodes, which are located at top, bottom, left and right of image boundary, are labelled as boundary priors. Then, based on weight matrix, label propagation is used to propagate the labels to unlabelled nodes. They rank the nodes according to the label information and select the nodes with minor information as saliency priors. Last, based on saliency priors, saliency detection is carried out by label propagation again. The nodes with more information are considered as saliency regions. Experimental results on three benchmark databases demonstrate the proposed method performs well when it is against the state-of-the-art methods in terms of accuracy and robustness.

[1]  Weisi Lin,et al.  Modeling visual attention's modulatory aftereffects on visual sensitivity and quality evaluation , 2005, IEEE Transactions on Image Processing.

[2]  David Salesin,et al.  Gaze-based interaction for semi-automatic photo cropping , 2006, CHI.

[3]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Lihi Zelnik-Manor,et al.  Context-Aware Saliency Detection , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Jing-Yu Yang,et al.  Multiscale saliency detection using principle component analysis , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[6]  Deepu Rajan,et al.  Random Walks on Graphs for Salient Object Detection in Images , 2010, IEEE Transactions on Image Processing.

[7]  Huchuan Lu,et al.  Saliency Detection via Graph-Based Manifold Ranking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Qingfu Zhang,et al.  Improving geodesic distance estimation based on locally linear assumption , 2008, Pattern Recognit. Lett..

[9]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[10]  Sabine Süsstrunk,et al.  Salient Region Detection and Segmentation , 2008, ICVS.

[11]  Huchuan Lu,et al.  Bayesian Saliency via Low and mid Level Cues , 2022 .

[12]  Matthew H Tong,et al.  SUN: Top-down saliency using natural statistics , 2009, Visual cognition.

[13]  Jian Sun,et al.  Geodesic Saliency Using Background Priors , 2012, ECCV.

[14]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[15]  Xing Xie,et al.  A visual attention model for adapting images on small displays , 2003, Multimedia Systems.

[16]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[17]  Mubarak Shah,et al.  Visual attention detection in video sequences using spatiotemporal cues , 2006, MM '06.

[18]  Helen C. Shen,et al.  Linear Neighborhood Propagation and Its Applications , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[22]  Zhong Jin,et al.  A New Framework for Multiscale Saliency Detection Based on Image Patches , 2012, Neural Processing Letters.

[23]  Liming Zhang,et al.  A Novel Multiresolution Spatiotemporal Saliency Detection Model and Its Applications in Image and Video Compression , 2010, IEEE Transactions on Image Processing.

[24]  C. Koch,et al.  Models of bottom-up and top-down visual attention , 2000 .

[25]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Pietro Perona,et al.  Is bottom-up attention useful for object recognition? , 2004, CVPR 2004.

[27]  Ali Borji,et al.  Salient Object Detection: A Benchmark , 2012, ECCV.

[28]  S. Süsstrunk,et al.  SLIC Superpixels ? , 2010 .

[29]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Ying Wu,et al.  A unified approach to salient object detection via low rank matrix recovery , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[32]  Yao Lu,et al.  Salient Object Detection using concavity context , 2011, 2011 International Conference on Computer Vision.

[33]  Laurent Itti,et al.  An Integrated Model of Top-Down and Bottom-Up Attention for Optimizing Detection Speed , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[34]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[35]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Christof Koch,et al.  Image Signature: Highlighting Sparse Salient Regions , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Nanning Zheng,et al.  Automatic salient object extraction with contextual cue , 2011, 2011 International Conference on Computer Vision.

[39]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[40]  Fei Wang,et al.  Label Propagation through Linear Neighborhoods , 2008, IEEE Trans. Knowl. Data Eng..