Hybrid of extended locality-constrained linear coding and manifold ranking for salient object detection

Abstract Recent years have witnessed great progress of salient object detection methods. However, due to the emerging complex scenes, two problems should be solved urgently: one is on the fast locating of the foreground while preserving the precision, and the other is about reducing the noise near the foreground boundary in saliency maps. In this paper, a hybrid method is proposed to ameliorate the above two issues. At first, to reduce the essential runtime of integrating the prior knowledge, a novel Prior Knowledge Learning based Region Classification (PKL-RC) method is proposed for classifying image regions and preliminarily locating foreground; furthermore, to generate more accurate saliency, a Locality-constrained Linear self-Coding based Region Clustering (LLsC-RC) model is proposed to improve the adjacency structure of the similarity graph for Manifold Ranking (MR). Experimental results demonstrate the effectiveness and superiority of the proposed method in both higher precision and better smoothness.

[1]  Ali Borji,et al.  What is a Salient Object? A Dataset and a Baseline Model for Salient Object Detection , 2014, IEEE Transactions on Image Processing.

[2]  Chun Chen,et al.  Low-level and high-level prior learning for visual saliency estimation , 2014, Inf. Sci..

[3]  King Ngi Ngan,et al.  Unsupervised Salient Object Segmentation Based on Kernel Density Estimation and Two-Phase Graph Cut , 2012, IEEE Transactions on Multimedia.

[4]  Tsuyoshi Ando,et al.  Majorization relations for Hadamard products , 1995 .

[5]  Huchuan Lu,et al.  Graph-Regularized Saliency Detection With Convex-Hull-Based Center Prior , 2013, IEEE Signal Processing Letters.

[6]  Jie Liu,et al.  Salient region detection via simple local and global contrast representation , 2015, Neurocomputing.

[7]  Chun Qi,et al.  Two-stage salient region detection by exploiting multiple priors , 2014, J. Vis. Commun. Image Represent..

[8]  Chunlei Yang,et al.  Extended Locality-Constrained Linear Self-Coding for Saliency Detection , 2017, IEEE Signal Processing Letters.

[9]  Liaoyuan Zeng,et al.  An effective vector model for global-contrast-based saliency detection , 2015, J. Vis. Commun. Image Represent..

[10]  Lihi Zelnik-Manor,et al.  Saliency for image manipulation , 2013, The Visual Computer.

[11]  Huchuan Lu,et al.  Saliency Detection with Multi-Scale Superpixels , 2014, IEEE Signal Processing Letters.

[12]  Zonghai Chen,et al.  Predicting salient object via multi-level features , 2016, Neurocomputing.

[13]  Min Xu,et al.  Saliency detection with color contrast based on boundary information and neighbors , 2014, The Visual Computer.

[14]  Gangyi Jiang,et al.  A depth perception and visual comfort guided computational model for stereoscopic 3D visual saliency , 2015, Signal Process. Image Commun..

[15]  Ronen Basri,et al.  Image Segmentation by Probabilistic Bottom-Up Aggregation and Cue Integration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Ying Yu,et al.  An approach for visual attention based on biquaternion and its application for ship detection in multispectral imagery , 2012, Neurocomputing.

[17]  Chunlei Yang,et al.  Salient object detection in complex scenes via D-S evidence theory based region classification , 2017, The Visual Computer.

[18]  Bing Li,et al.  Salient Object Detection via Structured Matrix Decomposition. , 2016, IEEE transactions on pattern analysis and machine intelligence.

[19]  Huchuan Lu,et al.  Salient object detection via global and local cues , 2015, Pattern Recognit..

[20]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[21]  Rui Zhang,et al.  Top-Down Saliency Detection via Contextual Pooling , 2014, J. Signal Process. Syst..

[22]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[23]  Lihi Zelnik-Manor,et al.  Context-Aware Saliency Detection , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Adrian G. Bors,et al.  Image retrieval based on query by saliency content , 2015, Digit. Signal Process..

[25]  Chun Qi,et al.  Salient region detection through sparse reconstruction and graph-based ranking , 2015, J. Vis. Commun. Image Represent..

[26]  Shi-Min Hu,et al.  SalientShape: group saliency in image collections , 2013, The Visual Computer.

[27]  Xiangping Sun,et al.  Saliency detection using hierarchical manifold learning , 2015, Neurocomputing.

[28]  Li Xu,et al.  Hierarchical Image Saliency Detection on Extended CSSD , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.