Combining external prior and internal features: toward a robust foreground seed selection method

Abstract. Graph-based salient object detection has been widely applied in many applications, because of its excellent performance and strong theoretical basis. Basically, the performance of this type of methods depends on the correctness in foreground seed selection. In research aiming to exactly identify the seeds on foreground objects, an external prior has been defined in recent work as having an image boundary that is mostly background (called boundary prior), so the foreground seeds must locate around the image center. However, this is not the case when salient objects are spatially close to the image boundary. This problem will cause a severe error in salient object detection, because background noises are likely mixed in foreground seeds. To solve this problem, we propose a robust foreground seed selection method for salient object detection. In our method, the external prior and multiple internal image features are combined for foreground seed selection. Our method can relax the limitation of the external prior and make the foreground seed selection more adaptive and robust to diverse samples. As a result, the proposed method can generate satisfying results, no matter where the salient object is located. This advantage is demonstrated by experimental comparisons with several state-of-art methods.

[1]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[2]  Huchuan Lu,et al.  Pattern Mining Saliency , 2016, ECCV.

[3]  Bart De Moor,et al.  Cellular automata models of road traffic , 2005, physics/0509082.

[4]  Xiaogang Wang,et al.  Saliency detection by multi-context deep learning , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Xiaofeng Zhu,et al.  Dynamic graph learning for spectral feature selection , 2018, Multimedia Tools and Applications.

[6]  Minghui Wang,et al.  RGB-D Salient Object Detection via Minimum Barrier Distance Transform and Saliency Fusion , 2017, IEEE Signal Processing Letters.

[7]  Huchuan Lu,et al.  Saliency Detection via Dense and Sparse Reconstruction , 2013, 2013 IEEE International Conference on Computer Vision.

[8]  Huchuan Lu,et al.  Saliency Detection via Graph-Based Manifold Ranking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Yi Liu,et al.  Video Object Extraction Based on Spatiotemporal Consistency Saliency Detection , 2018, IEEE Access.

[11]  Xu Yang,et al.  A novel approach for visual Saliency detection and segmentation based on objectness and top-down attention , 2017 .

[12]  Rynson W. H. Lau,et al.  SuperCNN: A Superpixelwise Convolutional Neural Network for Salient Object Detection , 2015, International Journal of Computer Vision.

[13]  Martin D. Levine,et al.  Visual Saliency Based on Scale-Space Analysis in the Frequency Domain , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Ronen Basri,et al.  Image Segmentation by Probabilistic Bottom-Up Aggregation and Cue Integration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Dewen Hu,et al.  Salient Region Detection via Integrating Diffusion-Based Compactness and Local Contrast , 2015, IEEE Transactions on Image Processing.

[17]  Lizhong Xu,et al.  Color–depth multi-task learning for object detection in haze , 2018, Neural Computing and Applications.

[18]  Li Xu,et al.  Hierarchical Saliency Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Shang-Hong Lai,et al.  Fusing generic objectness and visual saliency for salient object detection , 2011, 2011 International Conference on Computer Vision.

[20]  Huchuan Lu,et al.  Saliency detection via background and foreground seed selection , 2015, Neurocomputing.

[21]  Ali Borji,et al.  Salient Object Detection: A Benchmark , 2015, IEEE Transactions on Image Processing.

[22]  Xiaofeng Zhu,et al.  Local and Global Structure Preservation for Robust Unsupervised Spectral Feature Selection , 2018, IEEE Transactions on Knowledge and Data Engineering.

[23]  David Dagan Feng,et al.  Robust saliency detection via regularized random walks ranking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Jian Sun,et al.  Geodesic Saliency Using Background Priors , 2012, ECCV.

[25]  Xin Wang,et al.  Motion saliency detection using a temporal fourier transform , 2016 .

[26]  Bart De Moor,et al.  Cellular Automata Models of Road Traffic Preprint Submitted to Physics Reports , 2005 .

[27]  Stella X. Yu,et al.  Image Compression Based on Visual Saliency at Individual Scales , 2009, ISVC.

[28]  Wenbing Tao,et al.  Integration of the saliency-based seed extraction and random walks for image segmentation , 2014, Neurocomputing.

[29]  Jun Wang,et al.  Salient region detection via color spatial distribution determined global contrasts , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[30]  Huchuan Lu,et al.  Saliency Detection via Absorbing Markov Chain , 2013, 2013 IEEE International Conference on Computer Vision.

[31]  Yizhou Yu,et al.  Visual saliency based on multiscale deep features , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Huchuan Lu,et al.  Saliency Region Detection Based on Markov Absorption Probabilities , 2015, IEEE Transactions on Image Processing.

[33]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[34]  Tim K Marks,et al.  SUN: A Bayesian framework for saliency using natural statistics. , 2008, Journal of vision.

[35]  Jun Li,et al.  A novel approach for visual Saliency detection and segmentation based on objectness and top-down attention , 2017, 2017 2nd International Conference on Image, Vision and Computing (ICIVC).

[36]  Lihi Zelnik-Manor,et al.  What Makes a Patch Distinct? , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Laurent Itti,et al.  Automatic foveation for video compression using a neurobiological model of visual attention , 2004, IEEE Transactions on Image Processing.