Combined saliency enhancement based on fully convolutional network

We propose a combined saliency enhancement architecture by combining two traditional saliency enhancement strategies: saliency aggregation and saliency optimization. Previous methods have presented many remarkable saliency maps. Saliency aggregation fuses these results to highlight the salient objects and suppress the background. Saliency optimization optimizes the rough computational saliency maps by local and global context in the original image. We first illustrate the principle of saliency aggregation and optimization, and how to implement these two strategies using fully convolutional network. And then, we propose a network based on FCN to combine these two strategies. We use FCN to iteratively combine the results of the two strategies. Our method is evaluated on five representative datasets. Experimental results indicate that our architecture outperforms the state-of-the-art methods.

[1]  Jing Xiao,et al.  Importance filtering for image retargeting , 2011, CVPR 2011.

[2]  Laurent Itti,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Rapid Biologically-inspired Scene Classification Using Features Shared with Visual Attention , 2022 .

[3]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[4]  Jian Sun,et al.  Geodesic Saliency Using Background Priors , 2012, ECCV.

[5]  James M. Rehg,et al.  The Secrets of Salient Object Segmentation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Huchuan Lu,et al.  Saliency Detection via Graph-Based Manifold Ranking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Li Xu,et al.  Hierarchical Saliency Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Gabriela Csurka,et al.  A framework for visual saliency detection with applications to image thumbnailing , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[9]  Pierre Baldi,et al.  Bayesian surprise attracts human attention , 2005, Vision Research.

[10]  Ronen Basri,et al.  Image Segmentation by Probabilistic Bottom-Up Aggregation and Cue Integration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Lihi Zelnik-Manor,et al.  Context-Aware Saliency Detection , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[13]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[14]  Ronen Basri,et al.  Image Segmentation by Probabilistic Bottom-Up Aggregation and Cue Integration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Jian Sun,et al.  Saliency Optimization from Robust Background Detection , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Yuzhen Niu,et al.  Saliency Aggregation: A Data-Driven Approach , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[18]  Huchuan Lu,et al.  Saliency detection via Cellular Automata , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[20]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..