Salient region detection for complex background images using integrated features

We develop a novel algorithm for detecting salient regions. By analyzing the advantages and disadvantages of existing methods, five principles for designing salient region detection algorithms are summarized. Based on these principles, we propose a novel method that generates saliency map with highlighted salient regions by utilizing two different features, namely visual saliency value and spatial weight. The visual saliency value is determined based on local contrast differences and low-level feature frequencies. The spatial weight is computed by analyzing the size and locations of salient regions. Extensive experiments on benchmark image dataset demonstrate that the proposed algorithm outperforms seven state-of-the-art methods on complex background images.

[1]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[2]  Lifeng Sun,et al.  A Matrix-Based Approach to Unsupervised Human Action Categorization , 2012, IEEE Transactions on Multimedia.

[3]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Meng Wang,et al.  Video accessibility enhancement for hearing-impaired users , 2011, TOMCCAP.

[5]  Liming Zhang,et al.  Spatio-temporal Saliency detection using phase spectrum of quaternion fourier transform , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Meng Wang,et al.  Movie2Comics: Towards a Lively Video Content Presentation , 2012, IEEE Transactions on Multimedia.

[7]  Vipin Tyagi,et al.  Content based image retrieval based on relative locations of multiple regions of interest using selective regions matching , 2014, Inf. Sci..

[8]  Paul F. M. J. Verschure,et al.  PASAR: An integrated model of prediction, anticipation, sensation, attention and response for artificial sensorimotor systems , 2012, Inf. Sci..

[9]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Witold Pedrycz,et al.  Genetic interval neural networks for granular data regression , 2014, Inf. Sci..

[11]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[12]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[13]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[14]  Witold Pedrycz,et al.  Fuzzy logic-based generalized decision theory with imperfect information , 2012, Inf. Sci..

[15]  Sabine Süsstrunk,et al.  Salient Region Detection and Segmentation , 2008, ICVS.

[16]  Wen Gao,et al.  Measuring visual saliency by Site Entropy Rate , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Ming Xu,et al.  A biologically inspired computational model for image saliency detection , 2011, MM '11.

[18]  Liqing Zhang,et al.  Dynamic visual attention: searching for coding length increments , 2008, NIPS.

[19]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Mubarak Shah,et al.  Visual attention detection in video sequences using spatiotemporal cues , 2006, MM '06.

[21]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[22]  Liang-Tien Chia,et al.  Improved saliency detection based on superpixel clustering and saliency propagation , 2010, ACM Multimedia.

[23]  Tiejun Huang,et al.  Automatic interesting object extraction from images using complementary saliency maps , 2010, ACM Multimedia.

[24]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[25]  John K. Tsotsos,et al.  Saliency Based on Information Maximization , 2005, NIPS.

[26]  Chun Chen,et al.  Low-level and high-level prior learning for visual saliency estimation , 2014, Inf. Sci..

[27]  Lihi Zelnik-Manor,et al.  Context-Aware Saliency Detection , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Peyman Milanfar,et al.  Nonparametric bottom-up saliency detection by self-resemblance , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.