Saliency detection using multiple region-based features

This paper proposes a novel saliency model using multiple region-based features. The original image is initially segmented into a set of regions using the mean shift algorithm, and region merging is performed to obtain a moderate segmentation result. Then, three types of regional saliency measures are calculated using region-based features including local/global color difference, orientation difference, and spatial distribution, and they are integrated into an overall regional saliency measure for each region. Finally, the pixel-wise saliency map is generated by combining regional saliency measures with the distance-weighted color similarity between each pixel and each region. Experimental results demonstrate that our saliency model achieves an overall better saliency detection performance than previous saliency models, and the saliency maps generated using our model are more suitable for content-based applications such as salient object detection, content-aware image retargeting, and object-based image retrieval.

[1]  John K. Tsotsos,et al.  Saliency Based on Information Maximization , 2005, NIPS.

[2]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[3]  Zheru Chi,et al.  Attention-driven image interpretation with application to image retrieval , 2006, Pattern Recognit..

[4]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Matt P. Wand,et al.  On the Accuracy of Binned Kernel Density Estimators , 1994 .

[6]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Liming Zhang,et al.  A Novel Multiresolution Spatiotemporal Saliency Detection Model and Its Applications in Image and Video Compression , 2010, IEEE Transactions on Image Processing.

[8]  King Ngi Ngan,et al.  Adaptive image retargeting using saliency-based continuous seam carving , 2010 .

[9]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[10]  King Ngi Ngan,et al.  Unsupervised extraction of visual attention objects in color images , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Peyman Milanfar,et al.  Nonparametric bottom-up saliency detection by self-resemblance , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[12]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[13]  Nuno Vasconcelos,et al.  Bottom-up saliency is a discriminant process , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[14]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[15]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[16]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[18]  Lihi Zelnik-Manor,et al.  Context-aware saliency detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Michael Gleicher,et al.  Region Enhanced Scale-Invariant Saliency Detection , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[20]  T. Poggio,et al.  Predicting the visual world: silence is golden , 1999, Nature Neuroscience.

[21]  Nanning Zheng,et al.  Learning to Detect A Salient Object , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Zhi Liu,et al.  Nonparametric saliency detection using kernel density estimation , 2010, 2010 IEEE International Conference on Image Processing.

[23]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[24]  Byoung Chul Ko,et al.  Object-of-interest image segmentation based on human attention and semantic region clustering. , 2006, Journal of the Optical Society of America. A, Optics, image science, and vision.