Saliency modeling via outlier detection

Abstract. Based on the fact that human attention is more likely to be attracted by different objects or statistical outliers of a scene, a bottom-up saliency detection model is proposed. Our model regards the saliency patterns of an image as the outliers in a dataset. For an input image, first, each image element is described as a feature vector. The whole image is considered as a dataset and an image element is classified as a saliency pattern if its corresponding feature vector is an outlier among the dataset. Then, a binary label map can be built to indicate the salient and the nonsalient elements in the image. According to the Boolean map theory, we compute multiple binary maps as a set of Boolean maps which indicate the outliers in multilevels. Finally, we linearly fused them into the final saliency map. This saliency model is used to predict the human eye fixation, and has been tested on the most widely used three benchmark datasets and compared with eight state-of-the-art saliency models. In our experiments, we adopt the shuffled the area under curve metric to evaluate the accuracy of our model. The experimental results show that our model outperforms the state-of-the-art models on all three datasets.

[1]  John K. Tsotsos,et al.  Saliency Based on Information Maximization , 2005, NIPS.

[2]  Liming Zhang,et al.  A Novel Multiresolution Spatiotemporal Saliency Detection Model and Its Applications in Image and Video Compression , 2010, IEEE Transactions on Image Processing.

[3]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[4]  Douglas M. Hawkins Identification of Outliers , 1980, Monographs on Applied Probability and Statistics.

[5]  Raymond T. Ng,et al.  Distance-based outliers: algorithms and applications , 2000, The VLDB Journal.

[6]  Ali Borji,et al.  State-of-the-Art in Visual Attention Modeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Ali Borji,et al.  Exploiting local and global patch rarities for saliency detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Martin D. Levine,et al.  Visual Saliency Based on Scale-Space Analysis in the Frequency Domain , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[11]  Gert Kootstra,et al.  Predicting Eye Fixations on Complex Visual Stimuli Using Local Symmetry , 2011, Cognitive Computation.

[12]  J. Wolfe,et al.  What attributes guide the deployment of visual attention and how do they do it? , 2004, Nature Reviews Neuroscience.

[13]  Frédo Durand,et al.  Learning to predict where humans look , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[14]  Stan Sclaroff,et al.  Saliency Detection: A Boolean Map Approach , 2013, 2013 IEEE International Conference on Computer Vision.

[15]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[16]  Harold Pashler,et al.  A Boolean map theory of visual attention. , 2007, Psychological review.

[17]  Antón García-Díaz,et al.  Saliency from hierarchical adaptation through decorrelation and variance normalization , 2012, Image Vis. Comput..

[18]  Shijian Lu,et al.  Robust and Efficient Saliency Modeling from Image Co-Occurrence Histograms , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Peng Jiang,et al.  Salient Region Detection by UFO: Uniqueness, Focusness and Objectness , 2013, 2013 IEEE International Conference on Computer Vision.