Influence of Spatial Resolution on State-of-the-Art Saliency Models

Visual attention has been widely investigated and applied in recent decades. Various computation models have been proposed to modeling visual attention, but most researches are conducted under the assumption that given images have few limited spatial resolutions. Spatial resolution is an important feature of image. Image resolution may have some influence on visual attention, and it may also affect the effectiveness of visual attention models. The influence of spatial resolution on saliency models has not been systematically investigated before. In this paper, we discuss two problems related to image resolution and saliency: 1 Most saliency models contain down-sampling function which changes the resolution of original images to lower the computational complexity and keep the formalization of the algorithm. In the first part, we discuss the influence of the down-sampling ratio on the effectiveness of classic saliency models. 2 In the second part, we investigate the effectiveness of saliency models in images of various resolutions. A dataset which provides images and corresponding eye movement data in various spatial resolutions is used in this part. We apply the default rescaling parameters and keep them unchanged. Then we analyze the performance of classic models on 8 resolution levels. In summary, we systematically investigate and analyze problems concerning spatial resolution in the research of saliency modeling. The results of this work can provide a guide to the use of classic models in images of different resolutions and they are helpful to computational complexity optimization.

[1]  Naila Murray,et al.  Saliency estimation using a non-parametric low-level vision model , 2011, CVPR 2011.

[2]  Aykut Erdem,et al.  Visual saliency estimation by nonlinearly integrating features using region covariances. , 2013, Journal of vision.

[3]  Ali Borji,et al.  State-of-the-Art in Visual Attention Modeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Christof Koch,et al.  Image Signature: Highlighting Sparse Salient Regions , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Dominique Lamy,et al.  Visual consciousness and intertrial feature priming. , 2013, Journal of vision.

[6]  Sabine Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Frédo Durand,et al.  Learning to predict where humans look , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[8]  A. Torralba,et al.  Fixations on low-resolution images. , 2010, Journal of vision.

[9]  T.,et al.  Shiftable Multi-scale TransformsEero , 1992 .

[10]  John K. Tsotsos,et al.  Saliency Based on Information Maximization , 2005, NIPS.

[11]  Nicolas Riche,et al.  RARE2012: A multi-scale rarity-based saliency detection with its comparative statistical analysis , 2013, Signal Process. Image Commun..

[12]  Wei-Ta Chu,et al.  Size does matter: how image size affects aesthetic perception? , 2013, MM '13.

[13]  Víctor Leborán,et al.  On the relationship between optical variability, visual saliency, and eye fixations: a computational approach. , 2012, Journal of vision.

[14]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[15]  Lihi Zelnik-Manor,et al.  Context-aware saliency detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Edward H. Adelson,et al.  Shiftable multiscale transforms , 1992, IEEE Trans. Inf. Theory.

[17]  Barry B. Lee,et al.  Temporal frequency and chromatic processing in humans: an fMRI study of the cortical visual areas. , 2011, Journal of vision.

[18]  Tim K Marks,et al.  SUN: A Bayesian framework for saliency using natural statistics. , 2008, Journal of vision.

[19]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[20]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[21]  J. Kulikowski,et al.  Phases of daylight and the stability of color perception in the near peripheral human retina. , 2012, Journal of vision.

[22]  L. Zhaoping.  Attention capture by eye of origin singletons even without awareness--a hallmark of a bottom-up saliency map in the primary visual cortex. , 2008, Journal of vision.

[23]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.