Investigation of mobile surroundings for visual attention based on image perception model

This paper presents a novel perspective of performance evaluation for visual attention estimation: how the saliency models perform in mobile conditions. In particular, a broad-spectrum contrast sensitivity function is firstly proposed in this work. Based on this function, a new visual perception model is established, which will be further used to simulate the image perception in various mobile circumstances. Then the influence caused by mobile surroundings for visual attention is investigated. Meanwhile three types of mobile ground truth are generated by collecting viewers' fixations in three typical mobile conditions. Finally, by the perception model and mobile ground truth, an evaluation for ten classical visual attention models in various mobile surroundings is presented.

[1]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[2]  Ariel Shamir,et al.  Seam carving for media retargeting , 2009, CACM.

[3]  Aykut Erdem,et al.  Visual saliency estimation by nonlinearly integrating features using region covariances. , 2013, Journal of vision.

[4]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[5]  Youn Jin Kim.  An automatic image enhancement method adaptive to the surround luminance variation for small sized mobile transmissive LCD , 2010, IEEE Transactions on Consumer Electronics.

[6]  Peyman Milanfar,et al.  Visual saliency in noisy images. , 2013, Journal of vision.

[7]  M. Angela Sasse,et al.  The big picture on small screens delivering acceptable video quality in mobile TV , 2009, TOMCCAP.

[8]  Stan Sclaroff,et al.  Saliency Detection: A Boolean Map Approach , 2013, 2013 IEEE International Conference on Computer Vision.

[9]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[10]  Joyce H. D. M. Westerink,et al.  Subjective image quality as a function of viewing distance , 1989 .

[11]  Nicolas Riche,et al.  RARE2012: A multi-scale rarity-based saliency detection with its comparative statistical analysis , 2013, Signal Process. Image Commun..

[12]  King Ngi Ngan,et al.  Perceptual video coding: Challenges and approaches , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[13]  Bu-Sung Lee,et al.  Bottom-Up Saliency Detection Model Based on Human Visual Sensitivity and Amplitude Spectrum , 2012, IEEE Transactions on Multimedia.

[14]  Christof Koch,et al.  Image Signature: Highlighting Sparse Salient Regions , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Xiongkuo Min,et al.  Influence of compression artifacts on visual attention , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[16]  Chang Wen Chen,et al.  Mobile JND: environment adapted perceptual model and mobile video quality enhancement , 2012, MMSys '12.

[17]  Antón García-Díaz,et al.  Saliency from hierarchical adaptation through decorrelation and variance normalization , 2012, Image Vis. Comput..

[18]  Lihi Zelnik-Manor,et al.  Context-Aware Saliency Detection , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Matthew H Tong,et al.  SUN: Top-down saliency using natural statistics , 2009, Visual cognition.

[20]  John K. Tsotsos,et al.  Saliency Based on Information Maximization , 2005, NIPS.