A robust metric for the evaluation of visual saliency models

Finding a robust metric for evaluating the visual saliency algorithms has been the subject of research for decades. Motivated by the shuffled AUC metric in this paper, we propose a robust AUC metric that uses the statistical analysis of the fixations data to better judge the goodness of the different saliency algorithms. To calculate the robust AUC metric, we use the first eigenvector obtained from the statistical analysis to define the area from which non-fixations are selected thus mitigating the effect of the center bias. Our results show that the proposed metric results in similar performance when compared with the shuffled AUC metric, but given that the proposed metric is derived from the statistics for the data set, we believe that it is more robust.

[1]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[2]  Aykut Erdem,et al.  Visual saliency estimation by nonlinearly integrating features using region covariances. , 2013, Journal of vision.

[3]  R. Rosenholtz.  A simple saliency model predicts a number of motion popout phenomena , 1999, Vision Research.

[4]  Michael Brady,et al.  Saliency, Scale and Image Description , 2001, International Journal of Computer Vision.

[5]  Sabine Süsstrunk,et al.  Salient Region Detection and Segmentation , 2008, ICVS.

[6]  Antonio Torralba,et al.  Top-down control of visual attention in object detection , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[7]  Ali Borji,et al.  State-of-the-Art in Visual Attention Modeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Patrick Le Callet,et al.  A coherent computational approach to model bottom-up visual attention , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  L. Itti,et al.  Quantifying center bias of observers in free viewing of dynamic natural scenes. , 2009, Journal of vision.

[10]  Benjamin W Tatler,et al.  The central fixation bias in scene viewing: selecting an optimal viewing position independently of motor biases and image feature distributions. , 2007, Journal of vision.

[11]  Tim K Marks,et al.  SUN: A Bayesian framework for saliency using natural statistics. , 2008, Journal of vision.

[12]  C. Lappe.  Eye movements: A window on mind and brain , 2008 .

[13]  C. Koch,et al.  Faces and text attract gaze independent of the task: Experimental data and computer model. , 2009, Journal of vision.

[14]  Liming Zhang,et al.  Saliency-Based Image Quality Assessment Criterion , 2008, ICIC.

[15]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[16]  Ali Alsam,et al.  Analysis of eye fixations data , 2011 .

[17]  Ali Borji,et al.  Exploiting local and global patch rarities for saliency detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  George Loizou,et al.  Computer vision and pattern recognition , 2007, Int. J. Comput. Math..

[19]  Stella X. Yu,et al.  Image Compression Based on Visual Saliency at Individual Scales , 2009, ISVC.

[20]  Tao Liu,et al.  Saliency based objective quality assessment of decoded video affected by packet losses , 2008, 2008 15th IEEE International Conference on Image Processing.

[21]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[22]  Henrik I. Christensen,et al.  Attentional Landmark Selection for Visual SLAM , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Peter König,et al.  Measures and Limits of Models of Fixation Selection , 2011, PloS one.

[24]  Frédo Durand,et al.  Learning to predict where humans look , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[25]  Laurent Itti,et al.  Biologically-inspired robotics vision monte-carlo localization in the outdoor environment , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Iain D. Gilchrist,et al.  Visual correlates of fixation selection: effects of scale and time , 2005, Vision Research.

[27]  J. Henderson.  Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[28]  Brian Scassellati,et al.  A Context-Dependent Attention System for a Social Robot , 1999, IJCAI.

[29]  Laurent Itti,et al.  Automatic foveation for video compression using a neurobiological model of visual attention , 2004, IEEE Transactions on Image Processing.

[30]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[31]  Puneet Sharma,et al.  What the Eye Did Not See - A Fusion Approach to Image Coding , 2012, ISVC.

[32]  Christof Koch,et al.  Predicting human gaze using low-level saliency combined with face detection , 2007, NIPS.

[33]  D. Kalman.  A Singularly Valuable Decomposition: The SVD of a Matrix , 1996 .

[34]  Gene H. Golub,et al.  Calculating the singular values and pseudo-inverse of a matrix , 2007, Milestones in Matrix Computation.

[35]  Puneet Sharma,et al.  Asymmetry as a Measure of Visual Saliency , 2013, SCIA.

[36]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[37]  Antón García-Díaz,et al.  Saliency from hierarchical adaptation through decorrelation and variance normalization , 2012, Image Vis. Comput..

[38]  Ruth Rosenholtz,et al.  Do predictions of visual perception aid design? , 2011, TAP.

[39]  Ali Borji,et al.  Quantitative Analysis of Human-Model Agreement in Visual Saliency Modeling: A Comparative Study , 2013, IEEE Transactions on Image Processing.

[40]  Rainer Stiefelhagen,et al.  Predicting human gaze using quaternion DCT image signature saliency and face detection , 2012, 2012 IEEE Workshop on the Applications of Computer Vision (WACV).

[41]  John K. Tsotsos,et al.  Saliency Based on Information Maximization , 2005, NIPS.

[42]  Tom Fawcett,et al.  ROC Graphs: Notes and Practical Considerations for Researchers , 2007 .

[43]  Athanasios V. Vasilakos,et al.  Dynamic Intelligent Lighting for Directing Visual Attention in Interactive 3-D Scenes , 2009, IEEE Transactions on Computational Intelligence and AI in Games.