What Is the Chance of Happening: A New Way to Predict Where People Look

Visual attention is an important issue in image and video analysis and keeps being an open problem in the computer vision field. Motivated by the famous Helmholtz principle, a new approach of visual attention analysis is proposed in this paper based on the low level feature statistics of natural images and the Bayesian framework. Firstly, two priors, i.e., Surrounding Feature Prior (SFP) and Single Feature Probability Distribution (SFPD) are learned and integrated by a Bayesian framework to compute the chance of happening (CoH) of each pixel in an image. Then another prior, i.e., Center Bias Prior (CBP), is learned and applied to the CoH to compute the saliency map of the image. The experimental results demonstrate that the proposed approach is both effective and efficient by providing more accurate and quick visual attention location. We make three major contributions in this paper: (1) A set of simple but powerful priors, SFP, SFPD and CBP, are presented in an intuitive way; (2) A computational model of CoH based on Bayesian framework is given to integrate SFP and SFPD together; (3) A computationally plausible way to obtain the saliency map of natural images based on CoH and CBP.

[1]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[2]  Pierre Baldi,et al.  Bayesian surprise attracts human attention , 2005, Vision Research.

[3]  John K. Tsotsos,et al.  Modeling Visual Attention via Selective Tuning , 1995, Artif. Intell..

[4]  Chun Chen,et al.  Visual attention analysis by pseudo gravitational field , 2009, ACM Multimedia.

[5]  Frédo Durand,et al.  Learning to predict where humans look , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[6]  Tim K Marks,et al.  SUN: A Bayesian framework for saliency using natural statistics. , 2008, Journal of vision.

[7]  Neil D. B. Bruce.  Features that draw visual attention: an information theoretic perspective , 2005, Neurocomputing.

[8]  John K. Tsotsos,et al.  Saliency, attention, and visual search: an information theoretic approach. , 2009, Journal of vision.

[9]  Jean-Michel Morel,et al.  From Gestalt Theory to Image Analysis: A Probabilistic Approach , 2007 .

[10]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[11]  John K. Tsotsos.  Analyzing vision at the complexity level , 1990, Behavioral and Brain Sciences.

[12]  Wenjun Zhang,et al.  Scalable visual sensitivity profile estimation , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[13]  John K. Tsotsos,et al.  Saliency Based on Information Maximization , 2005, NIPS.

[14]  Wen Gao,et al.  Region-based visual attention analysis with its application in image browsing on small displays , 2007, ACM Multimedia.

[15]  Paul Scheunders,et al.  Statistical texture characterization from discrete wavelet representations , 1999, IEEE Trans. Image Process..

[16]  L. Zhaoping.  Attention capture by eye of origin singletons even without awareness--a hallmark of a bottom-up saliency map in the primary visual cortex. , 2008, Journal of vision.

[17]  Patrick Le Callet,et al.  A coherent computational approach to model bottom-up visual attention , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[19]  H. Vincent Poor,et al.  An introduction to signal detection and estimation (2nd ed.) , 1994 .

[20]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[21]  Jean-Michel Morel,et al.  From Gestalt Theory to Image Analysis , 2008 .