A bio-inspired center-surround model for salience computation in images

A bio-inspired center-surround model is proposed for salience computation.The center-surround model draws inspiration from retinal photoreceptor interactions.Multiple nonlinear combinations of nearby pixel values implement the interactions.We show that the combinations constitutes a favorable information-theoretic content.Qualitative and quantitative results show the effectiveness of the proposed approach. A center-surround model inspired by photoreceptor interactions and visual receptive field organization is presented in this paper for salience computation that predicts human eye fixation locations in images. The essence of photoreceptor interactions is implemented considering different nonlinear combinations of responses to stimuli given by values at nearby image pixels. These combinations are then fed to difference of Gaussian filtered outputs operation and Gabor filter based processes simulating visual receptive field organization. The proposed center-surround model is used in Itti et al.'s bio-inspired framework to perform salience computation. Analysis is carried out to present the information-theoretic aspect of the nonlinear combinations. Significance of the proposed center-surround model is shown both qualitatively and quantitatively by comparing its use in salience computation with the use of existing models considering different psychological patterns, and synthetic and real-life images. Quantitative and qualitative performance of salience computation using the novel center-surround model for three well-known datasets of images are also compared to that of relevant existing salience computation approaches to demonstrate the effectiveness of the proposed approach in generating salience maps closer to human eye fixation density maps.

[1]  Gert Kootstra,et al.  Predicting Eye Fixations on Complex Visual Stimuli Using Local Symmetry , 2011, Cognitive Computation.

[2]  Ali Borji,et al.  Quantitative Analysis of Human-Model Agreement in Visual Saliency Modeling: A Comparative Study , 2013, IEEE Transactions on Image Processing.

[3]  Nicolas Riche,et al.  Saliency and Human Fixations: State-of-the-Art and Study of Comparison Metrics , 2013, 2013 IEEE International Conference on Computer Vision.

[4]  John K. Tsotsos,et al.  Saliency Based on Information Maximization , 2005, NIPS.

[5]  Nuno Vasconcelos,et al.  On the plausibility of the discriminant center-surround hypothesis for visual saliency. , 2008, Journal of vision.

[6]  L. Itti,et al.  Mechanisms of top-down attention , 2011, Trends in Neurosciences.

[7]  Kuan-Man Xu,et al.  Using the Bootstrap Method for a Statistical Significance Test of Differences between Summary Histograms , 2006 .

[8]  Martin D. Levine,et al.  Visual Saliency Based on Scale-Space Analysis in the Frequency Domain , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Christof Koch,et al.  Image Signature: Highlighting Sparse Salient Regions , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[12]  John K. Tsotsos,et al.  Saliency, attention, and visual search: an information theoretic approach. , 2009, Journal of vision.

[13]  J. Daugman.  Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[14]  Antón García-Díaz,et al.  Saliency from hierarchical adaptation through decorrelation and variance normalization , 2012, Image Vis. Comput..

[15]  E. Lehmann.  Testing Statistical Hypotheses , 1960 .

[16]  F. Scharnowski,et al.  Long-lasting modulation of feature integration by transcranial magnetic stimulation. , 2009, Journal of vision.

[17]  Chuan Yi Tang,et al.  A 2.|E|-Bit Distributed Algorithm for the Directed Euler Trail Problem , 1993, Inf. Process. Lett..

[18]  Iain D. Gilchrist,et al.  Visual correlates of fixation selection: effects of scale and time , 2005, Vision Research.

[19]  Marko Tscherepanow,et al.  A random center surround bottom up visual attention model useful for salient region detection , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[20]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[21]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[22]  R. Tibshirani,et al.  An introduction to the bootstrap , 1993 .

[23]  Christof Koch,et al.  Feature combination strategies for saliency-based visual attention systems , 2001, J. Electronic Imaging.

[24]  Nicolas Riche,et al.  Rare: A new bottom-up saliency model , 2012, 2012 19th IEEE International Conference on Image Processing.

[25]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[26]  S. W. Kuffler.  Discharge patterns and functional organization of mammalian retina. , 1953, Journal of neurophysiology.

[27]  R. W. Rodieck,et al.  Analysis of receptive fields of cat retinal ganglion cells. , 1965, Journal of neurophysiology.

[28]  Nuno Vasconcelos,et al.  Bottom-up saliency is a discriminant process , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[29]  Nicolas Riche,et al.  RARE2012: A multi-scale rarity-based saliency detection with its comparative statistical analysis , 2013, Signal Process. Image Commun..

[30]  Weisi Lin,et al.  Integrating visual saliency and consistency for re-ranking image search results , 2011, 2010 IEEE International Conference on Image Processing.

[31]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[32]  Liqing Zhang,et al.  Dynamic visual attention: searching for coding length increments , 2008, NIPS.

[33]  L. Zhaoping.  Attention capture by eye of origin singletons even without awareness--a hallmark of a bottom-up saliency map in the primary visual cortex. , 2008, Journal of vision.

[34]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[35]  Tim K Marks,et al.  SUN: A Bayesian framework for saliency using natural statistics. , 2008, Journal of vision.

[36]  Lihi Zelnik-Manor,et al.  Context-Aware Saliency Detection , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Peyman Milanfar,et al.  Nonparametric bottom-up saliency detection by self-resemblance , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[38]  Frédo Durand,et al.  A Benchmark of Computational Models of Saliency to Predict Human Fixations , 2012 .

[39]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[40]  Peyman Milanfar,et al.  Static and space-time visual saliency detection by self-resemblance. , 2009, Journal of vision.

[41]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[42]  Bu-Sung Lee,et al.  Bottom-Up Saliency Detection Model Based on Human Visual Sensitivity and Amplitude Spectrum , 2012, IEEE Transactions on Multimedia.