Decorrelation and Distinctiveness Provide with Human-Like Saliency

In this work, we show the capability of a new model of saliency, of reproducing remarkable psychophysical results. The model presents low computational complexity compared to other models of the state of the art. It is based in biologically plausible mechanisms: the decorrelation and the distinctiveness of local responses. Decorrelation of scales is obtained from principal component analysis of multiscale low level features. Distinctiveness is measured through the Hotelling’s T2 statistic. The model is conceived to be used in a machine vision system, in which attention would contribute to enhance performance together with other visual functions. Experiments demonstrate the consistency with a wide variety of psychophysical phenomena, that are referenced in the visual attention modeling literature, with results that outperform other state of the art models.

[1]  Nuno Vasconcelos,et al.  On the plausibility of the discriminant center-surround hypothesis for visual saliency. , 2008, Journal of vision.

[2]  Eli Brenner,et al.  Reliable Identification by Color under Natural Conditions the Locations Baseline Measurement , 2022 .

[3]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[4]  R. Rosenholtz,et al.  The effect of background color on asymmetries in color search. , 2004, Journal of vision.

[5]  Christoph Zetzsche,et al.  Natural Scene Statistics and Salient Visual Features , 2005 .

[6]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[7]  J. Wolfe,et al.  What attributes guide the deployment of visual attention and how do they do it? , 2004, Nature Reviews Neuroscience.

[8]  H. Nothdurft.  Salience of Feature Contrast , 2005 .

[9]  Iain D. Gilchrist,et al.  Visual correlates of fixation selection: effects of scale and time , 2005, Vision Research.

[10]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[11]  David J. Field,et al.  How Close Are We to Understanding V1? , 2005, Neural Computation.

[12]  John K. Tsotsos,et al.  Saliency, attention, and visual search: an information theoretic approach. , 2009, Journal of vision.

[13]  H. Nothdurft.  The conspicuousness of orientation and motion contrast. , 1993, Spatial vision.

[14]  Peng-Yeng Yin,et al.  Pattern Recognition Techniques, Technology and Applications , 2008 .

[15]  Antón García-Díaz,et al.  Local Energy Variability as a Generic Measure of Bottom-Up Salience , 2008 .

[16]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[17]  Nuno Vasconcelos,et al.  The discriminant center-surround hypothesis for bottom-up saliency , 2007, NIPS.

[18]  John K. Tsotsos,et al.  Computational Foundations for Attentive Processes , 2008 .

[19]  R. Lund.  Advances in Neural Information Processing Systems 17: Proceedings of the 2004 Conference , 2006 .

[20]  Kuldip K. Paliwal,et al.  Fast principal component analysis using fixed-point algorithm , 2007, Pattern Recognit. Lett..

[21]  D. Burr,et al.  Feature detection in human vision: a phase-dependent energy model , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[22]  John K. Tsotsos,et al.  Neurobiology of Attention , 2005 .

[23]  Peter Kovesi,et al.  Invariant measures of image features from phase information , 1996 .

[24]  John K. Tsotsos,et al.  Saliency Based on Information Maximization , 2005, NIPS.

[25]  Mehryar Mohri,et al.  Confidence Intervals for the Area Under the ROC Curve , 2004, NIPS.

[26]  J L Gallant,et al.  Sparse coding and decorrelation in primary visual cortex during natural vision. , 2000, Science.

[27]  Patrick Le Callet,et al.  A coherent computational approach to model bottom-up visual attention , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Jason M. Samonds,et al.  Area 18 contributes to contrast adaptation of Area 17 cells in the cat. , 2004 .

[29]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[30]  A Treisman,et al.  Feature analysis in early vision: evidence from search asymmetries. , 1988, Psychological review.