A corner-based saliency model

Biological-based bottom-up saliency models base their computation on low-level features like intensity, color and orientation which input signals are encoded along the retina, lateral geniculate nucleus (LGN), and primary visual cortex (V1) respectively. Visual attention is then evaluated independently on each feature channel and combined later to achieve a final saliency map. In this work, we propose a model that utilizes medium-level features such as corners, line intersections, and line endings to extract possible locations of figures in natural images. Our result on Toronto dataset [1] indicates that the model is competitive among other state-of-the-art models. We also believe these features are essential for object learning and recognition at later stage of visual processing in human.

[1]  D. Jameson,et al.  An opponent-process theory of color vision. , 1957, Psychological review.

[2]  Tim K Marks,et al.  SUN: A Bayesian framework for saliency using natural statistics. , 2008, Journal of vision.

[3]  Heinz Hügli,et al.  Empirical Validation of the Saliency-based Model of Visual Attention , 2003 .

[4]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[5]  J. P. Jones,et al.  An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[6]  Pierre Baldi,et al.  Bayesian surprise attracts human attention , 2005, Vision Research.

[7]  Christof Koch,et al.  Image Signature: Highlighting Sparse Salient Regions , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Ali Borji,et al.  Exploiting local and global patch rarities for saliency detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[11]  Stefan Mihalas,et al.  A model of proto-object based saliency , 2014, Vision Research.

[12]  Simone Frintrop,et al.  VOCUS: A Visual Attention System for Object Detection and Goal-Directed Search , 2006, Lecture Notes in Computer Science.

[13]  D. Fitzpatrick,et al.  Orientation Selectivity and the Arrangement of Horizontal Connections in Tree Shrew Striate Cortex , 1997, The Journal of Neuroscience.

[14]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[15]  C. Connor,et al.  Responses to contour features in macaque area V4. , 1999, Journal of neurophysiology.

[16]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[17]  Ali Borji,et al.  State-of-the-Art in Visual Attention Modeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[19]  John K. Tsotsos,et al.  Saliency Based on Information Maximization , 2005, NIPS.