Saliency model for object detection: searching for novel items in the scene.

This Letter presents a new computational model of visual saliency. A new definition for saliency is proposed: saliency is novelty, which guides the deployment of visual attention. We define novelty as coming from regions that contain dissimilarities from the global scene. Our approach consists of two stages: First, obtain a global perspective. The global representation is obtained with a visual vocabulary. A novelty factor for each visual word is introduced according to the "repetition suppression principle." Second, obtain a local perspective. A local representation is achieved from the histogram of visual word occurrence. The metric of saliency is defined as the overall novelty factor of the visual words. Experimental results demonstrate good performance of the proposed model on complex scenes and fair consistency with human eye fixation data.

[1]  Yuan Zhao,et al.  Salient target detection based on pseudo-Wigner-Ville distribution and Rényi entropy. , 2010, Optics letters.

[2]  G. Rainer,et al.  Cognitive neuroscience: Neural mechanisms for detecting and remembering novel events , 2003, Nature Reviews Neuroscience.

[3]  Ramon Baldrich,et al.  Saliency of color image derivatives: a comparison between computational models and human perception. , 2010, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Byoung Chul Ko,et al.  Object-of-interest image segmentation based on human attention and semantic region clustering. , 2006, Journal of the Optical Society of America. A, Optics, image science, and vision.

[6]  Ohad Ben-Shahar,et al.  Curvature-based perceptual singularities and texture saliency with early vision mechanisms. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[7]  J. Förster Local and global cross-modal influences between vision and hearing, tasting, smelling, or touching. , 2011, Journal of experimental psychology. General.