A computational model of selecting visual attention based on bottom-up and top-down feature combination

Selecting attention is an important cognitive psychology concept originally which has received much attention from scholars in the field of computer science. Nowadays, selecting attention has much application in computer vision. Most current computational models of attention focus on bottom-up features and ignore scene information. In this paper, a model of selecting visual attention guidance based on both bottom-up and top-down features was proposed. We used two datasets to evaluate the performance of the model, and also compare ours with Itti's model, which is particularly famous for visual attention. Experiments indicate that our model is applicable to the simulation of visual attention, and it achieves better performance in attention transferring than the models existed.

[1]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[2]  Antonio Torralba,et al.  Top-down control of visual attention in object detection , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[3]  Ali Borji,et al.  State-of-the-Art in Visual Attention Modeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Christof Koch,et al.  Feature combination strategies for saliency-based visual attention systems , 2001, J. Electronic Imaging.

[5]  H. Pashler The Psychology of Attention , 1997 .

[6]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[7]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[8]  Jing Zhang,et al.  A Study of Top-Down Visual Attention Model Based on Similarity Distance , 2009, 2009 2nd International Congress on Image and Signal Processing.

[9]  Xing Xie,et al.  Salient Region Detection Using Weighted Feature Maps Based on the Human Visual Attention Model , 2004, PCM.

[10]  Bärbel Mertsching,et al.  Top-Down Visual Attention with Complex Templates , 2013, VISAPP.

[11]  Pietro Perona,et al.  Optimal reward harvesting in complex perceptual environments , 2010, Proceedings of the National Academy of Sciences.

[12]  R. Rafal,et al.  Shifting visual attention between objects and locations: evidence from normal and parietal lesion subjects. , 1994, Journal of experimental psychology. General.

[13]  Nathalie Guyader,et al.  Modelling Spatio-Temporal Saliency to Predict Gaze Direction for Short Videos , 2009, International Journal of Computer Vision.

[14]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[15]  John K. Tsotsos,et al.  Computational models of visual attention , 2011, Vision Research.

[16]  Bela Julesz,et al.  Enhanced detection in the aperture of focal attention during simple discrimination tasks , 1986, Nature.