Modeling of Human Saccadic Scanpaths Based on Visual Saliency

We propose a method to predict human saccadic scanpaths on natural images based on a bio-inspired visual attention model. The method integrates three related factors as driven forces to guide eye movements, sequentially-visual saliency, winner-takes-all and visual memory, respectively. When predicting a current fixation of saccadic scanpaths, we follow physiological visual memory characteristics to eliminate the effects of the previous selected fixation. Then, we use winner-takes-all to select the fixation on the current saliency map. Experimental results demonstrate that the proposed model outperform other methods on both static fixation locations and dynamic scanpaths.

[1]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[2]  John K. Tsotsos,et al.  Modeling Visual Attention via Selective Tuning , 1995, Artif. Intell..

[3]  Alan C. Bovik,et al.  FOVEA: a foveated vergent active stereo vision system for dynamic three-dimensional scene recovery , 1998, IEEE Trans. Robotics Autom..

[4]  Neil W. Bergmann,et al.  An automatic image quality assessment technique incorporating higher level perceptual factors , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[5]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[6]  Marios S. Pattichis,et al.  Foveated video compression with optimal rate control , 2001, IEEE Trans. Image Process..

[7]  Guang-Zhong Yang,et al.  Visual search: psychophysical models, practical applications , 2002, Image Vis. Comput..

[8]  Claudio M. Privitera,et al.  Human-vision-based selection of image processing algorithms for planetary exploration , 2003, IEEE Trans. Image Process..

[9]  Zhou Wang,et al.  Foveation scalable video coding with automatic fixation selection , 2003, IEEE Trans. Image Process..

[10]  Laurent Itti,et al.  Automatic foveation for video compression using a neurobiological model of visual attention , 2004, IEEE Transactions on Image Processing.

[11]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[12]  Nuno Vasconcelos,et al.  Discriminant Saliency, the Detection of Suspicious Coincidences, and Applications to Visual Recognition , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Yu Fu,et al.  Visual saliency detection by spatially weighted dissimilarity , 2011, CVPR 2011.