A novel saliency map extraction method based on improved Itti's model

To obtain a saliency map close to the saliency object as much as possible, an improved bottom-up visual attention model is presented. Firstly, early visual features such as intensity, color and orientation are extracted from an input image at multiple scales; Secondly, three conspicuity maps are created respectively according to early features; Thirdly, three conspicuity maps are combined into a saliency map nonlinearly. In the last step, different from Itti's model, the contribution rate of each conspicuity map to the saliency map is done in inversely proportional to the saliency points area. A set of experiments were carried out to demonstrate the effectiveness of the proposed model. The experimental results show that the algorithm is effective and saliency map accuracy increased by 15–20% compared to Itti's model.

[1]  Xing Xie,et al.  Automatic browsing of large pictures on mobile devices , 2003, MULTIMEDIA '03.

[2]  Yoshiki Uchikawa,et al.  Active vision inspired by mammalian fixation mechanism , 1994, IROS.

[3]  D. Jameson,et al.  An opponent-process theory of color vision. , 1957, Psychological review.

[4]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[5]  Jang-Kyoo Shin,et al.  Saliency map model based on the edge images of natural scenes , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[6]  Laurent Itti,et al.  Automatic foveation for video compression using a neurobiological model of visual attention , 2004, IEEE Transactions on Image Processing.

[7]  John K. Tsotsos,et al.  Modeling Visual Attention via Selective Tuning , 1995, Artif. Intell..

[8]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[9]  Donald P. Greenberg,et al.  Spatiotemporal sensitivity and visual attention for efficient rendering of dynamic environments , 2005, TOGS.

[10]  M. Carter.  Computer graphics: Principles and practice , 1997 .

[11]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[12]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Heinz Hügli,et al.  Empirical Validation of the Saliency-based Model of Visual Attention , 2003 .

[14]  Xing Xie,et al.  A visual attention model for adapting images on small displays , 2003, Multimedia Systems.

[15]  L. Itti,et al.  Modeling the influence of task on attention , 2005, Vision Research.

[16]  C. Koch,et al.  Models of bottom-up and top-down visual attention , 2000 .

[17]  Michal Irani,et al.  Detecting Irregularities in Images and in Video , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[18]  Pabitra Mitra,et al.  A New Image Watermarking Scheme Using Saliency Based Visual Attention Model , 2009, 2009 Annual IEEE India Conference.

[19]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[20]  C. Koch,et al.  Target detection using saliency-based attention , 2000 .

[21]  Laurent Itti,et al.  An Integrated Model of Top-Down and Bottom-Up Attention for Optimizing Detection Speed , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[22]  J ValdésJulio,et al.  2006 Special issue , 2006 .

[23]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .