Image saliency detection based on rectangular-wave spectrum analysis

Saliency detection is widely used in the fields of computer graphics and multimedia processing. Many computer graphics tasks, such as image segmentation, image labeling, and tracking, rely on the accurate generation of saliency maps. However, most current methods lack the ability to generate a fine boundary between the foreground and background while also providing a high recall rate. The saliency detection algorithm proposed in this paper is based on rectangular-wave spectrum analysis. In this method, we divide a given image into several regions, which are then convoluted using a pre-set rectangular-wave template. We determine the final saliency value by calculating the difference between a region and its adjacent regions, and its uniqueness compared with the entire image. Repeated tests using different data sets produced a high accuracy-recall rate. Moreover, the boundary in our saliency map is clear and fine.

[1]  Deepu Rajan,et al.  Salient Region Detection by Modeling Distributions of Color and Orientation , 2009, IEEE Transactions on Multimedia.

[2]  John K. Tsotsos,et al.  Saliency Based on Information Maximization , 2005, NIPS.

[3]  John K. Tsotsos,et al.  Modeling Visual Attention via Selective Tuning , 1995, Artif. Intell..

[4]  Frédo Durand,et al.  Learning to predict where humans look , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[5]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[6]  Sabine Süsstrunk,et al.  Salient Region Detection and Segmentation , 2008, ICVS.

[7]  Jianbo Shi,et al.  Contour cut: Identifying salient contours in images by solving a Hermitian eigenvalue problem , 2011, CVPR 2011.

[8]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[9]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[11]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[12]  Jing Shen,et al.  An Improved Computational Approach for Salient Region Detection , 2010, J. Comput..

[13]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[14]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[15]  Junchi Yan,et al.  Visual Saliency Detection via Sparsity Pursuit , 2010, IEEE Signal Processing Letters.

[16]  Liming Zhang,et al.  Spatio-temporal Saliency detection using phase spectrum of quaternion fourier transform , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Mubarak Shah,et al.  Visual attention detection in video sequences using spatiotemporal cues , 2006, MM '06.

[18]  Lihi Zelnik-Manor,et al.  Context-aware saliency detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Stephen J. Sangwine,et al.  Hypercomplex Fourier Transforms of Color Images , 2001, IEEE Transactions on Image Processing.

[20]  Xiaochun Cao,et al.  Image aesthetics enhancement using composition-based saliency detection , 2014, Multimedia Systems.

[21]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.