Frequency-spatial domain based salient region detection

Abstract A frequency-spatial domain based model for salient region detection was proposed. The paper gives a thorough theoretical analysis of detecting salient gradients belong to salient region in the frequency domain. The model detects and highlights salient gradient changes in the frequency domain firstly; then the image is segmented into regions in the spatial domain, and the salient gradients detection and segment results are fused using a probabilistic framework to produce the full resolution, region-wise saliency map. It was demonstrated that this model has the ability to detect salient regions accurately and highlight them uniformly. A publically available benchmark was used to demonstrate that the model outperformed state-of-the-art algorithms when identifying the salient regions where greater attention should be paid by human observers.

[1]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[2]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  P. König,et al.  Does luminance‐contrast contribute to a saliency map for overt visual attention? , 2003, The European journal of neuroscience.

[4]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[5]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[6]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[7]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[8]  D. Ruderman.  The statistics of natural images , 1994 .

[9]  Martin D. Levine,et al.  Visual Saliency Based on Scale-Space Analysis in the Frequency Domain , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Liming Zhang,et al.  A Novel Multiresolution Spatiotemporal Saliency Detection Model and Its Applications in Image and Video Compression , 2010, IEEE Transactions on Image Processing.

[12]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[13]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[14]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[16]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[17]  Simone Frintrop,et al.  A Real-time Visual Attention System Using Integral Images , 2007, ICVS 2007.

[18]  Mubarak Shah,et al.  Visual attention detection in video sequences using spatiotemporal cues , 2006, MM '06.

[19]  Jian Li,et al.  Image and Video Region Saliency Based on Space and Motion , 2010 .

[20]  T. Ell,et al.  Quaternion-Fourier transforms for analysis of two-dimensional linear time-invariant partial differential systems , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[21]  Michael Lindenbaum,et al.  Esaliency (Extended Saliency): Meaningful Attention Using Stochastic Image Modeling , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  King Ngi Ngan,et al.  Unsupervised extraction of visual attention objects in color images , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  L. Spillmann,et al.  Long-range interactions in visual perception , 1996, Trends in Neurosciences.

[24]  Liming Zhang,et al.  Spatio-temporal Saliency detection using phase spectrum of quaternion fourier transform , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.