Multi-scale region-based saliency detection using W2 distance on N-dimensional normal distributions

We present a new segment-based method for saliency detection based on multi-size superpixels that combines local and global saliency cues. We extract superpixels at several scales and represent each superpixel with a normal distribution in CIE-Lab space estimated from its associated pixels. Global saliency is computed by grouping similar superpixels to estimate the spatial distribution of colors, while local saliency detection is achieved by determining the center-surround contrast of neighboring superpixels. Both methods rely on the Wasserstein distance on L2 norm (W2) to measure perceptual (dis-)similarity between superpixels. Additionally, we propose a Saliency Flow technique to refine the local saliency map. Our approach uses very few empirical parameters and outperforms 6 recent state-of-the-art saliency detection methods in terms of several evaluations on a widely used benchmark.

[1]  Ali Borji,et al.  Salient Object Detection: A Benchmark , 2015, IEEE Transactions on Image Processing.

[2]  Liang-Tien Chia,et al.  Improved saliency detection based on superpixel clustering and saliency propagation , 2010, ACM Multimedia.

[3]  Simone Frintrop,et al.  Salient Pattern Detection Using W 2 on Multivariate Normal Distributions , 2012, DAGM/OAGM Symposium.

[4]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  T. Duckett,et al.  VOCUS : A Visual Attention System for Object Detection and Goal-directed Search , 2010 .

[6]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Simone Frintrop,et al.  Center-surround divergence of feature statistics for salient object detection , 2011, 2011 International Conference on Computer Vision.

[8]  Thomas Villmann,et al.  Fuzzy Variant of Affinity Propagation in Comparison to Median Fuzzy c-Means , 2009, WSOM.

[9]  Nicolas Riche,et al.  Rare: A new bottom-up saliency model , 2012, 2012 19th IEEE International Conference on Image Processing.

[10]  Henrik I. Christensen,et al.  Computational visual attention systems and their cognitive foundations: A survey , 2010, TAP.

[11]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[12]  Huchuan Lu,et al.  Bayesian Saliency via Low and mid Level Cues , 2022 .

[13]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[14]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[15]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[16]  B. Matthews Comparison of the predicted and observed secondary structure of T4 phage lysozyme. , 1975, Biochimica et biophysica acta.

[17]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Chu-Song Chen,et al.  From rareness to compactness: Contrast-aware image saliency detection , 2012, 2012 19th IEEE International Conference on Image Processing.

[19]  D. Dowson,et al.  The Fréchet distance between multivariate normal distributions , 1982 .