Adaptive Irregular Graph Construction-Based Salient Object Detection

Saliency detection represents a vital pre-processing stage of computer vision. Most existing propagation-based salient object detection methods construct a <inline-formula> <tex-math notation="LaTeX">$k$ </tex-math></inline-formula>-regular graph for saliency propagation. Applying a regular graph to a vast smooth region is potentially prone to unnecessary or prolonged propagation errors, leading to the excessive highlighting of the background regions. To mitigate such problems, we substitute the conventional <inline-formula> <tex-math notation="LaTeX">$k$ </tex-math></inline-formula>-regular graph with an adaptive irregular graph for saliency value propagation, thereby avoiding unnecessary iterations over a vast smooth region. We first perform a clustering analysis based on the smoothness, color, and other features of regions. The new graph boosts an adaptive link density by considering the clustering result. In addition, we propose a seeding strategy for the propagation. Based on our experimental studies of six major benchmark datasets, our method performed favorably against the other state-of-the-art methods, both quantitatively and qualitatively.

[1]  Huimin Lu,et al.  Facial Emotion Recognition Based on Biorthogonal Wavelet Entropy, Fuzzy Support Vector Machine, and Stratified Cross Validation , 2016, IEEE Access.

[2]  Huchuan Lu,et al.  Saliency Detection with Multi-Scale Superpixels , 2014, IEEE Signal Processing Letters.

[3]  Huchuan Lu,et al.  Graph-Regularized Saliency Detection With Convex-Hull-Based Center Prior , 2013, IEEE Signal Processing Letters.

[4]  Lei Guo,et al.  An Object-Oriented Visual Saliency Detection Framework Based on Sparse Coding Representations , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Jingdong Wang,et al.  Salient Object Detection: A Discriminative Regional Feature Integration Approach , 2013, International Journal of Computer Vision.

[6]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Huchuan Lu,et al.  Saliency Detection via Absorbing Markov Chain , 2013, 2013 IEEE International Conference on Computer Vision.

[8]  Sun-Yuan Kung,et al.  Semisupervised Learning Based on a Novel Iterative Optimization Model for Saliency Detection , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Huchuan Lu,et al.  Dense and Sparse Reconstruction Error Based Saliency Descriptor , 2016, IEEE Transactions on Image Processing.

[10]  Lihi Zelnik-Manor,et al.  Context-aware saliency detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Yudong Zhang,et al.  Structure-Adaptive Fuzzy Estimation for Random-Valued Impulse Noise Suppression , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Ying Wu,et al.  A unified approach to salient object detection via low rank matrix recovery , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Huchuan Lu,et al.  Inner and Inter Label Propagation: Salient Object Detection in the Wild , 2015, IEEE Transactions on Image Processing.

[15]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[16]  Shang-Hong Lai,et al.  Fusing generic objectness and visual saliency for salient object detection , 2011, 2011 International Conference on Computer Vision.

[17]  Jie Yang,et al.  Normalized cut-based saliency detection by adaptive multi-level region merging , 2015, IEEE Transactions on Image Processing.

[18]  Wenbin Zou,et al.  Saliency Tree: A Novel Saliency Detection Framework , 2014, IEEE Transactions on Image Processing.

[19]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[20]  Lihi Zelnik-Manor,et al.  How to Evaluate Foreground Maps , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Sun-Yuan Kung,et al.  Hyperspectral and Multispectral Image Fusion Based on Local Low Rank and Coupled Spectral Unmixing , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Vibhav Vineet,et al.  Efficient Salient Region Detection with Soft Image Abstraction , 2013, 2013 IEEE International Conference on Computer Vision.

[23]  Huchuan Lu,et al.  Saliency Detection via Graph-Based Manifold Ranking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Zhi Liu,et al.  Segmentation Driven Low-rank Matrix Recovery for Saliency Detection , 2013, BMVC.

[25]  Ronald Rosenfeld,et al.  Semi-supervised learning with graphs , 2005 .

[26]  Sun-Yuan Kung,et al.  Salient Object Detection via Fuzzy Theory and Object-Level Enhancement , 2019, IEEE Transactions on Multimedia.

[27]  Pichao Wang,et al.  Salient Object Detection via Weighted Low Rank Matrix Recovery , 2017, IEEE Signal Processing Letters.

[28]  Huchuan Lu,et al.  Deep networks for saliency detection via local estimation and global search , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Feng Wu,et al.  Background Prior-Based Salient Object Detection via Deep Reconstruction Residual , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Yuan Zhou,et al.  Depth image super-resolution based on joint sparse coding , 2020, Pattern Recognit. Lett..

[31]  Stan Sclaroff,et al.  Saliency Detection: A Boolean Map Approach , 2013, 2013 IEEE International Conference on Computer Vision.

[32]  Yuan Zhou,et al.  Underwater Image Restoration Using Color-Line Model , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[33]  Sabine Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Li Xu,et al.  Hierarchical Image Saliency Detection on Extended CSSD , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[36]  Yuan Zhou,et al.  Iterative Feedback Control-Based Salient Object Segmentation , 2018, IEEE Transactions on Multimedia.

[37]  James M. Rehg,et al.  The Secrets of Salient Object Segmentation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Rynson W. H. Lau,et al.  SuperCNN: A Superpixelwise Convolutional Neural Network for Salient Object Detection , 2015, International Journal of Computer Vision.

[39]  Bing Li,et al.  Salient Object Detection via Structured Matrix Decomposition. , 2016, IEEE transactions on pattern analysis and machine intelligence.

[40]  Shiguang Shan,et al.  Adaptive Partial Differential Equation Learning for Visual Saliency Detection , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Wei Liu,et al.  Saliency propagation from simple to difficult , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Weidong Cai,et al.  Reversion Correction and Regularized Random Walk Ranking for Saliency Detection , 2018, IEEE Transactions on Image Processing.

[43]  Shao-Yi Chien,et al.  Real-Time Salient Object Detection with a Minimum Spanning Tree , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Shuihua Wang,et al.  Indoor signage detection based on saliency map and bipartite graph matching , 2011, 2011 IEEE International Conference on Bioinformatics and Biomedicine Workshops (BIBMW).

[45]  Yudong Zhang,et al.  Intelligent facial emotion recognition based on stationary wavelet entropy and Jaya algorithm , 2018, Neurocomputing.

[46]  Huchuan Lu,et al.  Saliency detection via Cellular Automata , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  Huchuan Lu,et al.  Saliency Region Detection Based on Markov Absorption Probabilities , 2015, IEEE Transactions on Image Processing.

[48]  Huazhong Shu,et al.  Curve-Like Structure Extraction Using Minimal Path Propagation With Backtracking , 2016, IEEE Transactions on Image Processing.

[49]  Huchuan Lu,et al.  Bayesian Saliency via Low and mid Level Cues , 2022 .

[50]  Ronen Basri,et al.  Image Segmentation by Probabilistic Bottom-Up Aggregation and Cue Integration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[51]  Sun-Yuan Kung,et al.  Semi-Supervised Salient Object Detection Using a Linear Feedback Control System Model , 2019, IEEE Transactions on Cybernetics.

[52]  Ali Borji,et al.  Exploiting local and global patch rarities for saliency detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[53]  Jian Sun,et al.  Saliency Optimization from Robust Background Detection , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.