Exploiting the Value of the Center-dark Channel Prior for Salient Object Detection

Saliency detection aims to detect the most attractive objects in images and is widely used as a foundation for various applications. In this article, we propose a novel salient object detection algorithm for RGB-D images using center-dark channel priors. First, we generate an initial saliency map based on a color saliency map and a depth saliency map of a given RGB-D image. Then, we generate a center-dark channel map based on center saliency and dark channel priors. Finally, we fuse the initial saliency map with the center dark channel map to generate the final saliency map. Extensive evaluations over four benchmark datasets demonstrate that our proposed method performs favorably against most of the state-of-the-art approaches. Besides, we further discuss the application of the proposed algorithm in small target detection and demonstrate the universal value of center-dark channel priors in the field of object detection.

[1]  Naila Murray,et al.  Saliency estimation using a non-parametric low-level vision model , 2011, CVPR 2011.

[2]  Huchuan Lu,et al.  Inner and Inter Label Propagation: Salient Object Detection in the Wild , 2015, IEEE Transactions on Image Processing.

[3]  Jie Ma,et al.  A Robust Directional Saliency-Based Method for Infrared Small-Target Detection Under Various Complex Backgrounds , 2013, IEEE Geoscience and Remote Sensing Letters.

[4]  Vibhav Vineet,et al.  Efficient Salient Region Detection with Soft Image Abstraction , 2013, 2013 IEEE International Conference on Computer Vision.

[5]  Qi Tian,et al.  Context-Aware Semi-Local Feature Detector , 2012, TIST.

[6]  Ali Borji,et al.  Salient object detection: A survey , 2014, Computational Visual Media.

[7]  Chang-Su Kim,et al.  Optimized contrast enhancement for real-time image and video dehazing , 2013, J. Vis. Commun. Image Represent..

[8]  Yizhou Yu,et al.  Visual saliency based on multiscale deep features , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Ge Li,et al.  Automatic Salient Object Detection for Panoramic Images Using Region Growing and Fixation Prediction Model , 2017, ArXiv.

[10]  Huchuan Lu,et al.  Saliency detection via Cellular Automata , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Shai Avidan,et al.  Non-local Image Dehazing , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Ge Li,et al.  A multilayer backpropagation saliency detection algorithm and its applications , 2018, Multimedia Tools and Applications.

[13]  Ge Li,et al.  A Three-Pathway Psychobiological Framework of Salient Object Detection Using Stereoscopic Technology , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[14]  LiGe,et al.  Exploiting the Value of the Center-dark Channel Prior for Salient Object Detection , 2019 .

[15]  Zixing Cai,et al.  Improved Single Image Dehazing Using Dark Channel Prior and Multi-scale Retinex , 2010, 2010 International Conference on Intelligent System Design and Engineering Application.

[16]  Xueqing Li,et al.  Leveraging stereopsis for saliency analysis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Nuno Vasconcelos,et al.  Discriminant Saliency, the Detection of Suspicious Coincidences, and Applications to Visual Recognition , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Qingming Huang,et al.  Image Saliency Detection Video Saliency Detection Co-saliency Detection Temporal RGBD Saliency Detection Motion , 2018 .

[19]  Sabine Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Haibin Ling,et al.  Scale and object aware image retargeting for thumbnail browsing , 2011, 2011 International Conference on Computer Vision.

[21]  Xing Cai,et al.  PDNet: Prior-Model Guided Depth-Enhanced Network for Salient Object Detection , 2018, 2019 IEEE International Conference on Multimedia and Expo (ICME).

[22]  Frédo Durand,et al.  Learning to predict where humans look , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[23]  Lihi Zelnik-Manor,et al.  What Makes a Patch Distinct? , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Huchuan Lu,et al.  Graph-Regularized Saliency Detection With Convex-Hull-Based Center Prior , 2013, IEEE Signal Processing Letters.

[25]  Ran Ju,et al.  Depth saliency based on anisotropic center-surround difference , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[26]  Wai-Tat Fu,et al.  Leveraging Human Computations to Improve Schematization of Spatial Relations from Imagery , 2016, ACM Trans. Intell. Syst. Technol..

[27]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  James M. Rehg,et al.  The Secrets of Salient Object Segmentation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  P. Chavez An improved dark-object subtraction technique for atmospheric scattering correction of multispectral data , 1988 .

[30]  Yung-Yu Chuang,et al.  Content-Aware Display Adaptation and Interactive Editing for Stereoscopic Images , 2011, IEEE Transactions on Multimedia.

[31]  Ronggang Wang,et al.  An Innovative Salient Object Detection Using Center-Dark Channel Prior , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[32]  Huchuan Lu,et al.  Amulet: Aggregating Multi-level Convolutional Features for Salient Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[33]  Ronggang Wang,et al.  A Multilayer Backpropagation Saliency Detection Algorithm Based on Depth Mining , 2017, CAIP.

[34]  Qi Tian,et al.  Saliency Density Maximization for Efficient Visual Objects Discovery , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[35]  N. Gemini,et al.  An Improved Dark-Object Subtraction Technique for Atmospheric Scattering Correction of Multispectral Data* , 1988 .

[36]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[37]  Shi-Min Hu,et al.  SalientShape: group saliency in image collections , 2013, The Visual Computer.

[38]  Ming-Hsuan Yang,et al.  Top-down visual saliency via joint CRF and dictionary learning , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Huchuan Lu,et al.  Co-Bootstrapping Saliency , 2017, IEEE Transactions on Image Processing.

[40]  Ge Li,et al.  An Innovative Saliency Guided ROI Selection Model for Panoramic Images Compression , 2018, 2018 Data Compression Conference.

[41]  Thomas Deselaers,et al.  Measuring the Objectness of Image Windows , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Shenghua Gao,et al.  Beyond Universal Saliency: Personalized Saliency Prediction with Multi-task CNN , 2017, IJCAI.

[43]  Ronggang Wang,et al.  Salient Object Detection with Complex Scene Based on Cognitive Neuroscience , 2017, 2017 IEEE Third International Conference on Multimedia Big Data (BigMM).

[44]  Wei Li,et al.  Saliency-based automatic target detection in forward looking infrared images , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[45]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[46]  Nuno Vasconcelos,et al.  Discriminant Saliency for Visual Recognition from Cluttered Scenes , 2004, NIPS.

[47]  Kil-Houm Park,et al.  Effective small target enhancement and detection in infrared images using saliency map and image intensity , 2015 .

[48]  Ali Borji,et al.  Boosting bottom-up and top-down visual features for saliency estimation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  Yuan Xie,et al.  Instance-Level Salient Object Segmentation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[51]  Yizhou Yu,et al.  Deep Contrast Learning for Salient Object Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[52]  Xiaowu Chen,et al.  A Benchmark Dataset and Saliency-Guided Stacked Autoencoders for Video-Based Salient Object Detection , 2016, IEEE Transactions on Image Processing.

[53]  Chang-Su Kim,et al.  Multiscale Saliency Detection Using Random Walk With Restart , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[54]  Yuan Yan Tang,et al.  A Local Contrast Method for Small Infrared Target Detection , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[55]  Li Xu,et al.  Hierarchical Image Saliency Detection on Extended CSSD , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Takeo Kanade,et al.  Computer Vision and Image Understanding Computer Vision for Assistive Technologies , 2022 .

[57]  Antonio Torralba,et al.  Top-down control of visual attention in object detection , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[58]  Qingming Huang,et al.  Co-Saliency Detection for RGBD Images Based on Multi-Constraint Feature Matching and Cross Label Propagation , 2017, IEEE Transactions on Image Processing.

[59]  Rongrong Ji,et al.  RGBD Salient Object Detection: A Benchmark and Algorithms , 2014, ECCV.

[60]  Huchuan Lu,et al.  Saliency Detection with Recurrent Fully Convolutional Networks , 2016, ECCV.

[61]  Christof Koch,et al.  Predicting human gaze using low-level saliency combined with face detection , 2007, NIPS.

[62]  Huan Wang,et al.  Small target detection combining regional stability and saliency in a color image , 2017, Multimedia Tools and Applications.

[63]  Fei Zhang,et al.  Edge directional 2D LMS filter for infrared small target detection , 2012 .

[64]  Xuelong Li,et al.  A Review of Co-Saliency Detection Algorithms , 2018 .

[65]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[66]  Huchuan Lu,et al.  Learning to Detect Salient Objects with Image-Level Supervision , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[67]  Xiaochun Cao,et al.  Depth Enhanced Saliency Detection Method , 2014, ICIMCS '14.

[68]  Huchuan Lu,et al.  Salient object detection via bootstrap learning , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[69]  Giovanni Maria Farinella,et al.  An Experimental Analysis of Saliency Detection with Respect to Three Saliency Levels , 2014, ECCV Workshops.

[70]  Bing Zhu,et al.  Effective and robust infrared small target detection with the fusion of polydirectional first order derivative images under facet model , 2015 .