RGB-D Salient Object Detection via Minimum Barrier Distance Transform and Saliency Fusion

Automatic detection of salient objects in images has gained its popularity in computer vision field for its usage in numerous vision tasks in recent years. Depth information plays an important role in the human vision system while it is underutilized in most existing two-dimensional (2-D) saliency detection methods. In this letter, a multistage salient object detection framework via minimum barrier distance transform and saliency fusion based on multilayer cellular automata (MCA) is proposed. First, we independently generate the 3-D spatial prior, depth bias, and RGB-produced and depth-induced saliency maps. Next, the two saliency maps are weighted by depth bias to obtain two initial maps. Then, we adopt a saliency optimization step to generate more precise depth-induced saliency map. Moreover, the initial RGB-produced and the optimized depth-induced maps are further fused with 3-D spatial prior. Finally, we utilize MCA to fuse all saliency maps generated previously and obtain the final saliency result with complete salient object. The proposed method is evaluated on the publicly available benchmark dataset, RGBD1000. Compared to several state-of-the-art 2-D and depth-aware approaches, the experimental results demonstrate the effectiveness and superiority of our method, which can accurately detect the salient objects from RGB-D images, and has the most satisfactory overall performance.

[1]  Haibin Ling,et al.  Scale and Object Aware Image Thumbnailing , 2013, International Journal of Computer Vision.

[2]  Giovanni Maria Farinella,et al.  An Experimental Analysis of Saliency Detection with Respect to Three Saliency Levels , 2014, ECCV Workshops.

[3]  Tongwei Ren,et al.  Salient object detection for RGB-D image via saliency evolution , 2016, 2016 IEEE International Conference on Multimedia and Expo (ICME).

[4]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[6]  Peng Jiang,et al.  Salient Region Detection by UFO: Uniqueness, Focusness and Objectness , 2013, 2013 IEEE International Conference on Computer Vision.

[7]  Ling Shao,et al.  Enhanced Computer Vision With Microsoft Kinect Sensor: A Review , 2013, IEEE Transactions on Cybernetics.

[8]  Rongrong Ji,et al.  RGBD Salient Object Detection: A Benchmark and Algorithms , 2014, ECCV.

[9]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[10]  Andreas Zell,et al.  Salient regions detection for indoor robots using RGB-D data , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Ling Shao,et al.  Cosaliency Detection Based on Intrasaliency Prior Transfer and Deep Intersaliency Mining , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Jingfan Guo,et al.  Salient object detection in RGB-D image based on saliency fusion and propagation , 2015, ICIMCS '15.

[13]  Jian Sun,et al.  Saliency Optimization from Robust Background Detection , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Xiaogang Wang,et al.  Unsupervised Salience Learning for Person Re-identification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Mengke Huang,et al.  RGBD Co-saliency Detection via Bagging-Based Clustering , 2016, IEEE Signal Processing Letters.

[16]  Harish Katti,et al.  Depth Matters: Influence of Depth Cues on Visual Saliency , 2012, ECCV.

[17]  Michael Ying Yang,et al.  Exploiting global priors for RGB-D saliency detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[18]  Huchuan Lu,et al.  Saliency Detection via Dense and Sparse Reconstruction , 2013, 2013 IEEE International Conference on Computer Vision.

[19]  Huchuan Lu,et al.  Inner and Inter Label Propagation: Salient Object Detection in the Wild , 2015, IEEE Transactions on Image Processing.

[20]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Li Xu,et al.  Hierarchical Saliency Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Giovanni Maria Farinella,et al.  Saliency-Based Selection of Gradient Vector Flow Paths for Content Aware Image Resizing , 2014, IEEE Transactions on Image Processing.

[23]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[24]  Huchuan Lu,et al.  Saliency Detection via Graph-Based Manifold Ranking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Huchuan Lu,et al.  Saliency detection via Cellular Automata , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Yu-Wing Tai,et al.  Salient Region Detection via High-Dimensional Color Transform , 2014, CVPR.

[27]  Sabine Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[29]  Jian Sun,et al.  Geodesic Saliency Using Background Priors , 2012, ECCV.

[30]  Radomír Mech,et al.  Minimum Barrier Salient Object Detection at 80 FPS , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[31]  Liang-Tien Chia,et al.  Region-Based Saliency Detection and Its Application in Object Recognition , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Ran Ju,et al.  Depth saliency based on anisotropic center-surround difference , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[33]  Peng Jiang,et al.  Generic Promotion of Diffusion-Based Salient Object Detection , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[34]  K. Madhava Krishna,et al.  Depth really Matters: Improving Visual Salient Region Detection with Depth , 2013, BMVC.

[35]  Lihi Zelnik-Manor,et al.  How to Evaluate Foreground Maps , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Xiaochun Cao,et al.  Depth Enhanced Saliency Detection Method , 2014, ICIMCS '14.

[37]  Xueqing Li,et al.  Leveraging stereopsis for saliency analysis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Qi Zhang,et al.  Rolling Guidance Filter , 2014, ECCV.