A Three-Pathway Psychobiological Framework of Salient Object Detection Using Stereoscopic Technology

Saliency detection, finding the most important parts of an image, has become increasingly popular in computer vision. Existing proposal methods are mostly based on color information, which may not be effective for cluttered backgrounds. We propose a new algorithm leveraging stereopsis to generate optical flow which can obtain addition cue (depth cue) to get the final saliency map. The proposed framework consists of three pathways. The first pathway eliminates the background based on cellular automata. The second pathway gets the optical flow and color flow saliency map. The third pathway calculates a coarse saliency map. Finally, we fuse these three pathways to generate the final saliency map. Besides, we construct a new high-quality dataset with the complex scene to make computer challenge human vision. Experimental results on our dataset and another three popular datasets demonstrate that our method is superior to the existing methods in terms of robustness.

[1]  Ronggang Wang,et al.  A Multilayer Backpropagation Saliency Detection Algorithm Based on Depth Mining , 2017, CAIP.

[2]  Heinz Hügli,et al.  Computing visual attention from scene depth , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[3]  Shi-Min Hu,et al.  SalientShape: group saliency in image collections , 2013, The Visual Computer.

[4]  Pascal Fua,et al.  Supervoxel-Based Segmentation of Mitochondria in EM Image Stacks With Learned Shape Features , 2012, IEEE Transactions on Medical Imaging.

[5]  Xiaochun Cao,et al.  Depth Enhanced Saliency Detection Method , 2014, ICIMCS '14.

[6]  Ronggang Wang,et al.  Salient Object Detection with Complex Scene Based on Cognitive Neuroscience , 2017, 2017 IEEE Third International Conference on Multimedia Big Data (BigMM).

[7]  Yang Liu,et al.  Depth-aware salient object detection using anisotropic center-surround difference , 2015, Signal Process. Image Commun..

[8]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Tongwei Ren,et al.  Salient object detection for RGB-D image via saliency evolution , 2016, 2016 IEEE International Conference on Multimedia and Expo (ICME).

[10]  Rongrong Ji,et al.  RGBD Salient Object Detection: A Benchmark and Algorithms , 2014, ECCV.

[11]  Laurent Itti,et al.  Automatic foveation for video compression using a neurobiological model of visual attention , 2004, IEEE Transactions on Image Processing.

[12]  Danica Kragic,et al.  Active 3D Segmentation through Fixation of Previously Unseen Objects , 2010, BMVC.

[13]  Huchuan Lu,et al.  Inner and Inter Label Propagation: Salient Object Detection in the Wild , 2015, IEEE Transactions on Image Processing.

[14]  Huchuan Lu,et al.  Saliency detection via Cellular Automata , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Li Xu,et al.  Hierarchical Image Saliency Detection on Extended CSSD , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Nannan Li,et al.  An Innovative Saliency Detection Framework with an Example of Image Montage , 2017, SAWACMMM '17.