Fast filtering-based temporal saliency detection using Minimum Barrier Distance

In the video salient object detection domain, the optical flow technique is widely used to extract temporal saliency. The big issue with this approach is that the global motion, when it exists, may be wrongly detected as a salient object. To cope with this problem, we propose to filter out the global motion by using the boundary connectivity cue. Firstly, an edge-aware filter called the guided filter is introduced to preprocess the color optical flow map for enhancing object edges. Then the pixel's connectivity to the boundary is achieved by using the minimum barrier distance in the filtered optical flow map, which leads to the effective removal of the global motion. The proposed method is assessed on the popular Seg-Track v2 and Fukuchi datasets and then compared to state-of-the-art methods. The experimental results show that the proposed approach outperforms the existing related methods.

[1]  Nicolas Riche,et al.  Spatio-temporal saliency based on rare model , 2013, 2013 IEEE International Conference on Image Processing.

[2]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[3]  Yunsong Li,et al.  Efficient Coarse-to-Fine Patch Match for Large Displacement Optical Flow , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Radomír Mech,et al.  Minimum Barrier Salient Object Detection at 80 FPS , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[5]  Kimura Akisato,et al.  Saliency-based video segmentation with graph cuts and sequentially updated priors , 2009 .

[6]  Junsong Yuan,et al.  Finding spatio-temporal salient paths for video objects discovery , 2016, J. Vis. Commun. Image Represent..

[7]  Gengyu Ma,et al.  A video saliency detection method based on spatial and motion information , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[8]  Lei Zhang,et al.  A New Spatio-Temporal Saliency-Based Video Object Segmentation , 2016, Cognitive Computation.

[9]  Enhua Wu,et al.  Constant Time Weighted Median Filtering for Stereo Matching and Beyond , 2013, 2013 IEEE International Conference on Computer Vision.

[10]  James M. Rehg,et al.  Video Segmentation by Tracking Many Figure-Ground Segments , 2013, 2013 IEEE International Conference on Computer Vision.

[11]  Nicolas Riche,et al.  Video saliency based on rarity prediction: Hyperaptor , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[12]  Vittorio Ferrari,et al.  Fast Object Segmentation in Unconstrained Video , 2013, 2013 IEEE International Conference on Computer Vision.