Water flow driven salient object detection at 180 fps

We propose one efficient approximate MBD computation method which shows higher performance in both speed and accuracy.Based on water flow driven MBD, a fast salient object detection method is proposed which achieve 180 fps speed.The performance of proposed saliency detection method outperforms other MBD based methods and state-of-the-art methods. Minimum Barrier Distance (MBD) is one recently proposed saliency measure which provides more robust result than the geodesic distance. Due to accurate pixel-wise MBD computation needs high time expenditure, approximate implementation with raster scan and minimum spanning tree (MST) are proposed recently. Inspired by the natural phenomena of the water flow, we propose one efficient approximate method water flow driven MBD. Seed pixels (such as image boundary in salient object detection) are assumed as source of water, the water can flow from source pixels to other pixels with different priority which determined by MBD cost, lower cost means flow earlier. MBD of each pixel can be computed during processing of water flow. Our MBD computation shows higher performance in terms both speed and accuracy. Proposed MBD computation only needs visit image once, while raster based MBD needs scan image three times, MST based MBD needs traversal on image twice and additionally needs time to construct a tree. Compared with two previous MBD approximation algorithm, our computation speed increased by 2.4 times and 5 times, while approximation error declined by 50% and 80%. Based on our fast MBD computation, a fast salient object detection method is also proposed. The accuracy of proposed method outperforms other MBD based methods, and shows better performance than the other state-of-the-art methods. The proposed method achieves 180fps speed performance on four public datasets. In state-of-the-art methods, the highest speed performance is about 52fps, our method shows 3.5 times speed improvement.

[1]  Jian Sun,et al.  Saliency Optimization from Robust Background Detection , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  F. Meyer,et al.  Color image segmentation , 1992 .

[3]  Jian Sun,et al.  Geodesic Saliency Using Background Priors , 2012, ECCV.

[4]  Minglun Gong,et al.  Unsupervised hierarchical image segmentation through fuzzy entropy maximization , 2017, Pattern Recognit..

[5]  Radomír Mech,et al.  Minimum Barrier Salient Object Detection at 80 FPS , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Huchuan Lu,et al.  Saliency Detection via Absorbing Markov Chain , 2013, 2013 IEEE International Conference on Computer Vision.

[8]  Lihi Zelnik-Manor,et al.  Context-aware saliency detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Huchuan Lu,et al.  Salient Object Detection via Multiple Instance Learning , 2017, IEEE Transactions on Image Processing.

[10]  Ying Wu,et al.  A unified approach to salient object detection via low rank matrix recovery , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[12]  Nanning Zheng,et al.  Automatic salient object segmentation based on context and shape prior , 2011, BMVC.

[13]  James M. Rehg,et al.  The Secrets of Salient Object Segmentation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Luc Vincent,et al.  Morphological grayscale reconstruction in image analysis: applications and efficient algorithms , 1993, IEEE Trans. Image Process..

[15]  Thomas Deselaers,et al.  Measuring the Objectness of Image Windows , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Liming Zhang,et al.  A Novel Multiresolution Spatiotemporal Saliency Detection Model and Its Applications in Image and Video Compression , 2010, IEEE Transactions on Image Processing.

[17]  Dewen Hu,et al.  Salient Region Detection via Integrating Diffusion-Based Compactness and Local Contrast , 2015, IEEE Transactions on Image Processing.

[18]  Matthew H Tong,et al.  SUN: Top-down saliency using natural statistics , 2009, Visual cognition.

[19]  Chanho Jung,et al.  A Unified Spectral-Domain Approach for Saliency Detection and Its Application to Automatic Object Segmentation , 2012, IEEE Transactions on Image Processing.

[20]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[21]  Huchuan Lu,et al.  Salient object detection via global and local cues , 2015, Pattern Recognit..

[22]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[23]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Shao-Yi Chien,et al.  Real-Time Salient Object Detection with a Minimum Spanning Tree , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[26]  Huchuan Lu,et al.  Saliency Detection via Dense and Sparse Reconstruction , 2013, 2013 IEEE International Conference on Computer Vision.

[27]  Nanning Zheng,et al.  Automatic salient object extraction with contextual cue , 2011, 2011 International Conference on Computer Vision.

[28]  Paul L. Rosin A simple method for detecting salient regions , 2009, Pattern Recognit..

[29]  Weiqiang Wang,et al.  Detecting Salient Objects via Color and Texture Compactness Hypotheses , 2016, IEEE Transactions on Image Processing.

[30]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  B. S. Manjunath,et al.  Color image segmentation , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[32]  Li Xu,et al.  Hierarchical Image Saliency Detection on Extended CSSD , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Huchuan Lu,et al.  Saliency Region Detection Based on Markov Absorption Probabilities , 2015, IEEE Transactions on Image Processing.

[34]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[35]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[36]  Huchuan Lu,et al.  Bayesian Saliency via Low and mid Level Cues , 2022 .

[37]  Mubarak Shah,et al.  Visual attention detection in video sequences using spatiotemporal cues , 2006, MM '06.

[38]  Shiguang Shan,et al.  Adaptive Partial Differential Equation Learning for Visual Saliency Detection , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Laurent Itti,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Rapid Biologically-inspired Scene Classification Using Features Shared with Visual Attention , 2022 .

[40]  Vibhav Vineet,et al.  Efficient Salient Region Detection with Soft Image Abstraction , 2013, 2013 IEEE International Conference on Computer Vision.

[41]  Punam K. Saha,et al.  The minimum barrier distance , 2013, Comput. Vis. Image Underst..

[42]  Ali Borji,et al.  State-of-the-Art in Visual Attention Modeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Ming-Hsuan Yang,et al.  Top-down visual saliency via joint CRF and dictionary learning , 2012, CVPR.

[44]  Yu-Wing Tai,et al.  Salient Region Detection via High-Dimensional Color Transform and Local Spatial Support , 2014, IEEE Transactions on Image Processing.

[45]  Weixing Wang,et al.  Efficient multilevel image segmentation through fuzzy entropy maximization and graph cut optimization , 2014, Pattern Recognit..

[46]  Huchuan Lu,et al.  Ranking Saliency , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Peng Jiang,et al.  Salient Region Detection by UFO: Uniqueness, Focusness and Objectness , 2013, 2013 IEEE International Conference on Computer Vision.

[48]  Cordelia Schmid,et al.  Discriminative spatial saliency for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[50]  Pietro Perona,et al.  Selective visual attention enables learning and recognition of multiple objects in cluttered scenes , 2005, Comput. Vis. Image Underst..

[51]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  Ali Borji,et al.  Salient Object Detection: A Benchmark , 2015, IEEE Transactions on Image Processing.

[53]  Punam K. Saha,et al.  Efficient algorithm for finding the exact minimum barrier distance , 2014, Comput. Vis. Image Underst..