Dempster‐Shafer theory‐based hierarchical saliency detection

This article presents a new saliency detection method based on a hierarchical structure. In order to better capture the key elements in an image, we first construct a three‐layer structure by applying a merging strategy to the image. For different layers, we exploit different methods to detect salient regions. After obtaining initial saliency maps of five layers, we construct a Dempster‐Shafer model to fuse and refine these saliency maps. In the Dempster‐Shafer model, the saliency value of upper layers can provide guidance for saliency detection of lower layers. Finally, we fuse the saliency map of each layer to obtain the final result. Abundant experimental results on two benchmark data sets demonstrate that our method outperforms most of 12 state‐of‐the‐art methods in terms of three popular evaluation criteria, that is, the P‐R curve, the F‐measure, and the mean absolute error.

[1]  Chuiri Zhou Pricing Model for Dual Sales Channel with Promotion Effect Consideration , 2016 .

[2]  Radomír Mech,et al.  Minimum Barrier Salient Object Detection at 80 FPS , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[3]  Huchuan Lu,et al.  Salient object detection via global and local cues , 2015, Pattern Recognit..

[4]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[5]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Jian Sun,et al.  Saliency Optimization from Robust Background Detection , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Qizhi Sun,et al.  Color image quality assessment combining saliency and FSIM , 2013, Other Conferences.

[8]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[9]  Sabine Süsstrunk,et al.  Salient Region Detection and Segmentation , 2008, ICVS.

[10]  Xiaochun Cao,et al.  Structured Saliency Fusion Based on Dempster–Shafer Theory , 2015, IEEE Signal Processing Letters.

[11]  Michael Brady,et al.  Saliency, Scale and Image Description , 2001, International Journal of Computer Vision.

[12]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Lihi Zelnik-Manor,et al.  Context-aware saliency detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Narendra Ahuja,et al.  Robust Visual Tracking Via Consistent Low-Rank Sparse Learning , 2014, International Journal of Computer Vision.

[16]  Huchuan Lu,et al.  Salient object detection via bootstrap learning , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Guillaume-Alexandre Bilodeau,et al.  Multiple Feature Fusion in the Dempster-Shafer Framework for Multi-object Tracking , 2014, 2014 Canadian Conference on Computer and Robot Vision.

[18]  Hongyu Li,et al.  SDSP: A novel saliency detection method by combining simple priors , 2013, 2013 IEEE International Conference on Image Processing.

[19]  Jamal Ghasemi,et al.  Brain MRI segmentation by combining different MRI modalities using Dempster-Shafer theory , 2018, IET Image Process..

[20]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[21]  John K. Tsotsos,et al.  Saliency Based on Information Maximization , 2005, NIPS.

[22]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Liming Zhang,et al.  Spatio-temporal Saliency detection using phase spectrum of quaternion fourier transform , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Nanning Zheng,et al.  Automatic salient object segmentation based on context and shape prior , 2011, BMVC.

[25]  Sabine Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Huchuan Lu,et al.  Bayesian Saliency via Low and mid Level Cues , 2022 .

[27]  Mubarak Shah,et al.  Visual attention detection in video sequences using spatiotemporal cues , 2006, MM '06.

[28]  Liming Zhang,et al.  A Novel Multiresolution Spatiotemporal Saliency Detection Model and Its Applications in Image and Video Compression , 2010, IEEE Transactions on Image Processing.

[29]  Huchuan Lu,et al.  Saliency Detection via Dense and Sparse Reconstruction , 2013, 2013 IEEE International Conference on Computer Vision.

[30]  Weidong Zhao,et al.  Salient Region Detection by Fusing Foreground and Background Cues Extracted from Single Image , 2016 .

[31]  Dewen Hu,et al.  Salient Region Detection Using Diffusion Process on a Two-Layer Sparse Graph , 2017, IEEE Transactions on Image Processing.

[32]  Lihi Zelnik-Manor,et al.  What Makes a Patch Distinct? , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .