Salient object detection in complex scenes via D-S evidence theory based region classification

In complex scenes, multiple objects are often concealed in cluttered backgrounds. Their saliency is difficult to be detected by using conventional methods, mainly because single color contrast can not shoulder the mission of saliency measure; other image features should be involved in saliency detection to obtain more accurate results. Using Dempster-Shafer (D-S) evidence theory based region classification, a novel method is presented in this paper. In the proposed framework, depth feature information extracted from a coarse map is employed to generate initial feature evidences which indicate the probabilities of regions belonging to foreground or background. Based on the D-S evidence theory, both uncertainty and imprecision are modeled, and the conflicts between different feature evidences are properly resolved. Moreover, the method can automatically determine the mass functions of the two-stage evidence fusion for region classification. According to the classification result and region relevance, a more precise saliency map can then be generated by manifold ranking. To further improve the detection results, a guided filter is utilized to optimize the saliency map. Both qualitative and quantitative evaluations on three publicly challenging benchmark datasets demonstrate that the proposed method outperforms the contrast state-of-the-art methods, especially for detection in complex scenes.

[1]  Liang Lin,et al.  Deep Joint Task Learning for Generic Object Extraction , 2014, NIPS.

[2]  Ye Qing Evidence combination method based on the weight coefficients and the confliction probability distribution , 2006 .

[3]  Tzu-Chao Lin Decision-based filter based on SVM and evidence theory for image noise removal , 2011, Neural Computing and Applications.

[4]  Li Xu,et al.  Hierarchical Image Saliency Detection on Extended CSSD , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  R. D Tang,et al.  Saliency Detection Integrated with Depth Information , 2015 .

[6]  Liang Lin,et al.  PISA: Pixelwise Image Saliency by Aggregating Complementary Appearance Contrast Measures with Spatial Priors , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Chun Chen,et al.  Low-level and high-level prior learning for visual saliency estimation , 2014, Inf. Sci..

[8]  Jun Kong,et al.  Region contrast and supervised locality-preserving projection-based saliency detection , 2014, The Visual Computer.

[9]  Jian Sun,et al.  Geodesic Saliency Using Background Priors , 2012, ECCV.

[10]  Sabine Süsstrunk,et al.  Saliency detection using maximum symmetric surround , 2010, 2010 IEEE International Conference on Image Processing.

[11]  Tsuyoshi Ando,et al.  Majorization relations for Hadamard products , 1995 .

[12]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[13]  Huchuan Lu,et al.  Salient object detection via bootstrap learning , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Yao Lu,et al.  Learning attention map from images , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  He Tang,et al.  Prediction of Human Eye Fixation by a Single Filter , 2017, J. Signal Process. Syst..

[16]  Lihi Zelnik-Manor,et al.  What Makes a Patch Distinct? , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Huchuan Lu,et al.  Saliency Detection with Multi-Scale Superpixels , 2014, IEEE Signal Processing Letters.

[18]  David A. Clausi,et al.  Statistical Textural Distinctiveness for Salient Region Detection in Natural Images , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Yongdong Zhang,et al.  Salient region detection for complex background images using integrated features , 2014, Inf. Sci..

[20]  Antoni B. Chan,et al.  Adaptive figure-ground classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Lotfi A. Zadeh,et al.  A Simple View of the Dempster-Shafer Theory of Evidence and Its Implication for the Rule of Combination , 1985, AI Mag..

[22]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[23]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[24]  Jian-Huang Lai,et al.  Complex Background Subtraction by Pursuing Dynamic Spatio-Temporal Models , 2014, IEEE Transactions on Image Processing.

[25]  S. Süsstrunk,et al.  SLIC Superpixels ? , 2010 .

[26]  Ronen Basri,et al.  Image Segmentation by Probabilistic Bottom-Up Aggregation and Cue Integration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Ye Xiu A New Combination Rules of Evidence Theory , 2000 .

[29]  Arthur P. Dempster,et al.  Upper and Lower Probabilities Induced by a Multivalued Mapping , 1967, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[30]  Shi-Min Hu,et al.  SalientShape: group saliency in image collections , 2013, The Visual Computer.

[31]  Lihi Zelnik-Manor,et al.  Context-Aware Saliency Detection , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Amir Nakib,et al.  Hybrid framework based on evidence theory for blood cell image segmentation , 2014, Medical Imaging.

[33]  James M. Rehg,et al.  The Secrets of Salient Object Segmentation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Frédo Durand,et al.  Learning to predict where humans look , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[35]  Huchuan Lu,et al.  Graph-Regularized Saliency Detection With Convex-Hull-Based Center Prior , 2013, IEEE Signal Processing Letters.

[36]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Jian Sun,et al.  Saliency Optimization from Robust Background Detection , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Pei-Yin Chen,et al.  A Low-Cost Hardware Architecture for Illumination Adjustment in Real-Time Applications , 2015, IEEE Transactions on Intelligent Transportation Systems.

[39]  Huchuan Lu,et al.  Saliency Detection via Graph-Based Manifold Ranking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Jiri Matas,et al.  State of the Journal , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Bo Wang,et al.  Efficient combination rule of evidence theory , 2001, International Symposium on Multispectral Image Processing and Pattern Recognition.

[42]  N. H. C. Yung,et al.  Sub-scene generation: A step towards complex scene understanding , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[43]  Jingdong Wang,et al.  Salient Object Detection: A Discriminative Regional Feature Integration Approach , 2013, International Journal of Computer Vision.

[44]  Min Xu,et al.  Saliency detection with color contrast based on boundary information and neighbors , 2014, The Visual Computer.

[45]  Chun Qi,et al.  Two-stage salient region detection by exploiting multiple priors , 2014, J. Vis. Commun. Image Represent..

[46]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[47]  S. B. Rao,et al.  Evidence theoretic classification of ballistic missiles , 2015, Appl. Soft Comput..

[48]  Lihi Zelnik-Manor,et al.  Saliency for image manipulation , 2013, The Visual Computer.

[49]  Simone Frintrop,et al.  Traditional saliency reloaded: A good old model in new shape , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  Xiangping Sun,et al.  Saliency detection using hierarchical manifold learning , 2015, Neurocomputing.

[51]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[52]  Gangyao Kuang,et al.  Target Recognition via Information Aggregation Through Dempster–Shafer's Evidence Theory , 2015, IEEE Geoscience and Remote Sensing Letters.

[53]  Tiejun Huang,et al.  Automatic interesting object extraction from images using complementary saliency maps , 2010, ACM Multimedia.