Salient object detection from low contrast images based on local contrast enhancing and non-local feature learning

Salient object detection can facilitate numerous applications. Traditional salient object detection models mainly utilize low-level hand-crafted features or high-level deep features. However, they may face great challenges in the nighttime scene, due to the difficulties in extracting well-defined features to represent saliency information from low contrast images. In this paper, we present a salient object detection model based on local contrast enhancing and non-local feature learning. This model extracts non-local feature combines with local features under a unified deep learning framework. Besides, a deeply enhanced network is employed as a preprocessing of the low contrast images to assist our saliency detection model. The key idea of this paper is firstly hierarchically introducing a non-local module with local contrast-processing blocks, to provide a detailed and robust representation of saliency information. Then, an encoder-decoder image-enhanced network with full convolution layers is introduced to process the low contrast images for higher contrast and completer structure. As a minor contribution, this paper contributes a new dataset, including 676 low contrast images for testing our model. Extensive experiments have been conducted in the proposed low contrast image dataset to evaluate the performance of our method. Experimental results indicate that the proposed method yields competitive performance compared to existing state-of-the-art models.

[1]  Hong Zhang,et al.  Salient object detection using a covariance-based CNN model in low-contrast images , 2017, Neural Computing and Applications.

[2]  Jiashi Feng,et al.  Deep Edge Guided Recurrent Residual Learning for Image Super-Resolution. , 2017, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[3]  Xuelong Li,et al.  Spatiochromatic Context Modeling for Color Saliency Analysis , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Nan Mu,et al.  Estimation of Local and Global Superpixel Covariance for Salient Object Detection in Low Contrast Images , 2017, ICMLC.

[5]  Chen Wei,et al.  Deep Retinex Decomposition for Low-Light Enhancement , 2018, BMVC.

[6]  Yizhou Yu,et al.  Visual saliency based on multiscale deep features , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Noel E. O'Connor,et al.  Shallow and Deep Convolutional Networks for Saliency Prediction , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[9]  Jian Sun,et al.  Geodesic Saliency Using Background Priors , 2012, ECCV.

[10]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[11]  Jiajun Lin,et al.  Salient object detection via compactness and objectness cues , 2017, The Visual Computer.

[12]  Ron Kikinis,et al.  Statistical validation of image segmentation quality based on a spatial overlap index. , 2004, Academic radiology.

[13]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Li Tao,et al.  LLCNN: A convolutional neural network for low-light image enhancement , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[15]  Turgay Çelik,et al.  Contextual and Variational Contrast Enhancement , 2011, IEEE Transactions on Image Processing.

[16]  Bing Li,et al.  Salient Object Detection via Structured Matrix Decomposition. , 2016, IEEE transactions on pattern analysis and machine intelligence.

[17]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[18]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[19]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[20]  Stephen Lin,et al.  Object-based RGBD image co-segmentation with mutex constraint , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Lianfa Bai,et al.  Saliency detection via Boolean and foreground in a dynamic Bayesian framework , 2017, The Visual Computer.

[22]  Feng Wu,et al.  Depth-Preserving Stereo Image Retargeting Based on Pixel Fusion , 2017, IEEE Transactions on Multimedia.

[23]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[24]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Xiao-Ping Zhang,et al.  A Weighted Variational Model for Simultaneous Reflectance and Illumination Estimation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Paul L. Rosin,et al.  Intelligent Visual Media Processing: When Graphics Meets Vision , 2017, Journal of Computer Science and Technology.

[27]  Tianming Liu,et al.  Predicting eye fixations using convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Huchuan Lu,et al.  Learning to Promote Saliency Detectors , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[29]  Jia Xu,et al.  Learning to See in the Dark , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[30]  Adam Finkelstein,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, SIGGRAPH 2009.

[31]  Tao Li,et al.  Structure-Measure: A New Way to Evaluate Foreground Maps , 2017, International Journal of Computer Vision.

[32]  Nan Mu,et al.  Optimal Feature Selection for Saliency Seed Propagation in Low Contrast Images , 2018, PCM.

[33]  Ben Wang,et al.  Reverse Attention for Salient Object Detection , 2018, ECCV.

[34]  Yu Li,et al.  LIME: Low-Light Image Enhancement via Illumination Map Estimation. , 2017, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[35]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[36]  Ali Borji,et al.  Adaptive object tracking by learning background context , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[37]  Yi Liu,et al.  Image saliency detection using Gabor texture cues , 2016, Multimedia Tools and Applications.

[38]  Yue Gao,et al.  3-D Object Retrieval and Recognition With Hypergraph Analysis , 2012, IEEE Transactions on Image Processing.

[39]  M. Ali Akber Dewan,et al.  A Dynamic Histogram Equalization for Image Contrast Enhancement , 2007, IEEE Transactions on Consumer Electronics.

[40]  Xiaolong Zhang,et al.  Salient Object Detection in Low Contrast Images via Global Convolution and Boundary Refinement , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[41]  Xin Xu,et al.  Extended Non-local Feature for Visual Saliency Detection in Low Contrast Images , 2018, ECCV Workshops.

[42]  Lihi Zelnik-Manor,et al.  Context-Aware Saliency Detection , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  Yizhou Yu,et al.  Deep Contrast Learning for Salient Object Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Bing Li,et al.  Salient Object Detection via Structured Matrix Decomposition. , 2017, IEEE transactions on pattern analysis and machine intelligence.

[45]  Liang-Tien Chia,et al.  Region-Based Saliency Detection and Its Application in Object Recognition , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[46]  Soumik Sarkar,et al.  LLNet: A deep autoencoder approach to natural low-light image enhancement , 2015, Pattern Recognit..

[47]  Allan Hanbury,et al.  Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool , 2015, BMC Medical Imaging.

[48]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[50]  Ziheng Li,et al.  Hierarchical Features Fusion for Salient Object Detection in Low Contrast Images , 2015, ICIC.

[51]  Paria Mehrani,et al.  Saliency Segmentation based on Learning and Graph Cut Refinement , 2010, BMVC.

[52]  Abhinav Gupta,et al.  Non-local Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[53]  Junjie Cao,et al.  A generalized nonlocal mean framework with object-level cues for saliency detection , 2015, The Visual Computer.

[54]  Zhiming Luo,et al.  Non-local Deep Features for Salient Object Detection , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[55]  Zhuowen Tu,et al.  Deeply Supervised Salient Object Detection with Short Connections , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Lu Ding,et al.  A robust visual tracking method via local feature extraction and saliency detection , 2019, The Visual Computer.

[57]  Zhe Wu,et al.  Cascaded Partial Decoder for Fast and Accurate Salient Object Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[58]  Xiaogang Wang,et al.  Saliency detection by multi-context deep learning , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[59]  Ralph R. Martin,et al.  Internet visual media processing: a survey with graphics and vision applications , 2013, The Visual Computer.

[60]  Peng Jiang,et al.  Salient Region Detection by UFO: Uniqueness, Focusness and Objectness , 2013, 2013 IEEE International Conference on Computer Vision.

[61]  Chao Gao,et al.  BASNet: Boundary-Aware Salient Object Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[62]  Yueting Zhuang,et al.  DeepSaliency: Multi-Task Deep Neural Network Model for Salient Object Detection , 2015, IEEE Transactions on Image Processing.

[63]  Yu Li,et al.  LIME: Low-Light Image Enhancement via Illumination Map Estimation , 2017, IEEE Transactions on Image Processing.

[64]  Shuicheng Yan,et al.  Deep Edge Guided Recurrent Residual Learning for Image Super-Resolution , 2016, IEEE Transactions on Image Processing.

[65]  Xin Xu,et al.  Finding autofocus region in low contrast surveillance images using CNN-based saliency algorithm , 2019, Pattern Recognit. Lett..