Salient object detection in hyperspectral imagery using multi-scale spectral-spatial gradient

Abstract Spectra in hyperspectral images (HSIs) benefit identifying objects from cluttered background, thus increasing effort has been made for salient object detection in HSIs. However, most existing methods are sensitive to the spectral variation brought by uneven illumination during imaging as well as objects of various scales. To address this problem, we propose a novel multi-scale spectral-spatial gradient based salient object detection method for HSIs. Through constructing a region based hierarchical structure, we obtain various saliency maps by evaluating each region in multiple scales with a spectra-spatial gradient saliency model, which not only depicts the global region contrast with the spectral gradient, but also exploits the spatial gradient to highlight regions with semantic edges. Given these saliency maps, the final result is given as their weighted summation. The proposed method is robust to spectral variation and can adaptively detect objects of various scales. Two prior models are further integrated into the proposed saliency model to enhance the detection accuracy. Experimental results on real HSIs validate the effectiveness of the proposed method.

[1]  Bo Du,et al.  Beyond the Sparsity-Based Target Detector: A Hybrid Sparsity and Statistics-Based Detector for Hyperspectral Images , 2016, IEEE Transactions on Image Processing.

[2]  Ling Shao,et al.  Consistent Video Saliency Using Local Gradient Flow Optimization and Global Refinement , 2015, IEEE Transactions on Image Processing.

[3]  Xuelong Li,et al.  Lazy Random Walks for Superpixel Segmentation , 2014, IEEE Transactions on Image Processing.

[4]  Wei Wei,et al.  Salient object detection in hyperspectral imagery using spectral gradient contrast , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[5]  Deyu Meng,et al.  Co-Saliency Detection via a Self-Paced Multiple-Instance Learning Framework , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Bo Du,et al.  A Discriminative Metric Learning Based Anomaly Detection Method , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Feiping Nie,et al.  Revisiting Co-Saliency Detection: A Novel Approach Based on Two-Stage Multi-View Spectral Rotation Co-clustering , 2017, IEEE Transactions on Image Processing.

[8]  D. Foster,et al.  Frequency of metamerism in natural scenes , 2006 .

[9]  Dong Xu,et al.  Advanced Deep-Learning Techniques for Salient and Category-Specific Object Detection: A Survey , 2018, IEEE Signal Processing Magazine.

[10]  Lei Zhang,et al.  Structured Sparse Coding-Based Hyperspectral Imagery Denoising With Intracluster Filtering , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Jun Zhou,et al.  Salient object detection in hyperspectral imagery , 2013, 2013 IEEE International Conference on Image Processing.

[12]  Ayan Chakrabarti,et al.  Statistics of real-world hyperspectral images , 2011, CVPR 2011.

[13]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Ye Zhang,et al.  Content-based onboard compression for remote sensing images , 2016, Neurocomputing.

[15]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[16]  Qi Tian,et al.  Salient target detection in hyperspectral images using spectral saliency , 2015, 2015 IEEE China Summit and International Conference on Signal and Information Processing (ChinaSIP).

[17]  Ling Shao,et al.  Correspondence Driven Saliency Transfer , 2016, IEEE Transactions on Image Processing.

[18]  Wei Wei,et al.  An associative saliency segmentation method for infrared targets , 2013, 2013 IEEE International Conference on Image Processing.

[19]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[20]  Jon Y. Hardeberg,et al.  Saliency for Spectral Image Analysis , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Ardeshir Goshtasby,et al.  On the Canny edge detector , 2001, Pattern Recognit..

[22]  Ruigang Yang,et al.  Saliency-Aware Video Object Segmentation , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Andrew Zisserman,et al.  Convolutional Two-Stream Network Fusion for Video Action Recognition , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Junwei Han,et al.  A Unified Metric Learning-Based Framework for Co-Saliency Detection , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Huchuan Lu,et al.  Ranking Saliency , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Nanning Zheng,et al.  Video Object Discovery and Co-Segmentation with Extremely Weak Supervision , 2017, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Hao Chen,et al.  CNNs-Based RGB-D Saliency Detection via Cross-View Transfer and Multiview Fusion , 2017 .

[29]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Ling Shao,et al.  Video Salient Object Detection via Fully Convolutional Networks , 2017, IEEE Transactions on Image Processing.

[31]  Jing Liu,et al.  Object co-segmentation via salient and common regions discovery , 2016, Neurocomputing.

[32]  Bo Du,et al.  Target detection based on a dynamic subspace , 2014, Pattern Recognit..

[33]  Xuelong Li,et al.  Detection of Co-salient Objects by Looking Deep and Wide , 2016, International Journal of Computer Vision.

[34]  Fatih Murat Porikli,et al.  Saliency-aware geodesic video object segmentation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[36]  Xiaojun Chang,et al.  Revealing Event Saliency in Unconstrained Video Collection , 2017, IEEE Transactions on Image Processing.

[37]  Lei Dai,et al.  Deep Salient Object Detection via Hierarchical Network Learning , 2017, ICONIP.

[38]  Kwan-Liu Ma,et al.  Stereoscopic Thumbnail Creation via Efficient Stereo Saliency Detection , 2017, IEEE Transactions on Visualization and Computer Graphics.

[39]  Wei Wei,et al.  Dictionary Learning for Promoting Structured Sparsity in Hyperspectral Compressive Sensing , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Yael Pritch,et al.  Saliency filters: Contrast based filtering for salient region detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Xiaoqiang Lu,et al.  Remote Sensing Image Scene Classification: Benchmark and State of the Art , 2017, Proceedings of the IEEE.

[42]  Bo Du,et al.  PLTD: Patch-Based Low-Rank Tensor Decomposition for Hyperspectral Images , 2017, IEEE Transactions on Multimedia.

[43]  Wei Wei,et al.  Exploring Structured Sparsity by a Reweighted Laplace Prior for Hyperspectral Compressive Sensing , 2016, IEEE Transactions on Image Processing.

[44]  Yuan Yan Tang,et al.  Visual saliency detection with center shift , 2013, Neurocomputing.

[45]  Junwei Han,et al.  DHSNet: Deep Hierarchical Saliency Network for Salient Object Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Minho Lee,et al.  Affective saliency map considering psychological distance , 2011, Neurocomputing.

[47]  Yoshihiko Gotoh,et al.  A unified spatio-temporal human body region tracking approach to action recognition , 2015, Neurocomputing.

[48]  Qi Wang,et al.  Fast Hyperspectral Anomaly Detection via High-Order 2-D Crossing Filter , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Yizhou Yu,et al.  Deep Contrast Learning for Salient Object Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).