Saliency Analysis via Hyperparameter Sparse Representation and Energy Distribution Optimization for Remote Sensing Images

In an effort to detect the region-of-interest (ROI) of remote sensing images with complex data distributions, sparse representation based on dictionary learning has been utilized, and has proved able to process high dimensional data adaptively and efficiently. In this paper, a visual attention model uniting hyperparameter sparse representation with energy distribution optimization is proposed for analyzing saliency and detecting ROIs in remote sensing images. A dictionary learning algorithm based on biological plausibility is adopted to generate the sparse feature space. This method only focuses on finite features, instead of various considerations of feature complexity and massive parameter tuning in other dictionary learning algorithms. In another portion of the model, aimed at obtaining the saliency map, the contribution of each feature is evaluated in a sparse feature space and the coding length of each feature is accumulated. Finally, we calculate the segmentation threshold using the saliency map and obtain the binary mask to separate the ROI from the original images. Experimental results show that the proposed model achieves better performance in saliency analysis and ROI detection for remote sensing images.

[1]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[2]  Laurent Itti,et al.  Saliency and Gist Features for Target Detection in Satellite Images , 2011, IEEE Transactions on Image Processing.

[3]  Harry Shum,et al.  Picture Collage , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[4]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[5]  Liming Zhang,et al.  Spatio-temporal Saliency detection using phase spectrum of quaternion fourier transform , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[7]  Libao Zhang,et al.  Region-of-Interest Extraction Based on Frequency Domain Analysis and Salient Region Detection for Remote Sensing Image , 2014, IEEE Geoscience and Remote Sensing Letters.

[8]  Lei Guo,et al.  An Object-Oriented Visual Saliency Detection Framework Based on Sparse Coding Representations , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Xiaohua Tong,et al.  Urban Land Cover Classification With Airborne Hyperspectral Data: What Features to Use? , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  D.D. Giusto,et al.  Region-based remote-sensing image compression in the wavelet domain , 1999, IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS'99 (Cat. No.99CH36293).

[11]  Aoxue Li,et al.  Region-of-Interest Extraction Based on Saliency Analysis of Co-Occurrence Histogram in High Spatial Resolution Remote Sensing Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[13]  Lie Lu,et al.  A generic framework of user attention model and its application in video summarization , 2005, IEEE Trans. Multim..

[14]  Liqing Zhang,et al.  Dynamic visual attention: searching for coding length increments , 2008, NIPS.

[15]  Jie Jiang,et al.  Remote Sensing Image Registration with Line Segments and Their Intersections , 2017, Remote. Sens..

[16]  Youkyung Han,et al.  An Area-Based Image Fusion Scheme for the Integration of SAR and Optical Satellite Imagery , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  Guifeng Zhang,et al.  A Scale-Synthesis Method for High Spatial Resolution Remote Sensing Image Segmentation , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Mihai Datcu,et al.  Salient Remote Sensing Image Segmentation Based on Rate-Distortion Measure , 2009, IEEE Geoscience and Remote Sensing Letters.

[19]  Ali Borji,et al.  Exploiting local and global patch rarities for saliency detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Liangpei Zhang,et al.  A Novel Clustering-Based Feature Representation for the Classification of Hyperspectral Imagery , 2014, Remote. Sens..

[21]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[22]  Amin Sedaghat,et al.  Uniform Robust Scale-Invariant Feature Matching for Optical Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Touradj Ebrahimi,et al.  The JPEG 2000 still image compression standard , 2001, IEEE Signal Process. Mag..

[24]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[25]  Michael Möller,et al.  An Adaptive IHS Pan-Sharpening Method , 2010, IEEE Geoscience and Remote Sensing Letters.

[26]  Hao Li,et al.  Regions of Interest Detection in Panchromatic Remote Sensing Images Based on Multiscale Feature Fusion , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[27]  John H. R. Maunsell,et al.  Feature-based attention in visual cortex , 2006, Trends in Neurosciences.

[28]  D. Tolhurst,et al.  Characterizing the sparseness of neural codes , 2001, Network.

[29]  Pingkun Yan,et al.  Visual Saliency by Selective Contrast , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Lihi Zelnik-Manor,et al.  Context-Aware Saliency Detection , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  H. Basford,et al.  Optimal eye movement strategies in visual search , 2005 .

[32]  Jiquan Ngiam,et al.  Sparse Filtering , 2011, NIPS.

[33]  Ke Huang,et al.  Sparse Representation for Signal Classification , 2006, NIPS.

[34]  Lihi Zelnik-Manor,et al.  Puzzle‐like Collage , 2010, Comput. Graph. Forum.

[35]  Jon Atli Benediktsson,et al.  Directional mathematical morphology for the detection of the road network in Very High Resolution remote sensing images , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[36]  Adolfo Martínez Usó,et al.  Clustering-Based Hyperspectral Band Selection Using Information Measures , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Aoxue Li,et al.  Remote Sensing Image Segmentation Based on an Improved 2-D Gradient Histogram and MMAD Model , 2015, IEEE Geoscience and Remote Sensing Letters.

[38]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[39]  Weisi Lin,et al.  A Saliency Detection Model Using Low-Level Features Based on Wavelet Transform , 2013, IEEE Transactions on Multimedia.

[40]  Jon Atli Benediktsson,et al.  Advanced directional mathematical morphology for the detection of the road network in very high resolution remote sensing images , 2010, Pattern Recognit. Lett..

[41]  Aoxue Li,et al.  Global and Local Saliency Analysis for the Extraction of Residential Areas in High-Spatial-Resolution Remote Sensing Image , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Jie Chen,et al.  Region-of-Interest Coding Based on Saliency Detection and Directional Wavelet for Remote Sensing Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[43]  Lu Li,et al.  Refinement of Hyperspectral Image Classification with Segment-Tree Filtering , 2017, Remote. Sens..

[44]  Quan Pan,et al.  Dynamic evidential reasoning for change detection in remote sensing images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Xuelong Li,et al.  Saliency Detection by Multiple-Instance Learning , 2013, IEEE Transactions on Cybernetics.

[46]  Jie Chen,et al.  Joint Multi-Image Saliency Analysis for Region of Interest Detection in Optical Multispectral Remote Sensing Images , 2016, Remote. Sens..

[47]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[48]  Joseph W. Goodman,et al.  A mathematical analysis of the DCT coefficient distributions for images , 2000, IEEE Trans. Image Process..

[49]  Simone Frintrop,et al.  Center-surround divergence of feature statistics for salient object detection , 2011, 2011 International Conference on Computer Vision.

[50]  Yihua Tan,et al.  Airport Detection From Large IKONOS Images Using Clustered SIFT Keypoints and Region Information , 2011, IEEE Geoscience and Remote Sensing Letters.

[51]  Daniele D. Giusto,et al.  Region-based remote sensing image compression in wavelet domain using free angle segmentation model , 2002 .

[52]  Jiang Li,et al.  Dimensionality reduction of hyperspectral data using discrete wavelet transform feature extraction , 2002, IEEE Trans. Geosci. Remote. Sens..