Global and Local Saliency Analysis for the Extraction of Residential Areas in High-Spatial-Resolution Remote Sensing Image

Extraction of residential areas plays an important role in remote sensing image processing. Extracted results can be applied to various scenarios, including disaster assessment, urban expansion, and environmental change research. Quality residential areas extracted from a remote sensing image must meet three requirements: well-defined boundaries, uniformly highlighted residential area, and no background redundancy in residential areas. Driven by these requirements, this study proposes a global and local saliency analysis model (GLSA) for the extraction of residential areas in high-spatial-resolution remote sensing images. In the proposed model, a global saliency map based on quaternion Fourier transform (QFT) and a global saliency map based on adaptive directional enhancement lifting wavelet transform (ADE-LWT) are generated along with a local saliency map, all of which are fused into a main saliency map based on complementarities. In order to analyze the correlation among spectrums in the remote sensing image, the phase spectrum information of QFT is used on the multispectral images for producing a global saliency map. To acquire the texture and edge features of different scales and orientations, the coefficients acquired by ADE-LWT are used to construct another global saliency map. To discard redundant backgrounds, the amplitude spectrum of the Fourier transform and the spatial relations among patches are introduced into the panchromatic image to generate the local saliency map. Experimental results indicate that the GLSA model can better define the boundaries of residential areas and achieve complete residential areas than current methods. Furthermore, the GLSA model can prevent redundant backgrounds in residential areas and thus acquire more accurate residential areas.

[1]  Sabine Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  S. Sangwine.  Fourier transforms of colour images using quaternion or hypercomplex, numbers , 1996 .

[3]  Jie Chen,et al.  Image denoising based on iterative generalized cross-validation and fast translation invariant , 2015, J. Vis. Commun. Image Represent..

[4]  Guojin He,et al.  Visual attention based model for target detection in high resolution remote sensing images , 2012, 2012 International Conference on Computer Vision in Remote Sensing.

[5]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Aoxue Li,et al.  Remote Sensing Image Segmentation Based on an Improved 2-D Gradient Histogram and MMAD Model , 2015, IEEE Geoscience and Remote Sensing Letters.

[7]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[8]  Shuang Wang,et al.  Residential area extraction based on saliency analysis for high spatial resolution remote sensing images , 2015, J. Vis. Commun. Image Represent..

[9]  Libao Zhang,et al.  Region-of-Interest Extraction Based on Frequency Domain Analysis and Salient Region Detection for Remote Sensing Image , 2014, IEEE Geoscience and Remote Sensing Letters.

[10]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[11]  Patrick Le Callet,et al.  A coherent computational approach to model bottom-up visual attention , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Adolfo Martínez Usó,et al.  Clustering-Based Hyperspectral Band Selection Using Information Measures , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[13]  L. Durieux,et al.  Advances in Geographic Object-Based Image Analysis with ontologies: A review of main contributions and limitations from a remote sensing perspective , 2013 .

[14]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[15]  Xianchuan Yu,et al.  Detection of regions of interest in a high-spatial-resolution remote sensing image based on an adaptive spatial subsampling visual attention model , 2013 .

[16]  Yu Li,et al.  Automatic Target Detection in High-Resolution Remote Sensing Images Using Spatial Sparse Coding Bag-of-Words Model , 2012, IEEE Geoscience and Remote Sensing Letters.

[17]  Hao Li,et al.  Regions of Interest Detection in Panchromatic Remote Sensing Images Based on Multiscale Feature Fusion , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[18]  Weisi Lin,et al.  A Saliency Detection Model Using Low-Level Features Based on Wavelet Transform , 2013, IEEE Transactions on Multimedia.

[19]  Feng Wu,et al.  Adaptive Directional Lifting-Based Wavelet Transform for Image Coding , 2007, IEEE Transactions on Image Processing.

[20]  Jon Y. Hardeberg,et al.  Saliency for Spectral Image Analysis , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Liming Zhang,et al.  Spatio-temporal Saliency detection using phase spectrum of quaternion fourier transform , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Ioannis Rigas,et al.  Low-Level Visual Saliency With Application on Aerial Imagery , 2013, IEEE Geoscience and Remote Sensing Letters.

[23]  Adhemar Bultheel,et al.  Generalized cross validation for wavelet thresholding , 1997, Signal Process..

[24]  Huadong Guo,et al.  A Global Human Settlement Layer From Optical HR/VHR RS Data: Concept and First Results , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[25]  Aoxue Li,et al.  Region-of-Interest Extraction Based on Saliency Analysis of Co-Occurrence Histogram in High Spatial Resolution Remote Sensing Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  Jun Wang,et al.  A Novel Saliency Detection Method for Lunar Remote Sensing Images , 2014, IEEE Geoscience and Remote Sensing Letters.

[27]  Liangpei Zhang,et al.  A Hybrid Object-Oriented Conditional Random Field Classification Framework for High Spatial Resolution Remote Sensing Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[28]  John A. Richards,et al.  Fast k-NN classification using the cluster-space approach , 2005, IEEE Geoscience and Remote Sensing Letters.

[29]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[30]  Martino Pesaresi,et al.  A Robust Built-Up Area Presence Index by Anisotropic Rotation-Invariant Textural Measure , 2008, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  Ali Borji,et al.  Salient Object Detection: A Benchmark , 2015, IEEE Transactions on Image Processing.

[32]  T. Ell,et al.  Quaternion-Fourier transforms for analysis of two-dimensional linear time-invariant partial differential systems , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[33]  Junwei Han,et al.  Efficient, simultaneous detection of multi-class geospatial targets based on visual saliency modeling and discriminative learning of sparse coding , 2014 .

[34]  Li Pan,et al.  Local Edge Distributions for Detection of Salient Structure Textures and Objects , 2013, IEEE Geosci. Remote. Sens. Lett..

[35]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[36]  John K. Tsotsos,et al.  Saliency Based on Information Maximization , 2005, NIPS.

[37]  Jie Chen,et al.  Region of interest extraction in remote sensing images by saliency analysis with the normal directional lifting wavelet transform , 2016, Neurocomputing.

[38]  Xianchuan Yu,et al.  Multi-scale hybrid saliency analysis for region of interest detection in very high resolution remote sensing images , 2015, Image Vis. Comput..

[39]  Cem Ünsalan,et al.  A Probabilistic Framework to Detect Buildings in Aerial and Satellite Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.