Deep Spectral-Spatial Feature Extraction Based on DCGAN for Hyperspectral Image Retrieval

The hyperspectral images are represented as an image cube, which image the same ground object with several tens to hundreds of spectral bands from ultraviolet to the microwave range. Content-Based Image Retrieval (CBIR) for hyperspectral images has been explored in recent years. However, it is still a concern and challenging task to extract a highly descriptive feature to contribute to improve the performance of hyperspectral image retrieval. At present, deep learning is a new research area of machine learning, which can extract more effective deep features by using a cascade of many layers of nonlinear processing units. In this paper, a deep spectral-spatial feature extraction method is proposed based on Deep Convolutional Generative Adversarial Networks (DCGAN) for hyperspectral image retrieval. Firstly, spectral vector is extracted by selecting manually pure pixels from hyperspectral image. Then spatial vector is extracted by selecting manually the neighbor pixels of pure pixels from principal bands after reducing the dimensionality of hyperspectral images with one-bit (1BT) transform. Spectral-spatial vector as training samples is obtained by combining spectral vector with spatial vector by using Vector Stacking (VS) approach. After training DCGAN model, deep spectral-spatial feature is extracted to further apply into hyperspectral retrieval. Experiments are conducted among our method and the three other state-of-the-art methods including endmember extraction using improved Automatic Pixel Purity Index (APPI), spectral and spatial features extraction, and endmember signatures extraction using Endmember Induction Algorithm (EIA). Experimental results on AVIRIS data show that our method can achieve a higher accuracy for hyperspectral image retrieval and further prove our extracted deep spectral-spatial feature has stronger descriptive ability.

[1]  Manuel Graña,et al.  An endmember-based distance for content based hyperspectral image retrieval , 2012, Pattern Recognit..

[2]  Sarp Ertürk,et al.  Constrained One-Bit Transform for Low Complexity Block Motion Estimation , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  W C Chiou Dynamic descriptors for contextual classification of remotely sensed hyperspectral image data analysis. , 1984, Applied optics.

[4]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Xing Zhao,et al.  Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief Network , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[6]  C. Woodcock,et al.  Assessment of spectral, polarimetric, temporal, and spatial dimensions for urban and peri-urban land cover classification using Landsat and SAR data , 2012 .

[7]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[8]  Manuel Graña,et al.  On the validation of a spectral/spatial CBIR system for hyperspectral images , 2011, 2011 3rd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[9]  Fei Li,et al.  [Spectral curve shape feature-based hyperspectral remote sensing image retrieval]. , 2008, Guang pu xue yu guang pu fen xi = Guang pu.

[10]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[11]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Begüm Demir,et al.  A Low-Complexity Approach for the Color Display of Hyperspectral Remote-Sensing Images Using One-Bit-Transform-Based Band Selection , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Li Zhuo,et al.  A CBIR System for Hyperspectral Remote Sensing Images Using Endmember Extraction , 2017, Int. J. Pattern Recognit. Artif. Intell..

[14]  Konstantinos Konstantinides,et al.  Low-complexity block-based motion estimation via one-bit transforms , 1997, IEEE Trans. Circuits Syst. Video Technol..

[15]  Mark A. Richardson,et al.  An introduction to hyperspectral imaging and its application for security, surveillance and target acquisition , 2010 .

[16]  Minh N. Do,et al.  Semantic Image Inpainting with Deep Generative Models , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Manuel Graña,et al.  A Spectral/Spatial CBIR System for Hyperspectral Images , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[18]  Eustace L. Dereniak,et al.  Hyperspectral imaging for astronomy and space surviellance , 2004, SPIE Optics + Photonics.

[19]  Rob Fergus,et al.  Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks , 2015, NIPS.