A shallow network for hyperspectral image classification using an autoencoder with convolutional neural network

This paper addresses an approach for the classification of hyperspectral imagery (HSI). In remote sensing, the HSI sensor acquires hundreds of images with narrow and continuous spectral width in visible and near-infrared regions of the electromagnetic (EM) spectrum. Such nature of data acquisition is very useful in the classification and/or the identification of different objects present in the HSI data. However, the low-spatial resolution and large volume of HS images make it more challenging. In the proposed approach, we use an autoencoder with convolutional neural network (AECNN) for the classification of HS images. Pre-processing with autoencoder enhances the features in the HS images which helps to obtain optimized weights in the initial layers of the CNN model. Hence, shallow CNN architecture can be utilized to extract features from the pre-processed HSI data which are used further for the classification of the same. The potential of the proposed approach has been verified by conducting many experiments on various datasets. The classification results obtained using the proposed method are compared with many state-of-the-art deep learning based methods including the winner of the geoscience and remote sensing society (GRSS) Image Fusion Contest-2018 on HSI classification held at IEEE International Geoscience and Remote Sensing Symposium (IGARSS)-2018 and it shows superiority over those methods.

[1]  Giles M. Foody,et al.  Feature Selection for Classification of Hyperspectral Data by SVM , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Joydeep Ghosh,et al.  Investigation of the random forest framework for classification of hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Deqin Yan,et al.  Hyperspectral remote sensing image classification with information discriminative extreme learning machine , 2018, Multimedia Tools and Applications.

[4]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.

[5]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Hyperspectral Image Segmentation Using S , 2022 .

[6]  Bidyut Baran Chaudhuri,et al.  HybridSN: Exploring 3-D–2-D CNN Feature Hierarchy for Hyperspectral Image Classification , 2019, IEEE Geoscience and Remote Sensing Letters.

[7]  Qian Du,et al.  Multisource Remote Sensing Data Classification Based on Convolutional Neural Network , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Shutao Li,et al.  Multilabel Sample Augmentation-Based Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Soumik Sarkar,et al.  LLNet: A deep autoencoder approach to natural low-light image enhancement , 2015, Pattern Recognit..

[10]  Dacheng Tao,et al.  Multi-Task Pose-Invariant Face Recognition , 2015, IEEE Transactions on Image Processing.

[11]  Kishor P. Upla,et al.  AECNN: Autoencoder with Convolutional Neural Network for Hyperspectral Image Classification , 2018 .

[12]  Shanjun Mao,et al.  Spectral–spatial classification of hyperspectral images using deep convolutional neural networks , 2015 .

[13]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  Zhou Guo,et al.  On combining multiscale deep learning features for the classification of hyperspectral remote sensing imagery , 2015 .

[15]  Jun Huang,et al.  Spectral-Spatial Attention Networks for Hyperspectral Image Classification , 2019, Remote. Sens..

[16]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[17]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Jon Atli Benediktsson,et al.  Advances in Hyperspectral Image Classification: Earth Monitoring with Statistical Learning Methods , 2013, IEEE Signal Processing Magazine.

[19]  Naoto Yokoya,et al.  Invariant Attribute Profiles: A Spatial-Frequency Joint Feature Extractor for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Naoto Yokoya,et al.  2018 IEEE GRSS Data Fusion Contest: Multimodal Land Use Classification [Technical Committees] , 2018 .

[21]  Russell Congalton,et al.  Assessing the Accuracy of Remotely Sensed Data: Principles and Practices, Second Edition , 1998 .

[22]  Qian Du,et al.  Local Binary Patterns and Extreme Learning Machine for Hyperspectral Imagery Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Brian P. Salmon,et al.  Multiview Deep Learning for Land-Use Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[25]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Shiming Xiang,et al.  Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks , 2014, IEEE Geoscience and Remote Sensing Letters.

[27]  Jon Atli Benediktsson,et al.  Fusion of Multiple Edge-Preserving Operations for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Antonio J. Plaza,et al.  Semisupervised Hyperspectral Image Classification Using Soft Sparse Multinomial Logistic Regression , 2013, IEEE Geoscience and Remote Sensing Letters.

[29]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Yuxin Peng,et al.  A Boosted Multi-Task Model for Pedestrian Detection With Occlusion Handling , 2015, IEEE Transactions on Image Processing.

[31]  Antonio J. Plaza,et al.  Subspace-Based Support Vector Machines for Hyperspectral Image Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[32]  Berrin A. Yanikoglu,et al.  Deep Learning With Attribute Profiles for Hyperspectral Image Classification , 2016, IEEE Geoscience and Remote Sensing Letters.

[33]  Qian Du,et al.  Hyperspectral Image Classification Using Deep Pixel-Pair Features , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Sen Jia,et al.  Convolutional neural networks for hyperspectral image classification , 2017, Neurocomputing.