Hyperspectral Data Augmentation

Data augmentation is a popular technique which helps improve generalization capabilities of deep neural networks. It plays a pivotal role in remote-sensing scenarios in which the amount of high-quality ground truth data is limited, and acquiring new examples is costly or impossible. This is a common problem in hyperspectral imaging, where manual annotation of image data is difficult, expensive, and prone to human bias. In this letter, we propose online data augmentation of hyperspectral data which is executed during the inference rather than before the training of deep networks. This is in contrast to all other state-of-the-art hyperspectral augmentation algorithms which increase the size (and representativeness) of training sets. Additionally, we introduce a new principal component analysis based augmentation. The experiments revealed that our data augmentation algorithms improve generalization of deep networks, work in real-time, and the online approach can be effectively combined with offline techniques to enhance the classification accuracy.

[1]  Wei Li,et al.  Data Augmentation for Hyperspectral Image Classification With Deep CNN , 2019, IEEE Geoscience and Remote Sensing Letters.

[2]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Sébastien Ourselin,et al.  Automatic Brain Tumor Segmentation using Convolutional Neural Networks with Test-Time Augmentation , 2018, BrainLes@MICCAI.

[4]  Ping Zhong,et al.  Spectral-spatial classification of hyperspectral images with Gaussian process , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[5]  Jakub Nalepa,et al.  Validating Hyperspectral Image Segmentation , 2018, IEEE Geoscience and Remote Sensing Letters.

[6]  David A. Clausi,et al.  ST-IRGS: A Region-Based Self-Training Algorithm Applied to Hyperspectral Image Classification and Segmentation , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Xiuping Jia,et al.  Hyperspectral Image Classification Using Convolutional Neural Networks and Multiple Feature Learning , 2018, Remote. Sens..

[8]  Gökhan Bilgin,et al.  Segmentation of Hyperspectral Images via Subtractive Clustering and Cluster Validation Using One-Class Support Vector Machines , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Jie Liang,et al.  Spectral-spatial Feature Extraction for Hyperspectral Image Classification , 2016 .

[11]  Xiao Xiang Zhu,et al.  Deep Recurrent Neural Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Heesung Kwon,et al.  Going Deeper With Contextual CNN for Hyperspectral Image Classification , 2016, IEEE Transactions on Image Processing.

[13]  Taner Ince,et al.  Sparse Representation-Based Hyperspectral Image Classification Using Multiscale Superpixels and Guided Filter , 2019, IEEE Geoscience and Remote Sensing Letters.

[14]  Xing Zhao,et al.  Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief Network , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Bertrand Le Saux,et al.  Generative Adversarial Networks for Realistic Synthesis of Hyperspectral Samples , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[16]  Pabitra Mitra,et al.  BASS Net: Band-Adaptive Spectral-Spatial Feature Learning Neural Network for Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Shutao Li,et al.  Learning to Diversify Deep Belief Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Zhi-Hua Zhou,et al.  Multi-Label Learning with Weak Label , 2010, AAAI.

[19]  Salah Bourennane,et al.  Hyperspectral Image Classification Based on Parameter-Optimized 3D-CNNs Combined with Transfer Learning and Virtual Samples , 2018, Remote. Sens..