On data augmentation for segmenting hyperspectral images

Data augmentation is a popular technique which helps improve generalization capabilities of deep neural net- works, and can be perceived as implicit regularization. It is widely adopted in scenarios where acquiring high- quality training data is time-consuming and costly, with hyperspectral satellite imaging (HSI) being a real-life example. In this paper, we investigate data augmentation policies (exploiting various techniques, including generative adversarial networks applied to elaborate artificial HSI data) which help improve the generalization of deep neural networks (and other supervised learners) by increasing the representativeness of training sets. Our experimental study performed over HSI benchmarks showed that hyperspectral data augmentation boosts the classification accuracy of the models without sacrificing their real-time inference speed.

[1]  Léon Bottou,et al.  Wasserstein Generative Adversarial Networks , 2017, ICML.

[2]  Jakub Nalepa,et al.  Hyperspectral Data Augmentation , 2019, ArXiv.

[3]  Bertrand Le Saux,et al.  Generative Adversarial Networks for Realistic Synthesis of Hyperspectral Samples , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[4]  Steven Verstockt,et al.  Hyperspectral Image Classification with Convolutional Neural Networks , 2015, ACM Multimedia.

[5]  Amos J. Storkey,et al.  Data Augmentation Generative Adversarial Networks , 2017, ICLR 2018.

[6]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[8]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Jakub Nalepa,et al.  Validating Hyperspectral Image Segmentation , 2018, IEEE Geoscience and Remote Sensing Letters.

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  Osmar R. Zaïane,et al.  Synthetic Oversampling with the Majority Class: A New Perspective on Handling Extreme Imbalance , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[12]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[13]  Dimitris N. Metaxas,et al.  StackGAN: Text to Photo-Realistic Image Synthesis with Stacked Generative Adversarial Networks , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[14]  Lin Zhu,et al.  Generative Adversarial Networks for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Jeff Donahue,et al.  Large Scale GAN Training for High Fidelity Natural Image Synthesis , 2018, ICLR.

[16]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.