Semisupervised Hyperspectral Image Classification Based on Generative Adversarial Networks

Because the collection of ground-truth labels is difficult, expensive, and time-consuming, classifying hyperspectral images (HSIs) with few training samples is a challenging problem. In this letter, we propose a novel semisupervised algorithm for the classification of hyperspectral data by training a customized generative adversarial network (GAN) for hyperspectral data. The GAN constructs an adversarial game between a discriminator and a generator. The generator generates samples that are not distinguishable by the discriminator, and the discriminator determines whether or not a sample is composed of real data. We design a semisupervised framework for HSI data based on a 1-D GAN (HSGAN). This framework enables the automatic extraction of spectral features for HSI classification. When HSGAN is trained using unlabeled hyperspectral data, the generator can generate hyperspectral samples that are similar to the real data, while the discriminator contains the features, which can be used to classify hyperspectral data with only a small number of labeled samples. The performance of the HSGAN is evaluated on the Airborne Visible Infrared Imaging Spectrometer image data, and the results show that the proposed framework achieves very promising results with a small number of labeled samples.

[1]  Changxin Gao,et al.  A Discriminant Sparse Representation Graph-Based Semi-Supervised Learning for Hyperspectral Image Classification , 2015, CCCV.

[2]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[3]  Jost Tobias Springenberg,et al.  Unsupervised and Semi-supervised Learning with Categorical Generative Adversarial Networks , 2015, ICLR.

[4]  J. Chanussot,et al.  Hyperspectral Remote Sensing Data Analysis and Future Challenges , 2013, IEEE Geoscience and Remote Sensing Magazine.

[5]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[6]  T. Bandos,et al.  Semi-supervised Hyperspectral Image Classification with Graphs , 2006, 2006 IEEE International Symposium on Geoscience and Remote Sensing.

[7]  Antonio J. Plaza,et al.  Semisupervised Hyperspectral Image Classification Using Soft Sparse Multinomial Logistic Regression , 2013, IEEE Geoscience and Remote Sensing Letters.

[8]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[9]  Antonio J. Plaza,et al.  Semi-supervised hyperspectral image classification based on a Markov random field and sparse multinomial logistic regression , 2009, 2009 IEEE International Geoscience and Remote Sensing Symposium.

[10]  Augustus Odena,et al.  Semi-Supervised Learning with Generative Adversarial Networks , 2016, ArXiv.

[11]  Bin Wang,et al.  Semisupervised Spectral–Spatial Classification of Hyperspectral Imagery With Affinity Scoring , 2015, IEEE Geoscience and Remote Sensing Letters.

[12]  Alexander Zien,et al.  Semi-Supervised Learning , 2006 .

[13]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[14]  Shaoguang Zhou,et al.  Discriminative Sparse Representation for Hyperspectral Image Classification: A Semi-Supervised Perspective , 2017, Remote. Sens..

[15]  Bernhard Schölkopf,et al.  Introduction to Semi-Supervised Learning , 2006, Semi-Supervised Learning.

[16]  Lorenzo Bruzzone,et al.  A Composite Semisupervised SVM for Classification of Hyperspectral Images , 2009, IEEE Geoscience and Remote Sensing Letters.

[17]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .