Self-Supervised Divide-and-Conquer Generative Adversarial Network for Classification of Hyperspectral Images

Generative adversarial network (GAN) has been rapidly developed because of its powerful generating ability. However, imbalanced class distribution of hyperspectral images (HSIs) easily causes mode collapse in GAN. Moreover, limited training samples in HSIs restrict the generating ability of GAN. These issues may further deteriorate the classification performance of the discriminator. To conquer these issues, a novel self-supervised divide-and-conquer (SDC)-GAN is proposed for HSI classification. In SDC-GAN, a pretext cluster task with an encoder–decoder architecture is designed by leveraging abundant unlabeled samples. By transferring the learned cluster representation from the cluster task, limited labeled samples are divided effectively in the downstream classification. According to the division of clustering, SDC-GAN constructs a generic and several specific branches for both the generator and discriminator. The generator generates all- and specific-class samples by using the generic and specific branches separately and combines them adaptively. It can weaken the generation preference for the classes with large sample sizes and alleviate the mode collapse problem. Meanwhile, the classification ability of the discriminator is improved by integrating the judgment of specific branches into the generic branch. Experimental results show that SDC-GAN achieves competitive results for HSI classification compared with several state-of-the-art methods.

[1]  Zhiyong Lv,et al.  Explainable scale distillation for hyperspectral image classification , 2022, Pattern Recognit..

[2]  J. Zabalza,et al.  SpaSSA: Superpixelwise Adaptive SSA for Unsupervised Spatial–Spectral Feature Extraction in Hyperspectral Image , 2021, IEEE Transactions on Cybernetics.

[3]  Nikita Araslanov,et al.  Self-supervised Augmentation Consistency for Adapting Semantic Segmentation , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Kavita Bala,et al.  PiCIE: Unsupervised Semantic Segmentation using Invariance and Equivariance in Clustering , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Fan Zhang,et al.  A Hyperspectral Image Classification Approach Based on Feature Fusion and Multi-Layered Gradient Boosting Decision Trees , 2020, Entropy.

[6]  Jian-Jiun Ding,et al.  Spectral–Temporal Receptive Field-Based Descriptors and Hierarchical Cascade Deep Belief Network for Guitar Playing Technique Classification , 2020, IEEE Transactions on Cybernetics.

[7]  Qian Du,et al.  Adaptive DropBlock-Enhanced Generative Adversarial Networks for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Chao Tao,et al.  Semi-Supervised Variational Generative Adversarial Networks for Hyperspectral Image Classification , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[9]  Jon Atli Benediktsson,et al.  Deep Learning for Hyperspectral Image Classification: An Overview , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Matthijs Douze,et al.  Deep Clustering for Unsupervised Learning of Visual Features , 2018, ECCV.

[11]  Adalene Moreira Silva,et al.  Hyperspectral remote sensing applied to mineral exploration in southern Peru: A multiple data integration approach in the Chapi Chiara gold prospect , 2018, Int. J. Appl. Earth Obs. Geoinformation.

[12]  Qian Du,et al.  Hyperspectral Image Classification Using Deep Pixel-Pair Features , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Jon Atli Benediktsson,et al.  Effective Denoising and Classification of Hyperspectral Images Using Curvelet Transform and Singular Spectrum Analysis , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Jonathon Shlens,et al.  Conditional Image Synthesis with Auxiliary Classifier GANs , 2016, ICML.

[15]  Bo Yang,et al.  Towards K-means-friendly Spaces: Simultaneous Deep Learning and Clustering , 2016, ICML.

[16]  Alexei A. Efros,et al.  Context Encoders: Feature Learning by Inpainting , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Paolo Favaro,et al.  Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles , 2016, ECCV.

[18]  Yansheng Li,et al.  Unsupervised Spectral–Spatial Feature Learning With Stacked Sparse Autoencoder for Hyperspectral Imagery Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[19]  Juha Suomalainen,et al.  Generation of Spectral–Temporal Response Surfaces by Combining Multispectral Satellite and Hyperspectral UAV Imagery for Precision Agriculture Applications , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Li Ma,et al.  Local Manifold Learning-Based $k$ -Nearest-Neighbor for Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Chein-I Chang,et al.  Hyperspectral Data Exploitation , 2007 .

[23]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Weishi Zheng,et al.  Spectral-Spatial Transformer Network for Hyperspectral Image Classification: A Factorized Architecture Search Framework , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Zhiyong Lv,et al.  Hyperspectral Image Classification With Adversarial Attack , 2022 .