Cross-Data Set Hyperspectral Image Classification Based on Deep Domain Adaptation

For hyperspectral image classification, there is a large gap between the theoretical method and the practical application. Hyperspectral image classification in theoretical research trains a new classifier for each data set, which is ineffective and even infeasible in large-scale applications. In this paper, we make a preliminary attempt to recycle the classification model to new data sets in an unsupervised way. Specially, we propose a cross-data set hyperspectral image classification method based on deep domain adaptation. The proposed method contains three modules: domain alignment module that learns to minimize the domain discrepancy with the guide of an irrelevant task, task allocation module that learns to classify on the source domain with the regulation of domain alignment, and domain adaptation module that transfers both the alignment ability and classification ability to the target domain by an adaptation strategy. As a result, with the information of an irrelevant task on dual-domain data sets, we can minimize the domain discrepancy and transfer the task-relevant knowledge from the source domain to the target domain in an unsupervised way. Extensive experiments on three hyperspectral images demonstrate the effectiveness of our method compared with other related methods when dealing with new data sets.

[1]  Stanley Osher,et al.  Unsupervised Classification in Hyperspectral Imagery With Nonlocal Total Variation and Primal-Dual Hybrid Gradient Algorithm , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Shuying Li,et al.  Active-Learning-Incorporated Deep Transfer Learning for Hyperspectral Image Classification , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Hao Wu,et al.  Semi-Supervised Deep Learning Using Pseudo Labels for Hyperspectral Image Classification , 2018, IEEE Transactions on Image Processing.

[5]  Dong Xu,et al.  Recent Advances in Transfer Learning for Cross-Dataset Visual Recognition , 2017, ACM Comput. Surv..

[6]  Jocelyn Chanussot,et al.  Multiple Kernel Learning for Hyperspectral Image Classification: A Review , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Bing Liu,et al.  Supervised Deep Feature Extraction for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Hui Lin,et al.  Classification of Hyperspectral Images by Gabor Filtering Based Deep Network , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[10]  Raymond Y. K. Lau,et al.  Hyperspectral Image Classification With Deep Learning Models , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Jie Geng,et al.  Hyperspectral image classification via contextual deep learning , 2015, EURASIP Journal on Image and Video Processing.

[12]  Jon Atli Benediktsson,et al.  Advances in Hyperspectral Image Classification: Earth Monitoring with Statistical Learning Methods , 2013, IEEE Signal Processing Magazine.

[13]  Jian Zhu,et al.  Deformable Convolutional Neural Networks for Hyperspectral Image Classification , 2018, IEEE Geoscience and Remote Sensing Letters.

[14]  Qingshan Liu,et al.  Cascaded Recurrent Neural Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Cheng Wang,et al.  Hyperspectral Image Classification With Kernel-Based Least-Squares Support Vector Machines in Sum Space , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[16]  Trevor Darrell,et al.  Adversarial Discriminative Domain Adaptation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Lin Zhu,et al.  Generative Adversarial Networks for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Xiaorui Ma,et al.  Semisupervised classification for hyperspectral image based on multi-decision labeling and deep feature learning , 2016 .

[19]  Qian Du,et al.  Learning Sensor-Specific Spatial-Spectral Features of Hyperspectral Images via Convolutional Neural Networks , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Dan Hu,et al.  Semisupervised Hyperspectral Image Classification Based on Generative Adversarial Networks , 2018, IEEE Geoscience and Remote Sensing Letters.

[21]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[23]  Xiao Xiang Zhu,et al.  Deep Recurrent Neural Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Jun Li,et al.  Recent Advances on Spectral–Spatial Hyperspectral Image Classification: An Overview and New Guidelines , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Hui Xiong,et al.  A Unified Framework for Metric Transfer Learning , 2017, IEEE Transactions on Knowledge and Data Engineering.

[26]  Xuelong Li,et al.  Locality and Structure Regularized Low Rank Representation for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Naoto Yokoya,et al.  Foreword to the Special Issue on Hyperspectral Remote Sensing and Imaging Spectroscopy , 2016, IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens..

[28]  Weiwei Sun,et al.  A Band-Weighted Support Vector Machine Method for Hyperspectral Imagery Classification , 2017, IEEE Geoscience and Remote Sensing Letters.

[29]  Qian Du,et al.  Hyperspectral Image Classification Using Deep Pixel-Pair Features , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Gabriele Moser,et al.  Multimodal Classification of Remote Sensing Images: A Review and Future Directions , 2015, Proceedings of the IEEE.

[31]  Hang Chang,et al.  Unsupervised Transfer Learning via Multi-Scale Convolutional Sparse Coding for Biomedical Applications , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Pabitra Mitra,et al.  BASS Net: Band-Adaptive Spectral-Spatial Feature Learning Neural Network for Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Shuyuan Yang,et al.  Deep Fully Convolutional Network-Based Spatial Distribution Prediction for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Jun Li,et al.  Superpixel Tensor Model for Spatial–Spectral Classification of Remote Sensing Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Li Ma,et al.  Probabilistic class structure regularized sparse representation graph for semi-supervised hyperspectral image classification , 2017, Pattern Recognit..

[36]  Zhiming Luo,et al.  Spectral–Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Chen Li,et al.  Spatial Sequential Recurrent Neural Network for Hyperspectral Image Classification , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[38]  Richard J. Murphy,et al.  Pretraining for Hyperspectral Convolutional Neural Network Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Naoto Yokoya,et al.  Advances in Hyperspectral Image and Signal Processing: A Comprehensive Overview of the State of the Art , 2017, IEEE Geoscience and Remote Sensing Magazine.

[40]  Lorenzo Bruzzone,et al.  Kernel-Based Domain-Invariant Feature Selection in Hyperspectral Images for Transfer Learning , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Bo Du,et al.  Spectral–Spatial Unified Networks for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Jocelyn Chanussot,et al.  Foreword to the Special Issue on Hyperspectral Remote Sensing and Imaging Spectroscopy , 2018, IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens..

[43]  Peijun Du,et al.  Multiple Feature Kernel Sparse Representation Classifier for Hyperspectral Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Yue Cao,et al.  Transferable Representation Learning with Deep Adaptation Networks , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.