Attention-based Domain Adaptation for Hyperspectral Image Classification

Machine learning algorithms have been extensively used to generate complex features for classification task in the hyperspectral images. However, for challenging cases like domain adaptation (DA), these algorithms tend to perform less efficiently. Recently, with the advent of deep learning algorithms, more complex but useful features can be generated for hyperspectral image classification task. However, attention-based feature generation is not explored till now, which has been found to be effective for distinguishing different classes of images than without transferring the parameters. In this paper, we have opted to use attention-based DA based on transferring different levels of attention from a supervisor network to the student network to provide useful but more complex features for improving the overall classification of the DA problem. It has been shown that the proposed attention-based transfer method outperforms the state-of-the-art domain adaptation methods.

[1]  Shawki Areibi,et al.  Domain Adaptation Using Representation Learning for the Classification of Remote Sensing Images , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Geoffrey E. Hinton,et al.  Distilling the Knowledge in a Neural Network , 2015, ArXiv.

[3]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Lorenzo Bruzzone,et al.  Domain Adaptation Problems: A DASVM Classification Technique and a Circular Validation Strategy , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Xue Li,et al.  Iterative Reweighting Heterogeneous Transfer Learning Framework for Supervised Remote Sensing Image Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[6]  Jocelyn Chanussot,et al.  A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based Regularization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Moumita Roy,et al.  A neural approach under transfer learning for domain adaptation in land-cover classification using two-level cluster mapping , 2018, Appl. Soft Comput..

[8]  Russell G. Congalton,et al.  A review of assessing the accuracy of classifications of remotely sensed data , 1991 .

[9]  Jiawei Han,et al.  Knowledge transfer via multiple model local structure mapping , 2008, KDD.

[10]  Lorenzo Bruzzone,et al.  Semisupervised Transfer Component Analysis for Domain Adaptation in Remote Sensing Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Junmo Kim,et al.  A Gift from Knowledge Distillation: Fast Optimization, Network Minimization and Transfer Learning , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Jon Atli Benediktsson,et al.  Advances in Hyperspectral Image Classification: Earth Monitoring with Statistical Learning Methods , 2013, IEEE Signal Processing Magazine.

[13]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Lorenzo Bruzzone,et al.  A Sensor-Driven Hierarchical Method for Domain Adaptation in Classification of Remote Sensing Images , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Chao Li,et al.  Active multi-kernel domain adaptation for hyperspectral image classification , 2017, Pattern Recognit..

[16]  Jocelyn Chanussot,et al.  Decision Fusion for the Classification of Hyperspectral Data: Outcome of the 2008 GRS-S Data Fusion Contest , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Nikos Komodakis,et al.  Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer , 2016, ICLR.

[18]  Qian Du,et al.  Hyperspectral Image Classification Using Deep Pixel-Pair Features , 2017, IEEE Transactions on Geoscience and Remote Sensing.