Deep Transfer Learning Based on Generative Adversarial Networks For SAR Target Recognition with label limitation

Driven by the large-scale labeled dataset, convolutional neural networks(CNNs) have achieved great progress in optical image classification. Owing to the robust ability of image feature extracting, deep CNNs are also suitable for Synthetic Aperture Radar automatic target recognition(SAR-ATR) tasks. However, the labeled SAR image sets are always too small, which often lead to a severe over-fitting while training a deep CNNs. In this paper, we propose a novel transfer learning method with generative adversarial networks(GANs) to solve the above problem. Instead of training a deep neural network with the insufficient labeled dataset, we train a GAN using a large numbers of unlabeled SAR images to learn generic features. Then, the pre-trained layers are reused to transfer the generic knowledge to specific recognition tasks through the fine-tuning technique. The experimental results demonstrate that the transfer learning method has a particular performance improvement in SAR-ATR tasks and has less performance degradation when the dataset becomes even smaller. The experimental results prove the feasibility of using GANs for transfer learning, which is important for further research to improve the performance of SAR-ATR with label-limited datasets.

[1]  Chu He,et al.  SAR image classification based on the multi-layer network and transfer learning of mid-level representations , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[2]  Haipeng Wang,et al.  Target Classification Using the Deep Convolutional Networks for SAR Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[4]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[5]  Yoshua Bengio,et al.  Generative Adversarial Networks , 2014, ArXiv.

[6]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[7]  Koby Crammer,et al.  A theory of learning from different domains , 2010, Machine Learning.

[8]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Pieter Abbeel,et al.  InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets , 2016, NIPS.

[10]  Michael I. Jordan,et al.  Learning Transferable Features with Deep Adaptation Networks , 2015, ICML.

[11]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[12]  Shutao Li,et al.  Learning to Diversify Deep Belief Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Koby Crammer,et al.  Analysis of Representations for Domain Adaptation , 2006, NIPS.

[14]  Zongxu Pan,et al.  Transfer Learning with Deep Convolutional Neural Network for SAR Target Classification with Limited Labeled Data , 2017, Remote. Sens..

[15]  Trevor Darrell,et al.  Deep Domain Confusion: Maximizing for Domain Invariance , 2014, CVPR 2014.

[16]  Koby Crammer,et al.  Learning Bounds for Domain Adaptation , 2007, NIPS.

[17]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[18]  Eric R. Keydel,et al.  MSTAR extended operating conditions: a tutorial , 1996, Defense, Security, and Sensing.