High-Performance SAR Automatic Target Recognition Under Limited Data Condition Based on a Deep Feature Fusion Network

Deep learning algorithms have been widely applied to the recognition of remote-sensing images due to their excellent performance on various recognition problems with sufficient data. However, limited data on synthetic aperture radar (SAR) images degrade the performance of neural networks for SAR automatic target recognition (ATR). To address this problem, this paper presents a new deep feature fusion framework by combining the Gabor features and information of raw SAR images and fusing the feature vectors extracted from different layers in our proposed neural network. Gabor features improve the richness of SAR image features. The number of free parameters of neural networks is largely reduced by utilizing large-scale convolutional kernel factorization and global average pooling. Moreover, the fusion of feature vectors from different layers helps improve the recognition performance of neural networks. Experimental results on the MSTAR dataset demonstrate the effectiveness of our proposed method. The proposed neural network can achieve an average accuracy of 99% on the classification of ten-class targets and even achieve a high recognition accuracy on limited data and noisy data.

[1]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Huanxin Zou,et al.  Deep Convolutional Highway Unit Network for SAR Target Classification With Limited Labeled Training Data , 2017, IEEE Geoscience and Remote Sensing Letters.

[3]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Huanxin Zou,et al.  Synthetic Aperture Radar Target Recognition with Feature Fusion Based on a Stacked Autoencoder , 2017, Sensors.

[5]  R. Hummel,et al.  Model-based ATR using synthetic aperture radar , 2000, Record of the IEEE 2000 International Radar Conference [Cat. No. 00CH37037].

[6]  Ting Jiang,et al.  Data Augmentation with Gabor Filter in Deep Convolutional Neural Networks for Sar Target Recognition , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[7]  Larry S. Davis,et al.  Exploiting local features from deep networks for image retrieval , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[8]  Atle O. Knapskog,et al.  Classification of Ships in TerraSAR-X Images Based on 3D Models and Silhouette Matching , 2010 .

[9]  Qian Du,et al.  Local Binary Patterns and Extreme Learning Machine for Hyperspectral Imagery Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Carlos López-Martínez,et al.  A novel algorithm for ship detection in SAR imagery based on the wavelet transform , 2005, IEEE Geoscience and Remote Sensing Letters.

[11]  Zhipeng Liu,et al.  Adaptive boosting for SAR automatic target recognition , 2007, IEEE Transactions on Aerospace and Electronic Systems.

[12]  Lee C. Potter,et al.  Attributed scattering centers for SAR ATR , 1997, IEEE Trans. Image Process..

[13]  Wei Li,et al.  Multi-Aspect-Aware Bidirectional LSTM Networks for Synthetic Aperture Radar Target Recognition , 2017, IEEE Access.

[14]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Anton van den Hengel,et al.  The treasure beneath convolutional layers: Cross-convolutional-layer pooling for image classification , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  S. D. Halversen,et al.  Effects of polarization and resolution on SAR ATR , 1997, IEEE Transactions on Aerospace and Electronic Systems.

[17]  I. Hajnsek,et al.  A tutorial on synthetic aperture radar , 2013, IEEE Geoscience and Remote Sensing Magazine.

[18]  Peter F. McGuire,et al.  Automatic Target Recognition in Synthetic Aperture Radar Imagery: A State-of-the-Art Review , 2016, IEEE Access.

[19]  Huanxin Zou,et al.  Sparse Representation-Based SAR Image Target Classification on the 10-Class MSTAR Data Set , 2016 .

[20]  L. Novak,et al.  The Automatic Target- Recognition System in SAIP , 1997 .

[21]  Ping Zhong,et al.  An Unsupervised Convolutional Feature Fusion Network for Deep Representation of Remote Sensing Images , 2018, IEEE Geoscience and Remote Sensing Letters.

[22]  Jian Sun,et al.  Multimodal 2D+3D Facial Expression Recognition With Deep Fusion Convolutional Neural Network , 2017, IEEE Transactions on Multimedia.

[23]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[24]  Jianyu Yang,et al.  SAR Automatic Target Recognition Based on Multiview Deep Learning Framework , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[26]  Haipeng Wang,et al.  Target Classification Using the Deep Convolutional Networks for SAR Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[27]  David Morgan,et al.  Deep convolutional neural networks for ATR from SAR imagery , 2015, Defense + Security Symposium.

[28]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Yishu Liu,et al.  Scene Classification Based on Two-Stage Deep Feature Fusion , 2018, IEEE Geoscience and Remote Sensing Letters.

[30]  Chung Choo Chung,et al.  Robust Camera Lidar Sensor Fusion Via Deep Gated Information Fusion Network , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[31]  Hongwei Liu,et al.  Convolutional Neural Network With Data Augmentation for SAR Target Recognition , 2016, IEEE Geoscience and Remote Sensing Letters.

[32]  Haryong Song,et al.  Robust Vision-Based Relative-Localization Approach Using an RGB-Depth Camera and LiDAR Sensor Fusion , 2016, IEEE Transactions on Industrial Electronics.

[33]  Akira Hirose,et al.  Complex-Valued Neural Networks , 2006, Studies in Computational Intelligence.

[34]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[35]  Simon Wagner,et al.  A deep learning SAR ATR system using regularization and prioritized classes , 2017, 2017 IEEE Radar Conference (RadarConf).

[36]  Fan Zhang,et al.  Small Sample Learning Optimization for Resnet Based Sar Target Recognition , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[37]  Odysseas Kechagias-Stamatis,et al.  Fusing Deep Learning and Sparse Coding for SAR ATR , 2019, IEEE Transactions on Aerospace and Electronic Systems.

[38]  Hongwei Liu,et al.  SAR Automatic Target Recognition Based on Euclidean Distance Restricted Autoencoder , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[39]  Qun Zhao,et al.  Support vector machines for SAR automatic target recognition , 2001 .

[40]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Danfei Xu,et al.  PointFusion: Deep Sensor Fusion for 3D Bounding Box Estimation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[42]  Xiuping Jia,et al.  Deep Fusion of Remote Sensing Data for Accurate Classification , 2017, IEEE Geoscience and Remote Sensing Letters.

[43]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[44]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[45]  M. B. Kanevsky,et al.  Synthetic aperture radar , 2009 .

[46]  Amar Mitiche,et al.  Multiregion level-set partitioning of synthetic aperture radar images , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Hu Wei,et al.  A Method of SAR Target Recognition Based on Gabor Filter and Local Texture Feature Extraction , 2015 .

[49]  Wen Hong,et al.  Multi-aspect SAR target recognition based on space-fixed and space-varying scattering feature joint learning , 2019, Remote Sensing Letters.