On the importance of visual explanation and segmentation for SAR ATR using deep learning

After the successful application of deep learning to image classification and speech recognition in recent years, deep neural networks are now also widely used for the recognition of targets in Synthetic Aperture Radar (SAR) images. For the 10-class MSTAR SAR Automatic Target Recognition (ATR) problem, several papers have described Convolutional Neural Networks (CNNs) with a classification accuracy that is on a par or higher than conventional target recognition techniques. However, these papers do not show which part of the SAR image is being used by the CNN to classify the target. This paper explains through the visualization of a saliency map that a CNN can achieve a high classification score by using the similarity of the clutter in the SAR images in the training and test set. In this paper, the saliency map is computed from the trained CNN with the Gradient-weighted Class Activation Mapping (Grad-CAM) technique. This paper also shows that by first segmenting the SAR image in target, shadow and clutter regions, and then only providing the target region of the SAR image to the CNN, the problem of clutter-influenced target classification can be mitigated at the expense of a small reduction in classification accuracy.

[1]  Simon Wagner,et al.  A deep learning SAR ATR system using regularization and prioritized classes , 2017, 2017 IEEE Radar Conference (RadarConf).

[2]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[3]  R. Schumacher,et al.  Non-cooperative target identification of battlefield targets - classification results based on SAR images , 2005, IEEE International Radar Conference, 2005..

[4]  Leslie M. Novak State-of-the-art of SAR automatic target recognition , 2000, Record of the IEEE 2000 International Radar Conference [Cat. No. 00CH37037].

[5]  Joseph A. O'Sullivan,et al.  SAR ATR performance using a conditionally Gaussian model , 2001 .

[6]  Simon A. Wagner,et al.  SAR ATR by a combination of convolutional neural network and support vector machines , 2016, IEEE Transactions on Aerospace and Electronic Systems.

[7]  Ding Tao,et al.  A Segmentation-Based CFAR Detection Algorithm Using Truncated Statistics , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Wu Tao,et al.  Study on SAR target recognition based on Support Vector Machine , 2009, 2009 2nd Asian-Pacific Conference on Synthetic Aperture Radar.

[9]  Yang Liu,et al.  SAR ship detection using sea-land segmentation-based convolutional neural network , 2017, 2017 International Workshop on Remote Sensing with Intelligent Processing (RSIP).

[10]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[11]  Mujdat Cetin,et al.  Feature enhancement and ATR performance using nonquadratic optimization-based SAR imaging , 2003 .

[12]  David Morgan,et al.  Deep convolutional neural networks for ATR from SAR imagery , 2015, Defense + Security Symposium.

[13]  Jie Geng,et al.  Deep Supervised and Contractive Neural Network for SAR Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Chris Kreucher,et al.  Modern approaches in deep learning for SAR ATR , 2016, SPIE Defense + Security.

[15]  Fang Liu,et al.  SAR Image segmentation based on convolutional-wavelet neural network and markov random field , 2017, Pattern Recognit..

[16]  Philippe Marthon,et al.  An optimal multiedge detector for SAR image segmentation , 1998, IEEE Trans. Geosci. Remote. Sens..

[17]  Haipeng Wang,et al.  Target Classification Using the Deep Convolutional Networks for SAR Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Andrew Zisserman,et al.  Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps , 2013, ICLR.

[19]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[20]  Yu Zhong,et al.  Enlightening Deep Neural Networks with Knowledge of Confounding Factors , 2016, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[21]  W. Clem Karl,et al.  MRF-based algorithms for segmentation of SAR images , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[22]  Tsuyoshi Murata,et al.  {m , 1934, ACML.