Zero-Shot Learning of SAR Target Feature Space With Deep Generative Neural Networks

Zero-shot learning (ZSL) is of critical importance for practical synthetic aperture radar (SAR) automatic target recognition (ATR) as training samples are not always available for all targets and all observation configurations. We propose a novel generative-based deep neural network framework for ZSL of SAR ATR. The key component of the framework is a generative deconvolutional neural network referred to as generator. It learns a faithful hierarchical representation of known targets while automatically constructing a continuous SAR target feature space spanned by orientation-invariant features and orientation angle. It is then used as a reference to design and initialize an interpreter convolutional neural network, which is inversely symmetric to the generator network. The interpreter network is then trained to map any input SAR image, including those of unseen targets, into the target feature space. In a preliminary experiment with the Moving and Stationary Target Acquisition and Recognition data set, seven targets are used in the training of generator and interpreter networks. Then, the eighth target is used to test the interpreter, where it is correctly mapped to the reasonable spot spanned by the previous seven targets and its orientation can also be estimated.

[1]  Alberto Moreira,et al.  A Preliminary Study on SAR Advanced Information Retrieval and Scene Reconstruction , 2016, IEEE Geoscience and Remote Sensing Letters.

[2]  Yu Zhou,et al.  Polarimetric SAR Image Classification Using Deep Convolutional Neural Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[3]  Shaogang Gong,et al.  Transductive Multi-View Zero-Shot Learning , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Tao Xiang,et al.  Learning Multimodal Latent Attributes , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Pietro Perona,et al.  One-shot learning of object categories , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Haipeng Wang,et al.  Target Classification Using the Deep Convolutional Networks for SAR Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[7]  David A. Clausi,et al.  Sea Ice Concentration Estimation During Melt From Dual-Pol SAR Scenes Using Deep Convolutional Neural Networks: A Case Study , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Andrew Y. Ng,et al.  Zero-Shot Learning Through Cross-Modal Transfer , 2013, NIPS.

[9]  Marc'Aurelio Ranzato,et al.  DeViSE: A Deep Visual-Semantic Embedding Model , 2013, NIPS.

[10]  Thomas Brox,et al.  Learning to Generate Chairs, Tables and Cars with Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.