A Novel Pattern for Infrared Small Target Detection With Generative Adversarial Network

Since existing detectors are often sensitive to the complex background, a novel detection pattern based on generative adversarial network (GAN) is proposed to focus on the essential features of infrared small target in this article. Motivated by the fact that the infrared small targets have their unique distribution characteristics, we construct a GAN model to automatically learn the features of targets and directly predict the intensity of targets. The target is recognized and reconstructed by the generator, built upon U-Net, according the data distribution. A five-layer discriminator is constructed to enhance the data-fitting ability of generator. Besides, the L2 loss is added into adversarial loss to improve the localization. In general, the detection problem is formulated as an image-to-image translation problem implemented by GAN, namely the original image is translated to a detected image with only target remained. By this way, we can achieve reasonable results with no need of specific mapping function or hand-engineering features. Extensive experiments demonstrate the outstanding performance of proposed method on various backgrounds and targets. In particular, the proposed method significantly improve intersection over union (IoU) values of the detection results than state-of-the-art methods.

[1]  Ding Yuan,et al.  Infrared small target detection based on local intensity and gradient properties , 2018 .

[2]  Yuning Jiang,et al.  Acquisition of Localization Confidence for Accurate Object Detection , 2018, ECCV.

[3]  Dehui Kong,et al.  Infrared dim target detection based on total variation regularization and principal component pursuit , 2017, Image Vis. Comput..

[4]  Alexei A. Efros,et al.  Context Encoders: Feature Learning by Inpainting , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Zhenming Peng,et al.  Infrared Small Target Detection Based on Partial Sum of the Tensor Nuclear Norm , 2019, Remote. Sens..

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  Lorenzo Bruzzone,et al.  Infrared Small Target Detection Based on Facet Kernel and Random Walker , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Paweł Dobrzyński,et al.  The Problems of Standardization of Ground-to-Air Missiles , 2019 .

[9]  Lei Shao,et al.  Tiny and Dim Infrared Target Detection Based on Weighted Local Contrast , 2018, IEEE Geoscience and Remote Sensing Letters.

[10]  Hanshu Yan,et al.  Unsupervised Image Noise Modeling with Self-Consistent GAN , 2019, ArXiv.

[11]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[12]  Xiangzhi Bai,et al.  Infrared small target enhancement and detection based on modified top-hat transformations , 2010, Comput. Electr. Eng..

[13]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[14]  Yubo Wang,et al.  Infrared dim and small target detection based on three-dimensional collaborative filtering and spatial inversion modeling , 2019, Infrared Physics & Technology.

[15]  Jon Gauthier Conditional generative adversarial nets for convolutional face generation , 2015 .

[16]  Hemant R. Sonawane,et al.  Infrared signature studies of aerospace vehicles , 2007 .

[17]  Zhenming Peng,et al.  Infrared Small Target Detection via Non-Convex Rank Approximation Minimization Joint l2, 1 Norm , 2018, Remote. Sens..

[18]  Meng Hwa Er,et al.  Max-mean and max-median filters for detection of small targets , 1999, Optics & Photonics.

[19]  Jie Zhao,et al.  Infrared Small Target Detection Utilizing the Multiscale Relative Local Contrast Measure , 2018, IEEE Geoscience and Remote Sensing Letters.

[20]  Fei Zhang,et al.  Edge directional 2D LMS filter for infrared small target detection , 2012 .

[21]  Chenming Li,et al.  A robust infrared dim target detection method based on template filtering and saliency extraction , 2015 .

[22]  Hang Li,et al.  Infrared small target enhancement via phase spectrum of Quaternion Fourier Transform , 2014 .

[23]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Ruigang Yang,et al.  A new infrared small and dim target detection algorithm based on multi-directional composite window , 2015 .

[25]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[26]  Yi Yang,et al.  Infrared Patch-Image Model for Small Target Detection in a Single Image , 2013, IEEE Transactions on Image Processing.

[27]  S. Tunc,et al.  Dim Target Detection in Infrared Images Using Saliency Algorithms , 2019 .

[28]  D. Powers Evaluation: From Precision, Recall and F-Factor to ROC, Informedness, Markedness & Correlation , 2008 .

[29]  Dehui Kong,et al.  Infrared Dim and Small Target Detection Based on Stable Multisubspace Learning in Heterogeneous Scene , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Xin Zhou,et al.  Small Infrared Target Detection Based on Weighted Local Difference Measure , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Deyu Meng,et al.  Infrared small-dim target detection based on Markov random field guided noise modeling , 2018, Pattern Recognit..

[33]  Xiangzhi Bai,et al.  Analysis of new top-hat transformation and the application for infrared dim small target detection , 2010, Pattern Recognit..

[34]  Carl E. Halford,et al.  Model development and system performance optimization for staring infrared search and track (IRST) sensors , 2016, SPIE Defense + Security.

[35]  Ming Yang,et al.  Conditional Generative Adversarial Network for Structured Domain Adaptation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.