DFFIR-net: Infrared Dim Small Object Detection Network Constrained by Gray-level Distribution Model

A new deep learning method based on the target gray-level distribution constraint mechanism model is proposed to solve the infrared dim small target detection problem in the complex environment. First, to solve the uneven distribution of positive and negative samples, the designed smoothness operator is used to suppress the background and enhancement target by measuring the difference in their features in 1-D and 2-D gradient. Second, an infrared dim small target detection network based on dense feature fusion, namely, the depth feature fusion infrared network (DFFIR-net), is proposed. The DFFIR-net enhances the feature expression of dim small targets by integrating the original features and the smoothness features of gray-level gradient. Also, the DFFIR-net alleviates the problem of sparse feature extraction. Finally, a multiscale 2-D Gaussian label generation strategy is proposed. This strategy is critical in supervising the training of DFFIR-net in multidimensional Gaussian space, improving the feature exploration ability of the network and detection performance under small training samples. The experimental results show that compared with the existing advanced detection methods, the proposed method has higher accuracy and lower false alarm rates in various complex scenes.

[1]  T. Géraud,et al.  Local Intensity Order Transformation for Robust Curvilinear Object Segmentation , 2022, IEEE Transactions on Image Processing.

[2]  Qingyu Hou,et al.  RISTDnet: Robust Infrared Small Target Detection Network , 2021, IEEE Geoscience and Remote Sensing Letters.

[3]  Tao Chen,et al.  A Siamese Network Based U-Net for Change Detection in High Resolution Remote Sensing Images , 2022, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Wei An,et al.  Infrared Dim and Small Target Detection via Multiple Subspace Learning and Spatial-Temporal Patch-Tensor Model , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Yimian Dai,et al.  Attentional Local Contrast Networks for Infrared Small Target Detection , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Bin Zhao,et al.  A Novel Pattern for Infrared Small Target Detection With Generative Adversarial Network , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Xiaobin Xu,et al.  Object Detection Based on Fusion of Sparse Point Cloud and Image Information , 2021, IEEE Transactions on Instrumentation and Measurement.

[8]  Jiayi Ma,et al.  STDFusionNet: An Infrared and Visible Image Fusion Network Based on Salient Target Detection , 2021, IEEE Transactions on Instrumentation and Measurement.

[9]  Qian Zhao,et al.  A Local Contrast Method for Infrared Small-Target Detection Utilizing a Tri-Layer Window , 2020, IEEE Geoscience and Remote Sensing Letters.

[10]  Lanfen Lin,et al.  UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Zhenming Peng,et al.  Infrared Small Target Detection Based on Partial Sum of the Tensor Nuclear Norm , 2019, Remote. Sens..

[13]  Yu Liu,et al.  Gradient Harmonized Single-stage Detector , 2018, AAAI.

[14]  Zhenming Peng,et al.  Infrared Small Target Detection via Non-Convex Rank Approximation Minimization Joint l2, 1 Norm , 2018, Remote. Sens..

[15]  Tang Zhongxing,et al.  Using deep learning to detect small targets in infrared oversampling images , 2018 .

[16]  Ding Yuan,et al.  Infrared small target detection based on local intensity and gradient properties , 2018 .

[17]  Jie Zhao,et al.  Infrared Small Target Detection Utilizing the Multiscale Relative Local Contrast Measure , 2018, IEEE Geoscience and Remote Sensing Letters.

[18]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[19]  Yiquan Wu,et al.  Reweighted Infrared Patch-Tensor Model With Both Nonlocal and Local Priors for Single-Frame Small Target Detection , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Jun Guo,et al.  Non-negative infrared patch-image model: Robust target-background separation via partial sum minimization of singular values , 2017 .

[21]  Xin Zhou,et al.  Entropy-based window selection for detecting dim and small infrared targets , 2017, Pattern Recognit..

[22]  Yu Zhang,et al.  Infrared Ship Target Segmentation Based on Spatial Information Improved FCM , 2016, IEEE Transactions on Cybernetics.

[23]  Xin Zhou,et al.  Small Infrared Target Detection Based on Weighted Local Difference Measure , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Abhinav Gupta,et al.  Training Region-Based Object Detectors with Online Hard Example Mining , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Fuchun Sun,et al.  HyperNet: Towards Accurate Region Proposal Generation and Joint Object Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Yuan Yan Tang,et al.  A Local Contrast Method for Small Infrared Target Detection , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Yi Yang,et al.  Infrared Patch-Image Model for Small Target Detection in a Single Image , 2013, IEEE Transactions on Image Processing.

[30]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Xin Wang,et al.  Infrared dim target detection based on visual attention , 2012 .

[32]  Joohyoung Lee,et al.  Small Target Detection Utilizing Robust Methods of the Human Visual System for IRST , 2009 .

[33]  Yan Xiong,et al.  An extended track-before-detect algorithm for infrared target detection , 1997, IEEE Transactions on Aerospace and Electronic Systems.