An infrared target intrusion detection method based on feature fusion and enhancement

Abstract Infrared target intrusion detection has significant applications in the fields of military defence and intelligent warning. In view of the characteristics of intrusion targets as well as inspection difficulties, an infrared target intrusion detection algorithm based on feature fusion and enhancement was proposed. This algorithm combines static target mode analysis and dynamic multi-frame correlation detection to extract infrared target features at different levels. Among them, LBP texture analysis can be used to effectively identify the posterior feature patterns which have been contained in the target library, while motion frame difference method can detect the moving regions of the image, improve the integrity of target regions such as camouflage, sheltering and deformation. In order to integrate the advantages of the two methods, the enhanced convolutional neural network was designed and the feature images obtained by the two methods were fused and enhanced. The enhancement module of the network strengthened and screened the targets, and realized the background suppression of infrared images. Based on the experiments, the effect of the proposed method and the comparison method on the background suppression and detection performance was evaluated, and the results showed that the SCRG and BSF values of the method in this paper had a better performance in multiple data sets, and it’s detection performance was far better than the comparison algorithm. The experiment results indicated that, compared with traditional infrared target detection methods, the proposed method could detect the infrared invasion target more accurately, and suppress the background noise more effectively.

[1]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Luoqing Li,et al.  Wavelet-Hough Transform with Applications in Edge and Target Detections , 2006, Int. J. Wavelets Multiresolution Inf. Process..

[3]  Liyuan Li,et al.  Fusion of two different motion cues for intelligent video surveillance , 2001, Proceedings of IEEE Region 10 International Conference on Electrical and Electronic Technology. TENCON 2001 (Cat. No.01CH37239).

[4]  Chen Wang,et al.  A Kernel-Based Nonparametric Regression Method for Clutter Removal in Infrared Small-Target Detection Applications , 2010, IEEE Geoscience and Remote Sensing Letters.

[5]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[6]  Xin Huang,et al.  Deep networks under scene-level supervision for multi-class geospatial object detection from remote sensing images , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[7]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Matti Pietikäinen,et al.  Median Robust Extended Local Binary Pattern for Texture Classification , 2016, IEEE Trans. Image Process..

[9]  Yuan Gao,et al.  Research on Moving Object Detection Algorithm Based on Improved Three Frame Difference Method and Optical Flow , 2015, 2015 Fifth International Conference on Instrumentation and Measurement, Computer, Communication and Control (IMCCC).

[10]  傅雨田 Fu Yutian,et al.  Infrared Ship Target Detection Method Based on Deep Convolution Neural Network , 2018 .

[11]  Charlene E. Caefer,et al.  Optimization of point target tracking filters , 2000, IEEE Trans. Aerosp. Electron. Syst..

[12]  Xiangzhi Bai,et al.  Analysis of new top-hat transformation and the application for infrared dim small target detection , 2010, Pattern Recognit..

[13]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Jason J. Ford,et al.  Relative Entropy Rate Based Multiple Hidden Markov Model Approximation , 2010, IEEE Transactions on Signal Processing.

[15]  Chenglin Wen,et al.  Robust Small Target Co-Detection from Airborne Infrared Image Sequences , 2017, Sensors.

[16]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Amitava Das,et al.  Adaptive contour-based statistical background subtraction method for moving target detection in infrared video sequences , 2014 .

[18]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[19]  Guohua Gu,et al.  Infrared small target tracking based on sample constrained particle filtering and sparse representation , 2017 .

[20]  Guohua Gu,et al.  Infrared Small Moving Target Detection via Saliency Histogram and Geometrical Invariability , 2017 .

[21]  Matti Pietikäinen,et al.  Gray Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2000, ECCV.

[22]  Hakil Kim,et al.  Wide-residual-inception networks for real-time object detection , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[23]  M. Topi,et al.  Texture classification by multi-predicate local binary pattern operators , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[24]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[25]  Meng Hwa Er,et al.  Max-mean and max-median filters for detection of small targets , 1999, Optics & Photonics.

[26]  Xinyu Wang,et al.  Adaptive method for infrared small target detection based on gray-scale morphology and backward cumulative histogram analysis , 2009, 2009 International Conference on Information and Automation.

[27]  Zengping Chen,et al.  Infrared target detection and false alarm elimination based on multi-feature fusion decision , 2016, 2016 Progress in Electromagnetic Research Symposium (PIERS).

[28]  Jason J. Ford,et al.  Fusion of morphological images for airborne target detection , 2012, 2012 15th International Conference on Information Fusion.

[29]  Herbert E. Rauch,et al.  Background Suppression And Tracking With A Staring Mosaic Sensor , 1981 .

[30]  Richard E. Korf,et al.  Moving-Target Search: A Real-Time Search for Changing Goals , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Gang Sun,et al.  A real-time target detection and false alarm decreasing algorithm for wide field of view infrared surveillance system , 2013, Other Conferences.

[33]  Yongjun Zhang,et al.  Robust infrared small target detection using local steering kernel reconstruction , 2018, Pattern Recognit..

[34]  Bingjian Wang,et al.  Dim and small infrared target fast detection guided by visual saliency , 2019, Infrared Physics & Technology.

[35]  王芳 Wang Fang,et al.  Infrared Target Detecting Based on Symmetrical Displaced Frame Difference and Optical Flow Estimation , 2010 .

[36]  Rogério Schmidt Feris,et al.  A Unified Multi-scale Deep Convolutional Neural Network for Fast Object Detection , 2016, ECCV.

[37]  John B. Moore,et al.  Hidden Markov Models: Estimation and Control , 1994 .

[38]  Jinwen Tian,et al.  Infrared small target detection using directional highpass filters based on LS-SVM , 2009 .

[39]  Z. Zuo,et al.  Small target detection in infrared images using deep convolutional neural networks , 2019 .

[40]  Baoshu Xu,et al.  Multiple dim targets detection in infrared image sequences , 2014, Other Conferences.

[41]  Xiaobo Hu,et al.  In-frame and inter-frame information based infrared moving small target detection under complex cloud backgrounds , 2016 .