Detection of Small Moving Objects in Long Range Infrared Videos from a Change Detection Perspective

Detection of small moving objects in long range infrared (IR) videos is challenging due to background clutter, air turbulence, and small target size. In this paper, we present two unsupervised, modular, and flexible frameworks to detect small moving targets. The key idea was inspired by change detection (CD) algorithms where frame differences can help detect motions. Our frameworks consist of change detection, small target detection, and some post-processing algorithms such as image denoising and dilation. Extensive experiments using actual long range mid-wave infrared (MWIR) videos with target distances beyond 3500 m from the camera demonstrated that one approach, using Local Intensity Gradient (LIG) only once in the workflow, performed better than the other, which used LIG in two places, in a 3500 m video, but slightly worse in 4000 m and 5000 m videos. Moreover, we also investigated the use of synthetic bands for target detection and observed promising results for 4000 m and 5000 m videos. Finally, a comparative study with two conventional methods demonstrated that our proposed scheme has comparable performance.

[1]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Multispectral Images Using Kernel Feature Space Representation , 2014, IEEE Geoscience and Remote Sensing Letters.

[2]  Yantao Wei,et al.  Multiscale patch-based contrast measure for small infrared target detection , 2016, Pattern Recognit..

[3]  Kevin F. Kelly,et al.  Compressed domain image classification using a multi-rate neural network , 2019, ArXiv.

[4]  Yimian Dai,et al.  Attentional Local Contrast Networks for Infrared Small Target Detection , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Zhenming Peng,et al.  Infrared Small Target Detection via Nonconvex Tensor Fibered Rank Approximation , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Pavan K. Turaga,et al.  Direct inference on compressive measurements using convolutional neural networks , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[7]  Chaoqun Xia,et al.  Infrared Small Target Detection via Modified Random Walks , 2018, Remote. Sens..

[8]  Chiman Kwan,et al.  A Joint Sparsity Approach to Soil Detection Using Expanded Bands of WV-2 Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[9]  Chiman Kwan,et al.  Small Infrared Target Detection Based on Fast Adaptive Masking and Scaling With Iterative Segmentation , 2021, IEEE Geoscience and Remote Sensing Letters.

[10]  Yi Yang,et al.  Infrared Patch-Image Model for Small Target Detection in a Single Image , 2013, IEEE Transactions on Image Processing.

[11]  Enrique Tajahuerce,et al.  Online reconstruction-free single-pixel image classification , 2019, Image Vis. Comput..

[12]  Chiman Kwan,et al.  Enhancing Small Moving Target Detection Performance in Low-Quality and Long-Range Infrared Videos Using Optical Flow Techniques , 2020, Remote. Sens..

[13]  Yuan Yan Tang,et al.  A Local Contrast Method for Small Infrared Target Detection , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Pin Zhang,et al.  Weak and Occluded Vehicle Detection in Complex Infrared Environment Based on Improved YOLOv4 , 2021, IEEE Access.

[15]  James Theiler,et al.  Proposed Framework for Anomalous Change Detection , 2006 .

[16]  Lorenzo Bruzzone,et al.  Extended profiles with morphological attribute filters for the analysis of hyperspectral data , 2010 .

[17]  Chiman Kwan,et al.  A high-performance approach to detecting small targets in long-range low-quality infrared videos , 2020, Signal Image Video Process..

[18]  Lili Dong,et al.  A Method for Infrared Sea-Sky Condition Judgment and Search System: Robust Target Detection via PLS and CEDoG , 2021, IEEE Access.

[19]  Zhaoquan Cai,et al.  Three-Order Tensor Creation and Tucker Decomposition for Infrared Small-Target Detection , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Ralph Etienne-Cummings,et al.  Real-Time and Deep Learning Based Vehicle Detection and Classification Using Pixel-Wise Code Exposure Measurements , 2020, Electronics.

[21]  Qingyu Hou,et al.  RISTDnet: Robust Infrared Small Target Detection Network , 2021, IEEE Geoscience and Remote Sensing Letters.

[22]  Ke Li,et al.  Rotation-Insensitive and Context-Augmented Object Detection in Remote Sensing Images , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Hong Huo,et al.  IR-MSDNet: Infrared and Visible Image Fusion Based On Infrared Features and Multiscale Dense Network , 2021, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[24]  Chiman Kwan,et al.  Target Detection and Classification Improvements using Contrast Enhanced 16-bit Infrared Videos , 2021 .

[25]  Zixuan Xiao,et al.  Low-Rank Approximation and Multiple Sparse Constraint Modeling for Infrared Low-Flying Fixed-Wing UAV Detection , 2021, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  Jon Atli Benediktsson,et al.  Morphological Attribute Profiles for the Analysis of Very High Resolution Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Alan P. Schaum,et al.  Hyperspectral change detection and supervised matched filtering based on covariance equalization , 2004, SPIE Defense + Commercial Sensing.

[28]  Gang Wan,et al.  Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmark , 2020, ISPRS Journal of Photogrammetry and Remote Sensing.

[29]  Roxana Flores-Quispe,et al.  Textons of Irregular Shape to Identify Patterns in the Human Parasite Eggs , 2019 .

[30]  Jinchang Ren,et al.  Fusion of Infrared and Visible Images for Remote Detection of Low-Altitude Slow-Speed Small Targets , 2021, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  Zizhuang Song,et al.  Semi-Supervised Dim and Small Infrared Ship Detection Network Based on Haar Wavelet , 2021, IEEE Access.

[32]  Guohua Gu,et al.  Infrared Small Target Tracking via Gaussian Curvature-Based Compressive Convolution Feature Extraction , 2021, IEEE Geoscience and Remote Sensing Letters.

[33]  Ding Yuan,et al.  Infrared small target detection based on local intensity and gradient properties , 2018 .

[34]  Michael Elad,et al.  Compressed Learning: A Deep Neural Network Approach , 2016, ArXiv.

[35]  Ran Tao,et al.  A Novel Spatiotemporal Saliency Method for Low-Altitude Slow Small Infrared Target Detection , 2021, IEEE Geoscience and Remote Sensing Letters.

[36]  Zhenming Peng,et al.  Infrared Small Target Detection via Non-Convex Rank Approximation Minimization Joint l2, 1 Norm , 2018, Remote. Sens..

[37]  Lili Dong,et al.  Infrared Small Maritime Target Detection Based on Integrated Target Saliency Measure , 2021, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[38]  Junwei Han,et al.  Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.