Insect-Inspired Small Moving Target Enhancement in Infrared Videos

Thermal infrared imaging is an effective modality for developing robust methods of small target detection at large distances. However, low target contrast and high background clutter are two main challenges that limit the detection performance. We present bio-inspired spatio-temporal pre-processing of infrared video frames to deal with such challenges. The neurons in the early vision system of small flying insects have remarkable capability for noise filtering, contrast enhancement, signal compression and clutter suppression. These neurons were computationally modeled previously in two stages using a combination of linear and non-linear processing layers. The first stage models the adaptive temporal filtering mechanisms of insect photoreceptor cells. It improves the signal-to-noise-ratio, enhances target background discrimination and expands the possible range of signal variability. The second stage models the spatio-temporal adaptive filtering in the large monopolar cells that remove redundancy and increase target contrast. To show the performance gain achieved by such bio-inspired preprocessing, we perform small target detection experiments on real world high bit-depth infrared video sequences. Results show that the early biological vision based pre-processing significantly improves the performance of four standard infrared small moving target detection techniques. Specifically, the spatio-temporal preprocessing increase the detection rate (at 10−5 false alarm rate) of the best performing method by 100% and by up to 630% for the other methods. Our results are indicative of the strong potential of the bio-processing for allowing systems to detect smaller targets at longer distances in more cluttered environments.

[1]  Zhang Peng,et al.  The design of Top-Hat morphological filter and application to infrared target detection , 2006 .

[2]  Chenming Li,et al.  A robust infrared dim target detection method based on template filtering and saliency extraction , 2015 .

[3]  J. Tukey,et al.  Variations of Box Plots , 1978 .

[4]  K. Naka,et al.  S‐potentials from luminosity units in the retina of fish (Cyprinidae) , 1966, The Journal of physiology.

[5]  V. Hateren,et al.  Processing of natural time series of intensities by the visual system of the blowfly , 1997, Vision Research.

[6]  J. H. Hateren,et al.  Information theoretical evaluation of parametric models of gain control in blowfly photoreceptor cells , 2001, Vision Research.

[7]  Shengli Sun,et al.  A Method for Weak Target Detection Based on Human Visual Contrast Mechanism , 2019, IEEE Geoscience and Remote Sensing Letters.

[8]  Deyu Meng,et al.  Infrared small-dim target detection based on Markov random field guided noise modeling , 2018, Pattern Recognit..

[9]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[10]  Qian Zhao,et al.  A Local Contrast Method Combined With Adaptive Background Estimation for Infrared Small Target Detection , 2019, IEEE Geoscience and Remote Sensing Letters.

[11]  David C. O'Carroll,et al.  Robust Models for Optic Flow Coding in Natural Scenes Inspired by Insect Biology , 2009, PLoS Comput. Biol..

[12]  Xiaorun Li,et al.  Infrared Small Target Detection Based on Multiscale Local Contrast Measure Using Local Energy Factor , 2020, IEEE Geoscience and Remote Sensing Letters.

[13]  David C. O'Carroll,et al.  Performance of a bio-inspired model for the robust detection of moving targets in high dynamic range natural scenes , 2010 .

[14]  Meng Hwa Er,et al.  Max-mean and max-median filters for detection of small targets , 1999, Optics & Photonics.

[15]  David C. O'Carroll,et al.  Bio-inspired pixel-wise adaptive imaging , 2006, SPIE Micro + Nano Materials, Devices, and Applications.

[16]  Yi Yang,et al.  Infrared Patch-Image Model for Small Target Detection in a Single Image , 2013, IEEE Transactions on Image Processing.

[17]  Jie Ma,et al.  A Robust Directional Saliency-Based Method for Infrared Small-Target Detection Under Various Complex Backgrounds , 2013, IEEE Geoscience and Remote Sensing Letters.

[18]  Courtney I. Hilliard,et al.  Selection of a clutter rejection algorithm for real-time target detection from an airborne platform , 2000, SPIE Defense + Commercial Sensing.

[19]  Eng-Leng Mah,et al.  Photoreceptor processing improves salience facilitating small target detection in cluttered scenes. , 2008, Journal of vision.

[20]  Yantao Wei,et al.  Multiscale patch-based contrast measure for small infrared target detection , 2016, Pattern Recognit..

[21]  Yuan Yan Tang,et al.  A Local Contrast Method for Small Infrared Target Detection , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Yongjun Zhang,et al.  Robust infrared small target detection using local steering kernel reconstruction , 2018, Pattern Recognit..

[23]  Peyman Milanfar,et al.  Static and space-time visual saliency detection by self-resemblance. , 2009, Journal of vision.

[24]  Bin Wang,et al.  Detecting Infrared Maritime Targets Overwhelmed in Sun Glitters by Antijitter Spatiotemporal Saliency , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Jie Zhao,et al.  Infrared Small Target Detection Utilizing the Multiscale Relative Local Contrast Measure , 2018, IEEE Geoscience and Remote Sensing Letters.

[26]  Lorenzo Bruzzone,et al.  Infrared Small Target Detection Based on Facet Kernel and Random Walker , 2019, IEEE Transactions on Geoscience and Remote Sensing.