Spatiotemporal saliency model for small moving object detection in infrared videos

Abstract In this paper, a novel spatiotemporal saliency model based on three-dimensional Difference-of-Gaussians filters is proposed for small moving object detection in infrared videos. First, instead of utilizing the spatial Difference-of-Gaussians (DoG) filter which has been used to build saliency model for static images, we propose to extend the spatial DoG filter to construct three-dimensional (3D) Difference-of-Gaussians filters for measuring the center-surround difference in the spatiotemporal receptive field. Second, an effective spatiotemporal saliency model is generated based on these filters. This model provides a good basis for accurate and robust infrared small moving object detection. Experimental results show that the proposed saliency model consistently outperforms state-of-the-art saliency models for infrared moving object detection under various complex backgrounds.

[1]  Peyman Milanfar,et al.  Static and space-time visual saliency detection by self-resemblance. , 2009, Journal of vision.

[2]  Chun-Rong Huang,et al.  Video Saliency Map Detection by Dominant Camera Motion Removal , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Sungho Kim,et al.  Scale invariant small target detection by optimizing signal-to-clutter ratio in heterogeneous background for infrared search and track , 2012, Pattern Recognit..

[4]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[5]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[6]  Zhenmin Tang,et al.  Modified particle filter-based infrared pedestrian tracking , 2010 .

[7]  Ali Borji,et al.  State-of-the-Art in Visual Attention Modeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  D J Heeger,et al.  Model for the extraction of image flow. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[9]  Xiang Zhang,et al.  Superpixel-Based Spatiotemporal Saliency Detection , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Xinsheng Huang,et al.  Infrared dim and small target detecting and tracking method inspired by Human Visual System , 2014 .

[11]  Yi Yan,et al.  Infrared small target tracking based on target and interference behaviors model , 2014 .

[12]  Xiao Chen,et al.  Automatic salient object detection via maximum entropy estimation. , 2013, Optics letters.

[13]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[14]  Yongmei Cheng,et al.  Method of visual and infrared fusion for moving object detection. , 2013, Optics letters.

[15]  Liquan Shen,et al.  Saliency detection using regional histograms. , 2013, Optics letters.

[16]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[17]  Xin Wang,et al.  Infrared dim target detection based on visual attention , 2012 .

[18]  Nuno Vasconcelos,et al.  Biologically Inspired Object Tracking Using Center-Surround Saliency Mechanisms , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Jinwen Tian,et al.  Saliency detection using midlevel visual cues. , 2012, Optics letters.

[20]  N. Petkov,et al.  Motion detection, noise reduction, texture suppression, and contour enhancement by spatiotemporal Gabor filters with surround inhibition , 2007, Biological Cybernetics.

[21]  Chuan Yi Tang,et al.  A 2.|E|-Bit Distributed Algorithm for the Directed Euler Trail Problem , 1993, Inf. Process. Lett..