Robust infrared target tracking based on particle filter with embedded saliency detection

Infrared target tracking has attracted extensive research efforts in recent years. However, effective and efficient infrared target tracking is still a hard problem due to the low signal-to-noise ratio, difficulty of robustly describing complicated appearance variations as well as the abrupt motion of targets. In this paper, we propose a tracking method under the Particle Filtering framework by using a hierarchical sampling method, in which two complementary appearance models are used. Firstly, a saliency appearance model is proposed to suppress the cluttered background and properly guide particles to appropriate states. Then the eigen space model is employed as the other observation method to accurately estimate the target state. The hierarchical sampling process is proposed to incorporate the two complementary observation models to account for the abrupt motion efficiently. Experimental results on AMCOM FLIR sequences and comparisons with the state-of-the-art methods demonstrate that the proposed method is robust to appearance changes as well as drastic abrupt motions.

[1]  Guoliang Fan,et al.  Target Tracking with Online Feature Selection in FLIR Imagery , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Xiao Liu,et al.  Attribute-restricted latent topic model for person re-identification , 2012, Pattern Recognit..

[3]  Mignon Park,et al.  Object tracking from image sequences using adaptive models in fuzzy particle filter , 2013, Inf. Sci..

[4]  Dorothy Ndedi Monekosso,et al.  Refined particle swarm intelligence method for abrupt motion tracking , 2014, Inf. Sci..

[5]  Fuchun Sun,et al.  Efficient visual tracking using particle filter with incremental likelihood calculation , 2012, Information Sciences.

[6]  Gérard G. Medioni,et al.  Online Tracking and Reacquisition Using Co-trained Generative and Discriminative Trackers , 2008, ECCV.

[7]  Yi Yang,et al.  Discovering Discriminative Graphlets for Aerial Image Categories Recognition , 2013, IEEE Transactions on Image Processing.

[8]  Xuelong Li,et al.  Visual-Textual Joint Relevance Learning for Tag-Based Social Image Search , 2013, IEEE Transactions on Image Processing.

[9]  Chaoqun Hong,et al.  Realtime object matching with robust dominant orientation templates , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[10]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[11]  Chun Chen,et al.  Low-level and high-level prior learning for visual saliency estimation , 2014, Inf. Sci..

[12]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[13]  Michael Lindenbaum,et al.  Sequential Karhunen-Loeve basis extraction and its application to images , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[14]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[15]  Michael J. Black,et al.  EigenTracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation , 1996, International Journal of Computer Vision.

[16]  Abdullah Bal,et al.  Automatic target tracking in FLIR image sequences , 2004, SPIE Defense + Commercial Sensing.

[17]  Yue Gao,et al.  k-Partite graph reinforcement and its application in multimedia information retrieval , 2012, Inf. Sci..

[18]  Qi Tian,et al.  Less is More: Efficient 3-D Object Retrieval With Query View Selection , 2011, IEEE Transactions on Multimedia.

[19]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Mubarak Shah,et al.  Target tracking in airborne forward looking infrared imagery , 2003, Image Vis. Comput..

[21]  Guoliang Fan,et al.  Adaptive Kalman Filtering for Histogram-Based Appearance Learning in Infrared Imagery , 2012, IEEE Transactions on Image Processing.

[22]  Qi Tian,et al.  Task-Dependent Visual-Codebook Compression , 2012, IEEE Transactions on Image Processing.

[23]  Guizhong Liu,et al.  Visual Object Tracking Based on Combination of Local Description and Global Representation , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Ming-Hsuan Yang,et al.  Incremental Learning for Visual Tracking , 2004, NIPS.

[25]  Yue Gao,et al.  Symbiotic Tracker Ensemble Toward A Unified Tracking Framework , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Xuelong Li,et al.  Fusion of Multichannel Local and Global Structural Cues for Photo Aesthetics Evaluation , 2014, IEEE Transactions on Image Processing.

[28]  Luigi di Stefano,et al.  Joint Detection, Tracking and Mapping by Semantic Bundle Adjustment , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Xiao Liu,et al.  Probabilistic Graphlet Transfer for Photo Cropping , 2013, IEEE Transactions on Image Processing.

[30]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[31]  Xuelong Li,et al.  Spectral-Spatial Constraint Hyperspectral Image Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Lu Zhang,et al.  Structure Preserving Object Tracking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Khan M. Iftekharuddin,et al.  Automated tracking and classification of infrared images , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[34]  M. M. Naushad Ali,et al.  Multiple object tracking with partial occlusion handling using salient feature points , 2014, Inf. Sci..

[35]  Hong Qiao,et al.  Online Appearance Model Learning and Generation for Adaptive Visual Tracking , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[36]  Yue Gao,et al.  3-D Object Retrieval and Recognition With Hypergraph Analysis , 2012, IEEE Transactions on Image Processing.

[37]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[38]  Wen Gao,et al.  Location Discriminative Vocabulary Coding for Mobile Landmark Search , 2011, International Journal of Computer Vision.

[39]  Wen Gao,et al.  Learning to Distribute Vocabulary Indexing for Scalable Visual Search , 2013, IEEE Transactions on Multimedia.