Global-patch-hybrid template-based arbitrary object tracking with integral channel features

Arbitrary object tracking is a challenging task in computer vision, as many factors affecting the target representation must be considered. A target template based on only the global appearance or on only the local appearance is unable to capture the discriminating information required for the robust performance of a tracker. In this paper, the target appearance is represented using a hybrid of global and local appearances along with a framework to exploit the Integral Channel Features (ICF). The proposed hybrid approach achieves fusion of the conventional global and patch-based approaches for target representation to synergize the advantages of both approaches. The ICF approach under the hybrid approach integrates heterogeneous sources of information of the target and provides feature strength to the hybrid template. The use of ICF also expedites the extraction of the structural and color features from video frames as the features are collected over multiple channels. The target appearance representation is updated based on only samples with appearances similar to the target appearance using clustering and vector quantization. These factors offer the proposed algorithm robustness to occlusion, illumination changes, and in-plane rotation. Further experimentation analyzes the effects of a change in the scale of the bounding box on the tracking performance of the proposed algorithm. The proposed approach outperforms all the state-of-the-art algorithms in all considered scenarios.

[1]  Mei-Chen Yeh,et al.  Fast Human Detection Using a Cascade of Histograms of Oriented Gradients , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[2]  Ling Shao,et al.  Recent advances and trends in visual tracking: A review , 2011, Neurocomputing.

[3]  Horst Bischof,et al.  On-line Boosting and Vision , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[4]  Xiangjian He,et al.  Robust visual tracking via efficient manifold ranking with low-dimensional compressive features , 2015, Pattern Recognit..

[5]  Erik Blasch,et al.  Minimum Error Bounded Efficient L1 Tracker with Occlusion Detection (PREPRINT) , 2011 .

[6]  Ming-Hsuan Yang,et al.  Robust Object Tracking with Online Multiple Instance Learning , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[9]  Pietro Perona,et al.  Integral Channel Features , 2009, BMVC.

[10]  Larry S. Davis,et al.  Hierarchical Part-Template Matching for Human Detection and Segmentation , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[11]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Uwe D. Hanebeck,et al.  Template matching using fast normalized cross correlation , 2001, SPIE Defense + Commercial Sensing.

[13]  Junseok Kwon,et al.  Visual tracking decomposition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[15]  Simone Calderara,et al.  Visual Tracking: An Experimental Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Weisi Lin,et al.  Visual Object Tracking by Structure Complexity Coefficients , 2015, IEEE Transactions on Multimedia.

[17]  Jiri Matas,et al.  P-N learning: Bootstrapping binary classifiers by structural constraints , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Ivan Laptev,et al.  Improvements of Object Detection Using Boosted Histograms , 2006, BMVC.

[19]  Junseok Kwon,et al.  Tracking of a non-rigid object via patch-based dynamic appearance modeling and adaptive Basin Hopping Monte Carlo sampling , 2009, CVPR.

[20]  X. Rong Li,et al.  Survey of maneuvering target tracking: dynamic models , 2000, SPIE Defense + Commercial Sensing.

[21]  Shai Avidan,et al.  Locally Orderless Tracking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Shai Avidan,et al.  Locally Orderless Tracking , 2012, CVPR.

[24]  Ehud Rivlin,et al.  Robust Fragments-based Tracking using the Integral Histogram , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[25]  Haibin Ling,et al.  Robust Visual Tracking using 1 Minimization , 2009 .

[26]  Afshin Dehghan,et al.  Part-based multiple-person tracking with partial occlusion handling , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Shai Avidan,et al.  Ensemble Tracking , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Fatih Murat Porikli,et al.  Integral histogram: a fast way to extract histograms in Cartesian spaces , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[29]  Xiaoqin Zhang,et al.  Single and Multiple Object Tracking Using Log-Euclidean Riemannian Subspace and Block-Division Appearance Model , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  David Zhang,et al.  Fast Visual Tracking via Dense Spatio-temporal Context Learning , 2014, ECCV.

[31]  Huchuan Lu,et al.  Superpixel tracking , 2011, 2011 International Conference on Computer Vision.

[32]  Qing Wang,et al.  Object Tracking via Partial Least Squares Analysis , 2012, IEEE Transactions on Image Processing.

[33]  Ales Leonardis,et al.  An adaptive coupled-layer visual model for robust visual tracking , 2011, 2011 International Conference on Computer Vision.

[34]  David J. Fleet,et al.  Robust Online Appearance Models for Visual Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..