A Joint Multi-Feature and Scale-Adaptive Correlation Filter Tracker

Traditional tracking-by-detection trackers may fail to track targets owing to interferences, such as deformation, occlusion, fast or irregular motion, and background clutter. To improve the process of feature extraction, sample training, and the performance of the traditional kernelized correlation filter (KCF), this paper proposes a new joint multi-feature and scale-adaptive correlation filter tracking algorithm based on histogram of oriented gradients (HOG) and color-naming features. The new algorithm is composed of a position correlation filter tracker and a scale correlation filter tracker. It first uses a mask matrix to cut the training samples, obtains a higher proportion of real samples, and then trains the two correlation filter trackers. One is a position tracker that uses HOG and color-naming features to train two correlation filters, and then combines the results of the two correlation filters to calculate the target position. The second tracker is used to identify the scale with the maximum response size to select the target scale. The proposed algorithm achieves a competitive performance compared with algorithms, such as KCF, compressive tracking, and circulant structure kernel. The results show that this algorithm achieves a better performance when faced with occlusion, deformation, background clutter, and fast or irregular motion, and is able to track changes in target scale.

[1]  Jingtai Liu,et al.  A multi-scale kernel correlation filter tracker with feature integration and robust model updater , 2017, 2017 29th Chinese Control And Decision Conference (CCDC).

[2]  Huchuan Lu,et al.  Visual tracking via adaptive structural local sparse appearance model , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  Gérard G. Medioni,et al.  Context tracker: Exploring supporters and distracters in unconstrained environments , 2011, CVPR 2011.

[5]  Ming-Hsuan Yang,et al.  Robust Object Tracking with Online Multiple Instance Learning , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Michael Felsberg,et al.  Accurate Scale Estimation for Robust Visual Tracking , 2014, BMVC.

[8]  Qi Liu,et al.  Survey of single-target visual tracking methods based on online learning , 2014, IET Comput. Vis..

[9]  Jing Peng,et al.  SVM vs regularized least squares classification , 2004, ICPR 2004.

[10]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Junseok Kwon,et al.  Tracking by Sampling Trackers , 2011, 2011 International Conference on Computer Vision.

[12]  Luca Bertinetto,et al.  Staple: Complementary Learners for Real-Time Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Guixi Liu,et al.  Coupled-layer based visual tracking via adaptive kernelized correlation filters , 2016, The Visual Computer.

[14]  Cordelia Schmid,et al.  Learning Color Names for Real-World Applications , 2009, IEEE Transactions on Image Processing.

[15]  Jiawei Zhang,et al.  The research on tracking algorithm of intelligent vehicle based on image recognition , 2017, 2017 14th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP).

[16]  Lei Zhang,et al.  Real-Time Compressive Tracking , 2012, ECCV.

[17]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Jiri Matas,et al.  P-N learning: Bootstrapping binary classifiers by structural constraints , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Bernard Ghanem,et al.  Target Response Adaptation for Correlation Filter Tracking , 2016, ECCV.

[21]  Sangyoun Lee,et al.  AHD: Thermal Image-Based Adaptive Hand Detection for Enhanced Tracking System , 2018, IEEE Access.

[22]  Rui Caseiro,et al.  Exploiting the Circulant Structure of Tracking-by-Detection with Kernels , 2012, ECCV.

[23]  Thomas Mauthner,et al.  In defense of color-based model-free tracking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Bruce A. Draper,et al.  Visual object tracking using adaptive correlation filters , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[25]  T. Poggio,et al.  Regularized Least-Squares Classification 133 In practice , although , 2007 .

[26]  Qingming Huang,et al.  Hedged Deep Tracking , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Weibin Liu,et al.  Visual object tracking with multi-scale superpixels and color-feature guided kernelized correlation filters , 2018, Signal Process. Image Commun..