Visual Tracking With Long-Short Term Based Correlation Filter

Visual object tracking is a fundamental problem in computer vision, and has been greatly improved with the rapid development of deep learning. However, existing tracking methods with single model update strategy cannot guarantee the robustness of tracker in complex scenes. In this paper, we innovatively propose a novel real-time long-short-term multi-model based tracking method. For the fusion of long-term and short-term features contain more spatiotemporal information, three models with different update periods are designed to learn the long-term and short-term features to improve the tracking robustness. Besides, the hierarchical feature contain deep convolution features and handcraft features are used to represent the current object, which can further improve the tracking accuracy with richer semantic information. Finally, to solve the inaccurate prediction of object position due to the cosine window in the correlation filter, the bounding-box regression strategy is introduced to optimize the final object position. Extensive experiments on OTB, VOT, TC128, and UAV123 datasets demonstrate that the proposed method performs favorably against state-of-the-art algorithms while running at 24 fps.

[1]  Jin Wang,et al.  RETRACTED ARTICLE: The visual object tracking algorithm research based on adaptive combination kernel , 2019, Journal of Ambient Intelligence and Humanized Computing.

[2]  Haibin Ling,et al.  SANet: Structure-Aware Network for Visual Tracking , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[3]  Michael Felsberg,et al.  Beyond Correlation Filters: Learning Continuous Convolution Operators for Visual Tracking , 2016, ECCV.

[4]  Liejun Wang,et al.  Visual Tracking Based on Siamese Network of Fused Score Map , 2019, IEEE Access.

[5]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[6]  Michael Felsberg,et al.  Adaptive Color Attributes for Real-Time Visual Tracking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Erik Blasch,et al.  Encoding color information for visual tracking: Algorithms and benchmark , 2015, IEEE Transactions on Image Processing.

[8]  Simon Lucey,et al.  Learning Background-Aware Correlation Filters for Visual Tracking , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[9]  Bohyung Han,et al.  Modeling and Propagating CNNs in a Tree Structure for Visual Tracking , 2016, ArXiv.

[10]  Silvio Savarese,et al.  Learning to Track at 100 FPS with Deep Regression Networks , 2016, ECCV.

[11]  Spyros G. Tzafestas,et al.  Learning algorithms for neural networks with the Kalman filters , 1990, J. Intell. Robotic Syst..

[12]  Wenbing Tao,et al.  Convolutional Regression for Visual Tracking , 2016, IEEE Transactions on Image Processing.

[13]  Xiaogang Wang,et al.  STCT: Sequentially Training Convolutional Networks for Visual Tracking , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Michael Felsberg,et al.  ECO: Efficient Convolution Operators for Tracking , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Michael Felsberg,et al.  The Visual Object Tracking VOT2015 Challenge Results , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[16]  Fernando J. Pineda,et al.  Generalization of Back propagation to Recurrent and Higher Order Neural Networks , 1987, NIPS.

[17]  Bohyung Han,et al.  Learning Multi-domain Convolutional Neural Networks for Visual Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  William Stafford Noble,et al.  Support vector machine , 2013 .

[20]  Xiaogang Wang,et al.  Visual Tracking with Fully Convolutional Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[21]  Rynson W. H. Lau,et al.  CREST: Convolutional Residual Learning for Visual Tracking , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[22]  Luca Bertinetto,et al.  End-to-End Representation Learning for Correlation Filter Based Tracking , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Bruce A. Draper,et al.  Visual object tracking using adaptive correlation filters , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Michael Felsberg,et al.  Accurate Scale Estimation for Robust Visual Tracking , 2014, BMVC.

[25]  Michael Felsberg,et al.  Learning Spatially Regularized Correlation Filters for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[26]  Wei Zhao,et al.  Robust Tracking and Redetection: Collaboratively Modeling the Target and Its Context , 2018, IEEE Transactions on Multimedia.

[27]  Keqin Li,et al.  Dual Model Learning Combined With Multiple Feature Selection for Accurate Visual Tracking , 2019, IEEE Access.

[28]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[29]  Jiri Matas,et al.  Discriminative Correlation Filter with Channel and Spatial Reliability , 2017, CVPR.

[30]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Xi Chen,et al.  Multiscale fast correlation filtering tracking algorithm based on a feature fusion model , 2019, Concurr. Comput. Pract. Exp..

[32]  Zhe Chen,et al.  MUlti-Store Tracker (MUSTer): A cognitive psychology inspired approach to object tracking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Yanning Zhang,et al.  Real-Time Correlation Filter Tracking by Efficient Dense Belief Propagation With Structure Preserving , 2017, IEEE Transactions on Multimedia.

[34]  Xin Yu,et al.  Object Tracking With Multi-View Support Vector Machines , 2015, IEEE Transactions on Multimedia.

[35]  Simon Lucey,et al.  Learning Policies for Adaptive Tracking with Deep Feature Cascades , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[36]  Qingming Huang,et al.  Hedged Deep Tracking , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Jin Wang,et al.  Spatially Attentive Visual Tracking Using Multi-Model Adaptive Response Fusion , 2019, IEEE Access.

[38]  Luca Bertinetto,et al.  Staple: Complementary Learners for Real-Time Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Ming-Hsuan Yang,et al.  Hierarchical Convolutional Features for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[40]  Xin Yu,et al.  Hybrid support vector machines for robust object tracking , 2015, Pattern Recognit..

[41]  Vibhav Vineet,et al.  Struck: Structured Output Tracking with Kernels , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Seunghoon Hong,et al.  Online Tracking by Learning Discriminative Saliency Map with Convolutional Neural Network , 2015, ICML.

[43]  Lei Zhang,et al.  Learning Support Correlation Filters for Visual Tracking , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Kenli Li,et al.  A robust and fixed-time zeroing neural dynamics for computing time-variant nonlinear equation using a novel nonlinear activation function , 2019, Neurocomputing.

[45]  Michael Felsberg,et al.  Convolutional Features for Correlation Filter Based Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[46]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Jin Wang,et al.  A full convolutional network based on DenseNet for remote sensing scene classification. , 2019, Mathematical biosciences and engineering : MBE.