Multi-Feature Fusion Target Re-Location Tracking Based on Correlation Filters

Target tracking has been a research hotspot in computer vision, and the correlation filtered target tracking algorithm has the benefits of low computational complexity and fast speed. Still, the tracking effect is not good when dealing with complicated circumstances. This paper proposes a multi-feature fusion target repositioning tracking algorithm for the target tracking problem in complex environments. First, a multi-feature weighted fusion algorithm is presented. Since each feature has different advantages in different environments, we combine HOG, CN, ULBP, and image edge features and use the weighted coefficient method to adaptively fuse each feature component. Second, to address the target occlusion problem, an occlusion judgment mechanism is introduced, and the target is re-located by fusion weighted filtering. Third, the scale pool is established, and the scale filter is trained by the classification search method. Finally, an adaptive model update strategy is proposed. We conduct comparison experiments with current mainstream algorithms on the publicly available datasets OTB-2015, VOT2018, UAV123, and TColor-128, respectively, and the experimental results show that our proposed algorithm is more robust in complex scenarios.

[1]  Michael Felsberg,et al.  The Sixth Visual Object Tracking VOT2018 Challenge Results , 2018, ECCV Workshops.

[2]  Huseyin Ozkan,et al.  Extending Correlation Filter-Based Visual Tracking by Tree-Structured Ensemble and Spatial Windowing , 2017, IEEE Transactions on Image Processing.

[3]  Jianke Zhu,et al.  A Scale Adaptive Kernel Correlation Filter Tracker with Feature Integration , 2014, ECCV Workshops.

[4]  Zhenyu He,et al.  Particle filter re-detection for visual tracking via correlation filters , 2018, Multimedia Tools and Applications.

[5]  Michael Felsberg,et al.  Learning Spatially Regularized Correlation Filters for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  Michael Felsberg,et al.  Adaptive Color Attributes for Real-Time Visual Tracking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Lei Yang,et al.  A Joint Multi-Feature and Scale-Adaptive Correlation Filter Tracker , 2018, IEEE Access.

[8]  Feng Li,et al.  Learning Spatial-Temporal Regularized Correlation Filters for Visual Tracking , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[9]  Philip H.S. Torr,et al.  Siam R-CNN: Visual Tracking by Re-Detection , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Rui Caseiro,et al.  Exploiting the Circulant Structure of Tracking-by-Detection with Kernels , 2012, ECCV.

[11]  Rui Caseiro,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence High-speed Tracking with Kernelized Correlation Filters , 2022 .

[12]  Luca Bertinetto,et al.  Staple: Complementary Learners for Real-Time Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Bernard Ghanem,et al.  A Benchmark and Simulator for UAV Tracking , 2016, ECCV.

[14]  Zhihua Xie,et al.  Real Time Target Tracking Scale Adaptive Based on LBP Operator and Nonlinear Meanshift , 2017, 2017 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC).

[15]  Yafei Zhang,et al.  Combining Color Attributes for Scale Adaptive Correlation Tracking , 2016, 2016 3rd International Conference on Information Science and Control Engineering (ICISCE).

[16]  Michael Felsberg,et al.  Accurate Scale Estimation for Robust Visual Tracking , 2014, BMVC.

[17]  Michael Felsberg,et al.  Unveiling the Power of Deep Tracking , 2018, ECCV.

[18]  Zhenyu He,et al.  TRBACF: Learning temporal regularized correlation filters for high performance online visual object tracking , 2020, J. Vis. Commun. Image Represent..

[19]  Josef Kittler,et al.  Learning Adaptive Discriminative Correlation Filters via Temporal Consistency Preserving Spatial Feature Selection for Robust Visual Object Tracking , 2018, IEEE Transactions on Image Processing.

[20]  Xiangfei Nie,et al.  Face illumination invariant feature extraction based on edge detection operator , 2017, 2017 IEEE International Conference on Imaging Systems and Techniques (IST).

[21]  Zhenyu He,et al.  Robust visual tracking with correlation filters and metric learning , 2020, Knowl. Based Syst..

[22]  Lu Leng,et al.  Robust Visual Tracking With Occlusion Judgment and Re-Detection , 2020, IEEE Access.

[23]  Ming-Hsuan Yang,et al.  Object Tracking Benchmark , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Michael Felsberg,et al.  Convolutional Features for Correlation Filter Based Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[25]  Bruce A. Draper,et al.  Visual object tracking using adaptive correlation filters , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[26]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Thin Lai Lai Thein,et al.  Parking Space Detection using Complemented-ULBP Background Subtraction , 2019, 2019 IEEE 8th Global Conference on Consumer Electronics (GCCE).

[28]  Wei Liu,et al.  Unsupervised Deep Tracking , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Jingtai Liu,et al.  A multi-scale kernel correlation filter tracker with feature integration and robust model updater , 2017, 2017 29th Chinese Control And Decision Conference (CCDC).

[30]  Simon Lucey,et al.  Learning Background-Aware Correlation Filters for Visual Tracking , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[31]  Michael Felsberg,et al.  ECO: Efficient Convolution Operators for Tracking , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Zhenyu He,et al.  Self-Supervised Deep Correlation Tracking , 2020, IEEE Transactions on Image Processing.

[33]  Scott T. Acton,et al.  SITUP: Scale Invariant Tracking Using Average Peak-to-Correlation Energy , 2018, IEEE Transactions on Image Processing.

[34]  Di Yuan,et al.  A multiple feature fused model for visual object tracking via correlation filters , 2019, Multimedia Tools and Applications.

[35]  Gang Yu,et al.  An Improved Kernel Correlation Filter for Occlusion Target Tracking , 2019, 2019 IEEE 4th International Conference on Image, Vision and Computing (ICIVC).

[36]  Gang Wang,et al.  Real-time part-based visual tracking via adaptive correlation filters , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[38]  Stan Sclaroff,et al.  MEEM: Robust Tracking via Multiple Experts Using Entropy Minimization , 2014, ECCV.

[39]  Zhe Chen,et al.  MUlti-Store Tracker (MUSTer): A cognitive psychology inspired approach to object tracking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Erik Blasch,et al.  Encoding color information for visual tracking: Algorithms and benchmark , 2015, IEEE Transactions on Image Processing.