Long-term real time object tracking based on multi-scale local correlation filtering and global re-detection

This paper investigates long-term visual object tracking which is a complex problem in computer vision community and big data analysis, due to the variation of the target and the surrounding environment. A novel tracking algorithm based on local correlation filtering and global keypoint matching is proposed to solve problems occurred during long-term tracking such as occlusion, target-losing, etc. The algorithm consists of two major components: (1) local object tracking module, and (2) global losing re-detection module. The local tracking module optimizes the conventional correlation filtering algorithm. Firstly, the Color Name feature is applied to increase the color sensitivity. Secondly, a scale traversal is employed to accommodate target scale changes. In the global losing re-detection module, the target losing judgment and global re-detection is realized by keypoint feature models of foreground and background. The proposed tracker achieves the 1st place in the VTB50 test set with 81.3% precision and 61.3% success rate, which outperforms other existing state-of-the-art trackers by over 10%. And it achieves the 2nd place in our Chasing-Car test set with a higher real-time performance 43.2 fps. The experimental results show that the proposed tracker has higher accuracy and robustness when dealing with situations like object deformation, occlusion and target-losing, etc.

[1]  Lei Zhang,et al.  Real-Time Compressive Tracking , 2012, ECCV.

[2]  Yang Wang,et al.  Weakly supervised object localization and segmentation in videos , 2016, Image Vis. Comput..

[3]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[4]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Zhe Chen,et al.  MUlti-Store Tracker (MUSTer): A cognitive psychology inspired approach to object tracking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Silvio Savarese,et al.  Learning to Track at 100 FPS with Deep Regression Networks , 2016, ECCV.

[7]  Kang-Hyun Jo,et al.  A fuzzy model-based integration framework for vision-based intelligent surveillance systems , 2017, 2017 IEEE International Conference on Mechatronics (ICM).

[8]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Rama Krishna Sai Subrahmanyam Gorthi,et al.  Detection based long term tracking in correlation filter trackers , 2019, Pattern Recognit. Lett..

[10]  Cordelia Schmid,et al.  Learning Color Names for Real-World Applications , 2009, IEEE Transactions on Image Processing.

[11]  David Dagan Feng,et al.  Real-Time Long-Term Tracking With Prediction-Detection-Correction , 2018, IEEE Transactions on Multimedia.

[12]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Salah Sukkarieh,et al.  Vision-aided Guidance and Navigation for Close Formation Flight , 2016, J. Field Robotics.

[14]  Bohyung Han,et al.  Learning Multi-domain Convolutional Neural Networks for Visual Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Ming-Hsuan Yang,et al.  Long-term correlation tracking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Stan Sclaroff,et al.  MEEM: Robust Tracking via Multiple Experts Using Entropy Minimization , 2014, ECCV.

[18]  Zhifeng Zhang,et al.  Research on lamp auto-control system based on infrared image processing , 2016 .