Adaptive Visual Tracking Based on Key Frame Selection and Reinforcement Learning

When the appearance of a target changes dramatically, the traditional tracking methods can no longer be used for target tracking task. This paper proposes an adaptive visual tracking algorithm based on key frame selection and reinforcement learning (RL) to solve this problem. First of all, the probability value of the RL network output is analyzed, and the predicted value of output is normalized. At the model update stage of each frame, the probability value corresponding to the optimal behavior is judged. If it conforms to the preset rules, the last frame of the current frame is set as the key frame, and the network model is fine-tuned by using the key frame. The proposed algorithm is only fine-tuned in key frames to obtain multiple fixed prediction models. The experiment is conducted on 100 video sequences of the Object Tracking Benchmark to verify the effectiveness of key frame selection strategy. Compared with the original reinforcement learning based tracking algorithm, the tracking accuracy and the success rate of the proposed algorithm are improved respectively.

[1]  Jin Young Choi,et al.  Action-Decision Networks for Visual Tracking with Deep Reinforcement Learning , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Seunghoon Hong,et al.  Online Tracking by Learning Discriminative Saliency Map with Convolutional Neural Network , 2015, ICML.

[4]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Dimitris N. Metaxas,et al.  Optical Flow Constraints on Deformable Models with Applications to Face Tracking , 2000, International Journal of Computer Vision.

[6]  Yi Li,et al.  DeepTrack: Learning Discriminative Feature Representations by Convolutional Neural Networks for Visual Tracking , 2014, BMVC.

[7]  Haibin Ling,et al.  Robust Visual Tracking and Vehicle Classification via Sparse Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Ming-Hsuan Yang,et al.  Hierarchical Convolutional Features for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).