Correlation-Filter Based Scale-Adaptive Visual Tracking With Hybrid-Scheme Sample Learning

In visual tracking, a mature scale estimation method can greatly improve tracking performance and provide accurate target information for model training. However, many visual tracking approaches ignore the scale estimation problem or adopt a heuristic and exhaustive scale-estimation strategy. In this paper, we propose a novel correlation-filter based visual tracking approach that reveals the missing link between scale estimation and the detection response. In contrast to many multi-scale visual trackers, which generate samples at different scales using some pre-designed criteria and then select the sample with the maximal classifier response, in this paper, we deduce a scale estimation equation based on detection responses; thus, the scale of the target object can be estimated mathematically. To obtain a more stable estimated object scale, a constraint function that considers the prior knowledge of visual tracking is proposed. Moreover, a hybrid sample learning scheme is formulated to select pertinent training samples with higher learning weights to train the appearance model. Our tracker operates under a framework of correlation filters to achieve a high tracking speed. We demonstrate the efficiency and robustness of our proposed tracking algorithm by comparing it with 14 other state-of-the-art trackers on all the video sequences in the object tracking benchmark (OTB) 2013 dataset.

[1]  Bohyung Han,et al.  Learning Multi-domain Convolutional Neural Networks for Visual Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Eduardo Ros Vidal,et al.  Robust Bioinspired Architecture for Optical-Flow Computation , 2010, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[3]  Ming-Hsuan Yang,et al.  Long-term correlation tracking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Haibin Ling,et al.  SANet: Structure-Aware Network for Visual Tracking , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[6]  Huihui Song Robust visual tracking via online informative feature selection , 2014 .

[7]  Venkatesh K. Subramanian,et al.  A Novel Vision-Based Tracking Algorithm for a Human-Following Mobile Robot , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[8]  Shiguang Shan,et al.  Self-Paced Curriculum Learning , 2015, AAAI.

[9]  Vincent Lepetit,et al.  Robust 3D Object Tracking from Monocular Images Using Stable Parts , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Shuicheng Yan,et al.  NUS-PRO: A New Visual Tracking Challenge , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Wen-Hsiao Peng,et al.  An Interframe Prediction Technique Combining Template Matching Prediction and Block-Motion Compensation for High-Efficiency Video Coding , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Jason Jianjun Gu,et al.  Compressive sensing with Weighted Local Classifiers for robot Visual tracking , 2016, Int. J. Robotics Autom..

[13]  Dit-Yan Yeung,et al.  Learning a Deep Compact Image Representation for Visual Tracking , 2013, NIPS.

[14]  Ming-Hsuan Yang,et al.  Hierarchical Convolutional Features for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[15]  Luca Bertinetto,et al.  Staple: Complementary Learners for Real-Time Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Gérard G. Medioni,et al.  Context tracker: Exploring supporters and distracters in unconstrained environments , 2011, CVPR 2011.

[17]  H. JoséAntonioMartín,et al.  FPGA-Based Multimodal Embedded Sensor System Integrating Low- and Mid-Level Vision , 2011, Sensors.

[18]  Bernard Ghanem,et al.  Context-Aware Correlation Filter Tracking , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Jason Jianjun Gu,et al.  Development and Evaluation of Object-Based Visual Attention for Automatic Perception of Robots , 2013, IEEE Transactions on Automation Science and Engineering.

[20]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Horst Bischof,et al.  Real-Time Tracking via On-line Boosting , 2006, BMVC.

[22]  Bohyung Han,et al.  Modeling and Propagating CNNs in a Tree Structure for Visual Tracking , 2016, ArXiv.

[23]  Yiannis Demiris,et al.  Attentional Correlation Filter Network for Adaptive Visual Tracking , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Michael Felsberg,et al.  ECO: Efficient Convolution Operators for Tracking , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Francisco Tirado,et al.  A Low Cost Matching Motion Estimation Sensor Based on the NIOS II Microprocessor , 2012, Sensors.

[26]  Jason Jianjun Gu,et al.  An Efficient Method for Traffic Sign Recognition Based on Extreme Learning Machine , 2017, IEEE Transactions on Cybernetics.

[27]  Lei Zhang,et al.  Fast Compressive Tracking , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Junseok Kwon,et al.  Tracking by Sampling Trackers , 2011, 2011 International Conference on Computer Vision.

[29]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Michael Felsberg,et al.  Beyond Correlation Filters: Learning Continuous Convolution Operators for Visual Tracking , 2016, ECCV.

[31]  Michael Felsberg,et al.  Learning Spatially Regularized Correlation Filters for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[32]  Huchuan Lu,et al.  Robust object tracking via sparsity-based collaborative model , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Francisco Tirado,et al.  Acceleration of block-matching algorithms using a custom instruction-based paradigm on a Nios II microprocessor , 2013, EURASIP J. Adv. Signal Process..

[34]  David Zhang,et al.  Fast Visual Tracking via Dense Spatio-temporal Context Learning , 2014, ECCV.

[35]  Huchuan Lu,et al.  Visual tracking via adaptive structural local sparse appearance model , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Rui Caseiro,et al.  Exploiting the Circulant Structure of Tracking-by-Detection with Kernels , 2012, ECCV.

[37]  Saeid Nooshabadi,et al.  A Scalable Massively Parallel Motion and Disparity Estimation Scheme for Multiview Video Coding , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[38]  Hongbo Zhu,et al.  A Directional-Edge-Based Real-Time Object Tracking System Employing Multiple Candidate-Location Generation , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[39]  Junseok Kwon,et al.  Visual tracking decomposition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[40]  Yuanlong Yu,et al.  Sparse coding extreme learning machine for classification , 2017, Neurocomputing.

[41]  Yuhui Zheng,et al.  Robust visual tracking via self-similarity learning , 2017 .

[42]  Michael Milford,et al.  3D tracking of water hazards with polarized stereo cameras , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[43]  Michael Felsberg,et al.  Accurate Scale Estimation for Robust Visual Tracking , 2014, BMVC.

[44]  Ming-Hsuan Yang,et al.  Object Tracking Benchmark , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Yang Li,et al.  Reliable Patch Trackers: Robust visual tracking by exploiting reliable patches , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).