Visual tracking tracker via object proposals and co-trained kernelized correlation filters

Visual tracking is a challenging task in the field of computer vision with wide applications in intelligent and surveillance systems. Recently, correlation trackers have shown great achievement in visual tracking due to its high efficiency. However, such trackers have a problem of handling fast motion, motion blur, illumination variations, background clutter and drifting away caused by occlusion and thus may result in tracking failure. To solve this problem, we propose a tracker that is based on the object proposals and co-kernelized correlation filters (Co-KCF). The proposed tracker utilizes both object proposals and global prediction estimated by kernelized correlation filter scheme to obtain best proposals as prior information using spatial weight strategy in order to improve tracking performance of fast motion and motion blur. Since single kernel may lead to background clutter and drifting problem, Co-KCF has been employed to combat this defect and predict a new state of a target object. Extensive experiments demonstrate that our proposed tracker outperforms other existing state-of-the-art trackers.

[1]  Jiri Matas,et al.  Discriminative Correlation Filter with Channel and Spatial Reliability , 2017, CVPR.

[2]  Michael Felsberg,et al.  Accurate Scale Estimation for Robust Visual Tracking , 2014, BMVC.

[3]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Haibin Ling,et al.  Parallel Tracking and Verifying: A Framework for Real-Time and High Accuracy Visual Tracking , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[5]  Luca Bertinetto,et al.  Fully-Convolutional Siamese Networks for Object Tracking , 2016, ECCV Workshops.

[6]  Michael Felsberg,et al.  Adaptive Color Attributes for Real-Time Visual Tracking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  C. Lawrence Zitnick,et al.  Edge Boxes: Locating Object Proposals from Edges , 2014, ECCV.

[8]  Ming Tang,et al.  Multi-kernel Correlation Filter for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[9]  Dongbing Gu,et al.  Abrupt motion tracking using a visual saliency embedded particle filter , 2014, Pattern Recognit..

[10]  Dongbing Gu,et al.  Structural sparse representation-based semi-supervised learning and edge detection proposal for visual tracking , 2017, The Visual Computer.

[11]  Weiping Ni,et al.  Visual tracking using Siamese convolutional neural network with region proposal and domain specific updating , 2018, Neurocomputing.

[12]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Fumin Shen,et al.  Exploiting Spatial Structure from Parts for Adaptive Kernelized Correlation Filter Tracker , 2016, IEEE Signal Processing Letters.

[14]  David Zhang,et al.  Fast Visual Tracking via Dense Spatio-temporal Context Learning , 2014, ECCV.

[15]  Jing Wang,et al.  Sparse Coding and Counting for Robust Visual Tracking , 2016, PloS one.

[16]  Hanqing Lu,et al.  Collaborative Correlation Tracking , 2015, BMVC.

[17]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[18]  Jin Gao,et al.  Transfer Learning Based Visual Tracking with Gaussian Processes Regression , 2014, ECCV.

[19]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  Aykut Erdem,et al.  Deformable part-based tracking by coupled global and local correlation filters , 2016, J. Vis. Commun. Image Represent..

[21]  Cordelia Schmid,et al.  Online Object Tracking with Proposal Selection , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[22]  Changsheng Xu,et al.  Multi-task Correlation Particle Filter for Robust Object Tracking , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Narendra Ahuja,et al.  Robust Visual Tracking Using Oblique Random Forests , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Lennart Larsson,et al.  Rhinitis, Ocular, Throat and Dermal Symptoms, Headache and Tiredness among Students in Schools from Johor Bahru, Malaysia: Associations with Fungal DNA and Mycotoxins in Classroom Dust , 2016, PloS one.

[25]  Junxing Zhang,et al.  Object tracking using Langevin Monte Carlo particle filter and locality sensitive histogram based likelihood model , 2018, Comput. Graph..

[26]  Junseok Kwon,et al.  Highly Nonrigid Object Tracking via Patch-Based Dynamic Appearance Modeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[28]  Huchuan Lu,et al.  Visual tracking via adaptive structural local sparse appearance model , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Le Zhang,et al.  Robust visual tracking via co-trained Kernelized correlation filters , 2017, Pattern Recognit..

[30]  Huchuan Lu,et al.  Robust object tracking via sparsity-based collaborative model , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Ming-Hsuan Yang,et al.  Object Tracking Benchmark , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Michael Felsberg,et al.  Beyond Correlation Filters: Learning Continuous Convolution Operators for Visual Tracking , 2016, ECCV.

[33]  Haibin Ling,et al.  Robust visual tracking using ℓ1 minimization , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[34]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Huchuan Lu,et al.  Superpixel tracking , 2011, 2011 International Conference on Computer Vision.

[36]  Huchuan Lu,et al.  Least Soft-Threshold Squares Tracking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Jiri Matas,et al.  A Novel Performance Evaluation Methodology for Single-Target Trackers , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Zhiyong Li,et al.  Robust Object Tracking via Local Sparse Appearance Model , 2018, IEEE Transactions on Image Processing.

[39]  Jinhai Xiang,et al.  Robust Visual Tracking via Local-Global Correlation Filter , 2017, AAAI.

[40]  Changsheng Xu,et al.  Structural Sparse Tracking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Junsong Yuan,et al.  Adobe Boxes: Locating Object Proposals Using Object Adobes , 2016, IEEE Transactions on Image Processing.

[42]  Zhiyong Li,et al.  Robust object tracking via multi-feature adaptive fusion based on stability: contrast analysis , 2015, The Visual Computer.

[43]  Xiaogang Wang,et al.  Visual Tracking with Fully Convolutional Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[44]  Luca Bertinetto,et al.  End-to-End Representation Learning for Correlation Filter Based Tracking , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Simone Calderara,et al.  Visual Tracking: An Experimental Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Ming-Hsuan Yang,et al.  Hierarchical Convolutional Features for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[47]  Yanning Zhang,et al.  Part-Based Visual Tracking with Online Latent Structural Learning , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[48]  Yang Li,et al.  Reliable Patch Trackers: Robust visual tracking by exploiting reliable patches , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[49]  Bruce A. Draper,et al.  Visual object tracking using adaptive correlation filters , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[50]  Luca Bertinetto,et al.  Staple: Complementary Learners for Real-Time Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[51]  Jin Gao,et al.  Robust visual tracking using joint scale-spatial correlation filters , 2015, 2015 IEEE International Conference on Image Processing (ICIP).