RobStruck: Improving occlusion handling of structured tracking-by-detection using robust Kalman filter

Starting from an object's location in a video frame, tracking-by-detection methods find the location of that object in a subsequent video frame. The tracker's detection step may produce multiple false positives during short-term occlusions, which can result in loss of track. We propose a tracking-by-detection method that is robust to short-term occlusions and false positives. Here, we extend the Struck tracker, which is based on structured SVM, to output bounding boxes at multiple scales. In addition to predicting scale changes, we use the Robust Kalman filter to decrease false-positive detections and to increase the tracker resilience to short-time occlusions. Here, we develop a special strategy for the tracker's update step, which is designed to decrease over fitting and to allow for the tracker to recover from loss of track. We thoroughly evaluate our method on a publicly available video dataset and show that it outperforms the state-of-the-art.

[1]  Rui Caseiro,et al.  Exploiting the Circulant Structure of Tracking-by-Detection with Kernels , 2012, ECCV.

[2]  Vibhav Vineet,et al.  Struck: Structured Output Tracking with Kernels , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Simone Calderara,et al.  Visual Tracking: An Experimental Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Jin Gao,et al.  Transfer Learning Based Visual Tracking with Gaussian Processes Regression , 2014, ECCV.

[5]  Antoine Bordes,et al.  Sequence Labelling SVMs Trained in One Pass , 2008, ECML/PKDD.

[6]  C BergAlexander,et al.  Efficient Classification for Additive Kernel SVMs , 2013 .

[7]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Michael Felsberg,et al.  Accurate Scale Estimation for Robust Visual Tracking , 2014, BMVC.

[9]  Jianke Zhu,et al.  A Scale Adaptive Kernel Correlation Filter Tracker with Feature Integration , 2014, ECCV Workshops.

[10]  Huchuan Lu,et al.  Robust object tracking via sparsity-based collaborative model , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Peter Ruckdeschel,et al.  Optimally Robust Kalman Filtering , 2010 .

[12]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Subhransu Maji,et al.  Efficient Classification for Additive Kernel SVMs , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Jason Weston,et al.  Solving multiclass support vector machines with LaRank , 2007, ICML '07.

[15]  Thomas Hofmann,et al.  Support vector machine learning for interdependent and structured output spaces , 2004, ICML.

[16]  Koby Crammer,et al.  Multi-Class Pegasos on a Budget , 2010, ICML.