Graph-Regularized Structured Support Vector Machine for Object Tracking

How to build a robust and accurate appearance model is a crucial problem in object tracking. However, in most existing tracking methods, the structures among the adjacent video frames and neighboring regions, which may be helpful to improve the representation capability of the appearance model, have not been fully exploited. In this paper, we propose a novel tracking method by taking into account these structures to represent the appearance model. First, we propose a novel graph-regularized structured support vector machine (GS-SVM) algorithm by combining manifold learning and structured learning. Then, the proposed GS-SVM algorithm is employed to build the appearance model and a novel tracking method is developed. This new tracker not only absorbs the advantage of structured learning that deals with the intermediate classification step existing in tracking-by-detection methods, but also exploits the geometry structures in the tracked results and neighboring regions. In addition, a hybrid update strategy is introduced to fit with the GS-SVM-based appearance model. The experimental results demonstrate that the proposed tracking algorithm can outperform several state-of-the-art tracking methods in the benchmark dataset.

[1]  Andrea Cavallaro,et al.  Tracker-Level Fusion for Robust Bayesian Visual Tracking , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Horst Bischof,et al.  Real-Time Tracking via On-line Boosting , 2006, BMVC.

[3]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[4]  Yanxi Liu,et al.  Online Selection of Discriminative Tracking Features , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Horst Bischof,et al.  PROST: Parallel robust online simple tracking , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[7]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[8]  Yanning Zhang,et al.  Part-Based Visual Tracking with Online Latent Structural Learning , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Shai Avidan,et al.  Ensemble Tracking , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Ehud Rivlin,et al.  Robust Fragments-based Tracking using the Integral Histogram , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[13]  Huchuan Lu,et al.  Robust Superpixel Tracking , 2014, IEEE Transactions on Image Processing.

[14]  Charles A. Micchelli,et al.  Learning Multiple Tasks with Kernel Methods , 2005, J. Mach. Learn. Res..

[15]  Haibin Ling,et al.  Robust Visual Tracking using 1 Minimization , 2009 .

[16]  Chun Chen,et al.  Graph Regularized Sparse Coding for Image Representation , 2011, IEEE Transactions on Image Processing.

[17]  Shai Avidan,et al.  Support Vector Tracking , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[18]  Gérard G. Medioni,et al.  Context tracker: Exploring supporters and distracters in unconstrained environments , 2011, CVPR 2011.

[19]  Ming-Hsuan Yang,et al.  Robust Object Tracking with Online Multiple Instance Learning , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Hanqing Lu,et al.  A robust boosting tracker with minimum error bound in a co-training framework , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[21]  Thomas Hofmann,et al.  Large Margin Methods for Structured and Interdependent Output Variables , 2005, J. Mach. Learn. Res..

[22]  Antoine Bordes,et al.  Sequence Labelling SVMs Trained in One Pass , 2008, ECML/PKDD.

[23]  Huchuan Lu,et al.  Robust Visual Tracking via Multiple Kernel Boosting With Affinity Constraints , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Narendra Ahuja,et al.  Robust visual tracking via multi-task sparse learning , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Junseok Kwon,et al.  Tracking by Sampling Trackers , 2011, 2011 International Conference on Computer Vision.

[27]  Tianli Yu,et al.  Kernelized structural SVM learning for supervised object segmentation , 2011, CVPR 2011.

[28]  Lu Zhang,et al.  Structure Preserving Object Tracking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Xin Yu,et al.  Object Tracking With Multi-View Support Vector Machines , 2015, IEEE Transactions on Multimedia.

[30]  Junzhou Huang,et al.  Robust Visual Tracking Using Local Sparse Appearance Model and K-Selection , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Qing Wang,et al.  Object Tracking With Joint Optimization of Representation and Classification , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Christoph H. Lampert,et al.  Learning to Localize Objects with Structured Output Regression , 2008, ECCV.

[33]  Chunhong Pan,et al.  Manifold Regularized Local Sparse Representation for Face Recognition , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Jason Weston,et al.  Solving multiclass support vector machines with LaRank , 2007, ICML '07.

[35]  Qi Zhao,et al.  Co-Tracking Using Semi-Supervised Support Vector Machines , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[36]  Patrick Pérez,et al.  Color-Based Probabilistic Tracking , 2002, ECCV.

[37]  Xiaojun Wu,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Huchuan Lu,et al.  Robust Object Tracking via Sparse Collaborative Appearance Model , 2014, IEEE Transactions on Image Processing.

[39]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Huchuan Lu,et al.  A co-training framework for visual tracking with multiple instance learning , 2011, Face and Gesture 2011.

[41]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[42]  Junseok Kwon,et al.  Visual tracking decomposition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[43]  Huchuan Lu,et al.  L2-RLS-Based Object Tracking , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[44]  Chunhua Shen,et al.  Real-time visual tracking using compressive sensing , 2011, CVPR 2011.

[45]  Rui Caseiro,et al.  Exploiting the Circulant Structure of Tracking-by-Detection with Kernels , 2012, ECCV.

[46]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[47]  Laura Sevilla-Lara,et al.  Distribution fields for tracking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[48]  Huchuan Lu,et al.  Visual tracking via adaptive structural local sparse appearance model , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  Mikhail Belkin,et al.  Laplacian Support Vector Machines Trained in the Primal , 2009, J. Mach. Learn. Res..

[50]  Ling Shao,et al.  Recent advances and trends in visual tracking: A review , 2011, Neurocomputing.

[51]  Bohan Zhuang,et al.  Visual tracking via discriminative sparse similarity map. , 2014, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[52]  Thorsten Joachims,et al.  Cutting-plane training of structural SVMs , 2009, Machine Learning.

[53]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[54]  Gunnar Rätsch,et al.  Efficient Training of Graph-Regularized Multitask SVMs , 2012, ECML/PKDD.

[55]  Huchuan Lu,et al.  Robust object tracking via sparsity-based collaborative model , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[56]  Lei Zhang,et al.  Real-Time Compressive Tracking , 2012, ECCV.

[57]  Shai Avidan,et al.  Locally Orderless Tracking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.