相关论文

Robust Visual Tracking via Structured Multi-Task Sparse Learning

Abstract:In this paper, we formulate object tracking in a particle filter framework as a structured multi-task sparse learning problem, which we denote as Structured Multi-Task Tracking (S-MTT). Since we model particles as linear combinations of dictionary templates that are updated dynamically, learning the representation of each particle is considered a single task in Multi-Task Tracking (MTT). By employing popular sparsity-inducing $$\ell _{p,q}$$ mixed norms $$(\text{ specifically} p\in \{2,\infty \}$$ and $$q=1),$$ we regularize the representation problem to enforce joint sparsity and learn the particle representations together. As compared to previous methods that handle particles independently, our results demonstrate that mining the interdependencies between particles improves tracking performance and overall computational complexity. Interestingly, we show that the popular $$L_1$$ tracker (Mei and Ling, IEEE Trans Pattern Anal Mach Intel 33(11):2259–2272, 2011) is a special case of our MTT formulation (denoted as the $$L_{11}$$ tracker) when $$p=q=1.$$ Under the MTT framework, some of the tasks (particle representations) are often more closely related and more likely to share common relevant covariates than other tasks. Therefore, we extend the MTT framework to take into account pairwise structural correlations between particles (e.g. spatial smoothness of representation) and denote the novel framework as S-MTT. The problem of learning the regularized sparse representation in MTT and S-MTT can be solved efficiently using an Accelerated Proximal Gradient (APG) method that yields a sequence of closed form updates. As such, S-MTT and MTT are computationally attractive. We test our proposed approach on challenging sequences involving heavy occlusion, drastic illumination changes, and large pose variations. Experimental results show that S-MTT is much better than MTT, and both methods consistently outperform state-of-the-art trackers.

摘要:本文将粒子滤波框架中的目标跟踪问题描述为一个结构化多任务稀疏学习问题,我们称之为结构化多任务跟踪(S-mtt)。由于我们将粒子建模为动态更新的字典模板的线性组合,因此在多任务跟踪(MTT)中,学习每个粒子的表示被视为一项单一任务。通过使用流行的稀疏性诱导$$\ell_p,q}$$混合范数$$(特别是p\in2,inty$$和$$q=1),我们将表示问题正则化以强制联合稀疏性,并一起学习粒子表示。与以往单独处理粒子的方法相比,我们的结果表明,挖掘粒子之间的相互依赖关系提高了跟踪性能和整体计算复杂度。有趣的是,我们证明了流行的$$L_1$$跟踪器(Mei和Ling,IEEE Transans Pattern Anal Mach Intel 33(11):2259-2272,2011)是我们的MTT公式的特例(表示为$$L_{11}$tracker),当$$p=q=1时。$$在MTT框架下,一些任务(粒子表示)通常比其他任务更紧密地相关,并且更有可能共享共同的相关协变量。因此,我们扩展了四甲基偶氮唑蓝框架以考虑粒子之间的两两结构相关性(例如,表示的空间光滑性),并将新的框架命名为S-四甲基偶氮唑蓝。利用一种产生闭合形式更新序列的加速近邻梯度(APG)方法,可以有效地解决在MTT法和S-MTT法中学习正则化稀疏表示的问题。因此,S-四甲基偶氮唑蓝和四甲基偶氮唑蓝在计算上具有吸引力。我们在涉及严重遮挡、剧烈光照变化和较大姿势变化的挑战序列上测试了我们提出的方法。实验结果表明,S-MTT法比MTT法要好得多,而且这两种方法的性能都一致优于最先进的跟踪器。

参考文献

[1]  N. Ahuja,et al.  Robust Visual Tracking via MultiTask Sparse Learning , 2012 .

[2]  Horst Bischof,et al.  On-Line Multi-view Forests for Tracking , 2010, DAGM-Symposium.

[3]  Chunhua Shen,et al.  Real-time visual tracking using compressive sensing , 2011, CVPR 2011.

[4]  David J. Fleet,et al.  Robust Online Appearance Models for Visual Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[6]  Rama Chellappa,et al.  Visual tracking and recognition using appearance-adaptive models in particle filters , 2004, IEEE Transactions on Image Processing.

[7]  Junzhou Huang,et al.  Robust and Fast Collaborative Tracking with Two Stage Sparse Optimization , 2010, ECCV.

[8]  Trevor Darrell,et al.  An efficient projection for l 1 , infinity regularization. , 2009, ICML 2009.

[9]  Ying Wu,et al.  Robust Visual Tracking by Integrating Multiple Cues Based on Co-Inference Learning , 2004, International Journal of Computer Vision.

[10]  Erik Blasch,et al.  Minimum Error Bounded Efficient L1 Tracker with Occlusion Detection (PREPRINT) , 2011 .

[11]  Michael J. Black,et al.  EigenTracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation , 1996, International Journal of Computer Vision.

[12]  Y. Nesterov Gradient methods for minimizing composite objective function , 2007 .

[13]  Haibin Ling,et al.  Real time robust L1 tracker using accelerated proximal gradient approach , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Junzhou Huang,et al.  Robust tracking using local sparse appearance model and K-selection , 2011, CVPR 2011.

[15]  Timothy J. Robinson,et al.  Sequential Monte Carlo Methods in Practice , 2003 .

[16]  John Wright,et al.  RASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Gang Hua,et al.  Context-Aware Visual Tracking , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Shai Avidan,et al.  Ensemble Tracking , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Haibin Ling,et al.  Robust Visual Tracking and Vehicle Classification via Sparse Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Ming-Hsuan Yang,et al.  Visual tracking with online Multiple Instance Learning , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  E. Blasch,et al.  Multiresolution EO/IR target tracking and identification , 2005, 2005 7th International Conference on Information Fusion.

[23]  Gérard G. Medioni,et al.  Online Tracking and Reacquisition Using Co-trained Generative and Discriminative Trackers , 2008, ECCV.

[24]  Robert T. Collins,et al.  Object tracking and detection after occlusion via numerical hybrid local and global mode-seeking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Ehud Rivlin,et al.  Robust Fragments-based Tracking using the Integral Histogram , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[26]  R. Collins,et al.  On-line selection of discriminative tracking features , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[27]  Horst Bischof,et al.  Real-Time Tracking via On-line Boosting , 2006, BMVC.

[28]  Horst Bischof,et al.  Semi-supervised On-Line Boosting for Robust Tracking , 2008, ECCV.

[29]  Hanqing Lu,et al.  A robust boosting tracker with minimum error bound in a co-training framework , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[30]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[31]  Junseok Kwon,et al.  Visual tracking decomposition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[33]  Shuicheng Yan,et al.  Visual classification with multi-task joint sparse representation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[34]  Larry S. Davis,et al.  Fast multiple object tracking via a hierarchical particle filter , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[35]  Trevor Darrell,et al.  An efficient projection for l1, ∞ regularization , 2009, ICML '09.

[36]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[37]  Narendra Ahuja,et al.  Low-Rank Sparse Learning for Robust Visual Tracking , 2012, ECCV.

[38]  Xi Chen,et al.  Accelerated Gradient Method for Multi-task Sparse Learning Problem , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[39]  Frank Dellaert,et al.  A Rao-Blackwellized particle filter for EigenTracking , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[40]  Narendra Ahuja,et al.  Robust visual tracking via multi-task sparse learning , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Nan Jiang,et al.  Adaptive and discriminative metric differential tracking , 2011, CVPR 2011.

[42]  F. Dellaert,et al.  A Rao-Blackwellized particle filter for EigenTracking , 2004, CVPR 2004.

引用
Cross-Domain Multi-Event Tracking via CO-PMHT
TOMM
2014
Abnormal Event Detection From Videos Using a Two-Stream Recurrent Variational Autoencoder
IEEE Transactions on Cognitive and Developmental Systems
2020
Universal representations: The missing link between faces, text, planktons, and cat breeds
ArXiv
2017
Learning Adaptive Discriminative Correlation Filters via Temporal Consistency Preserving Spatial Feature Selection for Robust Visual Object Tracking
IEEE Transactions on Image Processing
2018
Encoding color information for visual tracking: Algorithms and benchmark
IEEE Transactions on Image Processing
2015
Integration of texture and depth information for robust object tracking
2014 IEEE International Conference on Granular Computing (GrC)
2014
Visual tracking via multi-task non-negative matrix factorization
2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
2016
Minimum barrier distance based tracking via spatio-temporal context learning
2019
An Improved MEEM Tracker via Adaptive Binary Feature Encoding
CCPR
2016
Object tracking via collaborative multi-task learning and appearance model updating
Appl. Soft Comput.
2015
Minimum Uncertainty Gap for Robust Visual Tracking
2013 IEEE Conference on Computer Vision and Pattern Recognition
2013
Orderless Tracking through Model-Averaged Posterior Estimation
2013 IEEE International Conference on Computer Vision
2013
Robust Visual Tracking via Multiple Kernel Boosting With Affinity Constraints
IEEE Transactions on Circuits and Systems for Video Technology
2014
Visual Tracking via Locally Structured Gaussian Process Regression
IEEE Signal Processing Letters
2015
A Multi-task Learning Framework for Time-continuous Emotion Estimation from Crowd Annotations
CrowdMM '14
2014
Uncertainty Calibrated Markov Chain Monte Carlo Sampler for Visual Tracking Based on Multi-shape Posterior
Journal of Mathematical Imaging and Vision
2017
Particle dynamics and multi-channel feature dictionaries for robust visual tracking
BMVC
2015
Part-Based Data Association for Visual Tracking
2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA)
2017
Cascaded probabilistic tracking with supervised dictionary learning
Signal Process. Image Commun.
2015
Integration of Regularized l1 Tracking and Instance Segmentation for Video Object Tracking
Neurocomputing
2019