Online visual tracking based on subspace representation with continuous occlusion modeling

As an important issue in image processing and computer vision, online visual tracking acts a critical role in numerous lines of research and has many potential applications. This paper presents a novel tracking algorithm based on subspace representation with continuous occlusion handling, the contributions of which are threefolds. First, this paper develops an effective objective function to represent the tracked object, in which the object reconstruction, the sparsity of the error term and the spatial consistency of the error term are simultaneously considered. Then, we derive an iterative algorithm to solve the proposed objective function based on the accelerated proximal gradient framework, and therefore obtain the optimal representation coefficients and the possible occlusion conditions. Finally, based on the proposed representation model, we design an effective likelihood function and a simple model update scheme for building a robust tracker within the particle filter framework. We conduct many experiments to evaluate the proposed tracking algorithm in comparisons with other state-of-the-art trackers. Both qualitative and quantitative evaluations demonstrate the proposed tracker achieves good performance.

[1]  Li Bai,et al.  Efficient Minimum Error Bounded Particle Resampling L1 Tracker With Occlusion Detection , 2013, IEEE Transactions on Image Processing.

[2]  Horst Bischof,et al.  Semi-supervised On-Line Boosting for Robust Tracking , 2008, ECCV.

[3]  Horst Bischof,et al.  On-line Boosting and Vision , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[4]  Narendra Ahuja,et al.  Robust Visual Tracking via Structured Multi-Task Sparse Learning , 2012, International Journal of Computer Vision.

[5]  Haibin Ling,et al.  Robust Visual Tracking using 1 Minimization , 2009 .

[6]  Yan Liu,et al.  Soft-assigned bag of features for object tracking , 2014, Multimedia Systems.

[7]  Changsheng Xu,et al.  Partial Occlusion Handling for Visual Tracking via Robust Part Matching , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Huchuan Lu,et al.  Robust Superpixel Tracking , 2014, IEEE Transactions on Image Processing.

[9]  Kaihua Zhang,et al.  Real-time visual tracking via online weighted multiple instance learning , 2013, Pattern Recognit..

[10]  Haijun Wang,et al.  Object Tracking via 2DPCA and ℓ2-Regularization , 2016, J. Electr. Comput. Eng..

[11]  Weiqiang Wang,et al.  Robust object tracking via incremental subspace dynamic sparse model , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[12]  Narendra Ahuja,et al.  Robust visual tracking via multi-task sparse learning , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Narendra Ahuja,et al.  Robust Visual Tracking Via Consistent Low-Rank Sparse Learning , 2014, International Journal of Computer Vision.

[14]  Ehud Rivlin,et al.  Robust Fragments-based Tracking using the Integral Histogram , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[15]  Huchuan Lu,et al.  Least Soft-Threshold Squares Tracking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Huchuan Lu,et al.  Robust object tracking via sparsity-based collaborative model , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Haibin Ling,et al.  Real time robust L1 tracker using accelerated proximal gradient approach , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Junzhou Huang,et al.  Robust tracking using local sparse appearance model and K-selection , 2011, CVPR 2011.

[19]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[20]  Huchuan Lu,et al.  On-line learning parts-based representation via incremental orthogonal projective non-negative matrix factorization , 2013, Signal Process..

[21]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Tobias Bjerregaard,et al.  A survey of research and practices of Network-on-chip , 2006, CSUR.

[23]  Xiaoqin Zhang,et al.  Incremental Tensor Subspace Learning and Its Applications to Foreground Segmentation and Tracking , 2011, International Journal of Computer Vision.

[24]  Junseok Kwon,et al.  Visual tracking decomposition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[25]  Zhongfei Zhang,et al.  A survey of appearance models in visual object tracking , 2013, ACM Trans. Intell. Syst. Technol..

[26]  Ling Shao,et al.  Recent advances and trends in visual tracking: A review , 2011, Neurocomputing.

[27]  Ming-Hsuan Yang,et al.  Visual tracking with online Multiple Instance Learning , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Huchuan Lu,et al.  Visual Tracking via Probability Continuous Outlier Model , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Hainan Zhao,et al.  Robust visual tracking via discriminative appearance model based on sparse coding , 2014, Multimedia Systems.

[31]  Weiqiang Wang,et al.  Robust object tracking via multi-task dynamic sparse model , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[32]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Huchuan Lu,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON IMAGE PROCESSING 1 Online Object Tracking with Sparse Prototypes , 2022 .

[35]  Weiqiang Wang,et al.  Object tracking based on local dynamic sparse model , 2015, J. Vis. Commun. Image Represent..

[36]  Huchuan Lu,et al.  Object Tracking via 2DPCA and $\ell_{1}$-Regularization , 2012, IEEE Signal Processing Letters.

[37]  Rynson W. H. Lau,et al.  Visual Tracking via Locality Sensitive Histograms , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Huchuan Lu,et al.  Visual tracking via adaptive structural local sparse appearance model , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Narendra Ahuja,et al.  Low-Rank Sparse Learning for Robust Visual Tracking , 2012, ECCV.

[40]  Changsheng Xu,et al.  Object Tracking by Occlusion Detection via Structured Sparse Learning , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[41]  Vibhav Vineet,et al.  Struck: Structured Output Tracking with Kernels , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Patrick Pérez,et al.  Color-Based Probabilistic Tracking , 2002, ECCV.

[43]  Michael J. Black,et al.  EigenTracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation , 1996, International Journal of Computer Vision.

[44]  Xiaoqin Zhang,et al.  Visual tracking via incremental Log-Euclidean Riemannian subspace learning , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Huchuan Lu,et al.  Robust Object Tracking via Sparse Collaborative Appearance Model , 2014, IEEE Transactions on Image Processing.