Robust object tracking using a spatial pyramid heat kernel structural information representation

In this paper, we propose an object tracking framework based on a spatial pyramid heat kernel structural information representation. In the tracking framework, we take advantage of heat kernel structural information (HKSI) matrices to represent object appearance, because HKSI matrices perform well in characterizing the edge flow (or structural) information on the object appearance graph. To further capture the multi-level spatial layout information of the HKSI matrices, a spatial pyramid division strategy is adopted. Then, multi-scale HKSI subspace analysis is applied to each spatial pyramid grid at different levels. As a result, several grid-specific HKSI subspace models are obtained and updated by the incremental PCA algorithm. Based on the multi-scale grid-specific HKSI subspace models, we propose a tracking framework using a particle filter to propagate sample distributions over time. Theoretical analysis and experimental evaluations demonstrate the effectiveness of the proposed tracking framework.

[1]  Rama Chellappa,et al.  Appearance modeling under geometric context , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[2]  Qi Zhao,et al.  Differential EMD Tracking , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[3]  Alper Yilmaz,et al.  Object Tracking by Asymmetric Kernel Mean Shift with Automatic Scale and Orientation Selection , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Fatih Murat Porikli,et al.  Covariance Tracking using Model Update Based on Lie Algebra , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[5]  Xiaoqin Zhang,et al.  Robust Visual Tracking Based on Incremental Tensor Subspace Learning , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[6]  Danijel Skocaj,et al.  Weighted and robust incremental method for subspace learning , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[7]  Ying Wu,et al.  Differential Tracking based on Spatial-Appearance Model (SAM) , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[8]  David Suter,et al.  Adaptive Object Tracking Based on an Effective Appearance Filter , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Michael J. Black,et al.  EigenTracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation , 1996, ECCV.

[10]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[11]  Xiaoqin Zhang,et al.  Visual tracking via incremental Log-Euclidean Riemannian subspace learning , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Gregory D. Hager,et al.  Real-time tracking of image regions with changes in geometry and illumination , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Yongmin Li,et al.  On incremental and robust subspace learning , 2004, Pattern Recognit..

[14]  Chunhua Shen,et al.  Kernel-based Tracking from a Probabilistic Viewpoint , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Edwin R. Hancock,et al.  Characterising Graphs using the Heat Kernel , 2005, BMVC.

[16]  Edwin R. Hancock,et al.  Heat Kernels, Manifolds and Graph Embedding , 2004, SSPR/SPR.

[17]  Pascal Fua,et al.  Non-Linear Beam Model for Tracking Large Deformations , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[18]  David J. Fleet,et al.  Robust Online Appearance Models for Visual Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Xiaoqin Zhang,et al.  Robust Visual Tracking Based on an Effective Appearance Model , 2008, ECCV.

[20]  Ming-Hsuan Yang,et al.  Visual tracking with online Multiple Instance Learning , 2009, CVPR.

[21]  Michael Isard,et al.  Contour Tracking by Stochastic Propagation of Conditional Density , 1996, ECCV.

[22]  Mario Sznaier,et al.  Dynamic Appearance Modeling for Human Tracking , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[23]  David J. Kriegman,et al.  Online learning of probabilistic appearance manifolds for video-based recognition and tracking , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[24]  Larry S. Davis,et al.  Robust Object Trackinng wvith Regional Affine Invariant Features , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[25]  Hanqing Lu,et al.  Real-time visual tracking via Incremental Covariance Tensor Learning , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[26]  David J. Fleet,et al.  A framework for modeling appearance change in image sequences , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[27]  D. Kriegman,et al.  Visual tracking using learned linear subspaces , 2004, CVPR 2004.

[28]  Rama Chellappa,et al.  Visual tracking and recognition using appearance-adaptive models in particle filters , 2004, IEEE Transactions on Image Processing.

[29]  Geraldo F. Silveira,et al.  Real-time Visual Tracking under Arbitrary Illumination Changes , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Horst Bischof,et al.  Learning Features for Tracking , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.