Efficient hybrid appearance model for object tracking with occlusion handling

During object tracking, the appearance of the object being tracked often suffers from complex variations due to large illumination, pose changes, and frequent occlusions. Modeling a robust appearance model for accommodating those variations becomes a crux for appearance-based tracking algorithms. We present a tracking algorithm based on the hybrid appearance models that include a fixed appearance model, a fast-change appearance model, and an eigenspace-based model. The hybrid appearance models reveal three factors of appearance changes: stable, transient, and gradual. A particle filter is invoked to perform state inference and simultaneously be responsible for intermodel switching. In addition, robust statistics is utilized to deal with occlusion events. Numerous experiments on many difficult sequences demonstrate that our algorithm can effectively track the object undergoing large pose, lighting, and viewpoint changes. More importantly, our algorithm shows powerful ability of addressing severe occlusions.

[1]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[2]  Shaogang Gong,et al.  View-Based Adaptive Affine Tracking , 1998, ECCV.

[3]  Arnold W. M. Smeulders,et al.  Fast occluded object tracking by a robust appearance filter , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[5]  David J. Fleet,et al.  A framework for modeling appearance change in image sequences , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[6]  Danijel Skočaj,et al.  Robust Subspace Approaches to Visual Learning and recognition , 2003 .

[7]  Luc Van Gool,et al.  An adaptive color-based particle filter , 2003, Image Vis. Comput..

[8]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Zhongliang Jing,et al.  Learning-based appearance model for probabilistic visual tracking , 2006 .

[10]  M. Worring,et al.  Occlusion robust adaptive template tracking , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[11]  Thomas S. Huang,et al.  Online updating appearance generative mixture model for meanshift tracking , 2006, Machine Vision and Applications.

[12]  Takahiro Ishikawa,et al.  The template update problem , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  David J. Fleet,et al.  Robust Online Appearance Models for Visual Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Rama Chellappa,et al.  Visual tracking and recognition using appearance-adaptive models in particle filters , 2004, IEEE Transactions on Image Processing.