Online Learning and Partitioning of Linear Displacement Predictors for Tracking

A novel approach to learning and tracking arbitrary image features is presented. Tracking is tackled by learning the mapping from image intensity differences to displacements. Linear regression is used, resulting in low computational cost. An appearance model of the target is built on-the-fly by clustering sub-sampled image templates. The medoidshift algorithm is used to cluster the templates thus identifying various modes or aspects of the target appearance, each mode is associated to the most suitable set of linear predictors allowing piecewise linear regression from image intensity differences to warp updates. Despite no hard-coding or offline learning, excellent results are shown on three publicly available video sequences and comparisons with related approaches made.

[1]  F. Chaumette,et al.  Robust real-time visual tracking using a 2 D-3 D model-based approach , 1999 .

[2]  Richard Bowden,et al.  N-tier Simultaneous Modelling and Tracking for Arbitrary Warps , 2006, BMVC.

[3]  Michel Dhome,et al.  Real Time Robust Template Matching , 2002, BMVC.

[4]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[5]  Takeo Kanade,et al.  Mode-seeking by Medoidshifts , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[6]  Horst Bischof,et al.  Real-Time Tracking via On-line Boosting , 2006, BMVC.

[7]  Patrick Bouthemy,et al.  Robust real-time visual tracking using a 2D-3D model-based approach , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  David J. Fleet,et al.  Robust Online Appearance Models for Visual Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[10]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Takahiro Ishikawa,et al.  The template update problem , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Jiri Matas,et al.  Linear Predictors for Fast Simultaneous Modeling and Tracking , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[13]  Andrew Blake,et al.  A sparse probabilistic learning algorithm for real-time tracking , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[14]  Jiri Matas,et al.  Learning Efficient Linear Predictors for Motion Estimation , 2006, ICVGIP.