Model-based tracking: Temporal conditional random fields

We present Temporal Conditional Random Fields, a probabilistic framework for modeling object motion. The state-of-the-art discriminative approach for tracking is known as dynamic conditional random fields. This method models an event based on spatial and temporal relation between pixels in an image sequence without any prediction. To facilitate such a powerful graphical model with prediction and come up with a CRF-based predictor, we propose a set of new temporal relations for object tracking, with feature functions such as optical flow (calculated among consequent frames) and line filed features. We validate our proposed method with real data sequences and will show that the TCRF prediction is nearly equivalent with result of template matching. Experimental results indicate that our TCRF can predict future state of any maneuvering target with nearly zero error during its constant motion. Not only the proposed TCRF has a simple and easy to implement structure, but also it outperforms the state-of-the-art predictors such as Kalman filter.

[1]  Ying Zhu,et al.  Tracking Complex Objects Using Graphical Object Models , 2004, IWCM.

[2]  Andrew McCallum,et al.  Dynamic conditional random fields: factorized probabilistic models for labeling and segmenting sequence data , 2004, J. Mach. Learn. Res..

[3]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Neil A. Thacker,et al.  Tutorial: Computing 2D and 3D Optical Flow. , 2004 .

[5]  Q. Ji,et al.  Segmentation of Video Sequences using Spatial-temporal Conditional Random Fields , 2008, 2008 IEEE Workshop on Motion and video Computing.

[6]  Yang Wang,et al.  A dynamic conditional random field model for object segmentation in image sequences , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Stan Sclaroff,et al.  Layered Graphical Models for Tracking Partially Occluded Objects , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Qiang Yang,et al.  Spatio-temporal event detection using dynamic conditional random fields , 2009, IJCAI 2009.

[9]  Trevor Darrell,et al.  Conditional Random People: Tracking Humans with CRFs and Grid Filters , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[10]  Stan Sclaroff,et al.  Layered graphical models for tracking partially-occluded objects , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.