Visual vehicle tracking based on conditional random fields

This paper proposes an approach to moving vehicle tracking in surveillance videos based on conditional random fields (CRF). The key idea is to integrate a variety of relevant knowledge about vehicle tracking into a uniform probabilistic framework by using the CRF model. In this work, the CRF model integrates spatial and temporal contextual information of vehicle motion, and the appearance information of the vehicle. An approximate inference algorithm, loopy belief propagation, is used to recursively estimate the vehicle region from the history of observed images. Moreover, the background model is updated adaptively to cope with non-stationary background processes. Experimental results show that the proposed approach is able to accurately track moving vehicles in monocular image sequences. Besides, region-level tracking realizes precise localization of vehicles.

[1]  Yang Wang,et al.  A dynamic conditional random field model for object segmentation in image sequences , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[2]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[3]  Yang Wang,et al.  A dynamic conditional random field model for foreground and shadow segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Aurélie Bugeau,et al.  Tracking with Occlusions via Graph Cuts , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[6]  Patrick Pérez,et al.  Track and Cut: Simultaneous Tracking and Segmentation of Multiple Objects with Graph Cuts , 2008, EURASIP J. Image Video Process..

[7]  Gunnar Farnebäck,et al.  Two-Frame Motion Estimation Based on Polynomial Expansion , 2003, SCIA.

[8]  Ivan V. Bajic,et al.  Video Object Tracking in the Compressed Domain Using Spatio-Temporal Markov Random Fields , 2013, IEEE Transactions on Image Processing.

[9]  K. Ikeuchi,et al.  EVENT RECOGNITIONS FROM TRAFFIC IMAGES BASED ON SPATIO-TEMPORAL MARKOV RANDOM FIELD MODEL , 2001 .

[10]  Lin Zhu,et al.  Tracking multiple objects through occlusion with online sampling and position estimation , 2008, Pattern Recognit..

[11]  Sergio A. Velastin,et al.  A Review of Computer Vision Techniques for the Analysis of Urban Traffic , 2011, IEEE Transactions on Intelligent Transportation Systems.

[12]  Avinash C. Kak,et al.  Computer Vision and Pattern Recognition 2010 A Probabilistic Framework for Joint Segmentation and Tracking , 2022 .

[13]  Katsushi Ikeuchi,et al.  Traffic monitoring and accident detection at intersections , 2000, IEEE Trans. Intell. Transp. Syst..

[14]  Andrew McCallum,et al.  An Introduction to Conditional Random Fields , 2010, Found. Trends Mach. Learn..

[15]  Katsushi Ikeuchi,et al.  VEHICLE TRACKING IN LOW-ANGLE AND FRONT-VIEW IMAGES BASED ON SPATIO-TEMPORAL MARKOV RANDOM FIELD MODEL , 2001 .

[16]  Osama Masoud,et al.  Detection and classification of vehicles , 2002, IEEE Trans. Intell. Transp. Syst..

[17]  Antonio Criminisi,et al.  TextonBoost for Image Understanding: Multi-Class Object Recognition and Segmentation by Jointly Modeling Texture, Layout, and Context , 2007, International Journal of Computer Vision.

[18]  Andrew McCallum,et al.  Dynamic conditional random fields: factorized probabilistic models for labeling and segmenting sequence data , 2004, J. Mach. Learn. Res..