MCMC Particle Filter for Real-Time Visual Tracking of Vehicles

This paper adresses real-time automatic tracking and labeling of a variable number of vehicles, using one or more still cameras. The multi-vehicle configuration is tracked through a Markov Chain Monte-Carlo Particle Filter (MCMC PF) method. We show that integrating a simple vehicle kinematic model within this tracker allows to estimate the trajectories of a set of vehicles, with a moderate number of particles, allowing frame-rate computation. This paper also adresses vehicle tracking involving occlusions, deep scale and appearance changes: we propose a global observation function allowing to fairly track far vehicles as well as close vehicles. Experiment results are shown and discussed on multiple vehicle tracking sequences. Though now only tracking light vehicles, the ultimate goal of this research is to track and classify all classes of road users, also including trucks, cycles and pedestrians, in order to analyze road users interactions.

[1]  Thierry Chateau,et al.  Vehicle trajectories evaluation by static video sensors , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[2]  Hans-Hellmut Nagel,et al.  Model-based object tracking in monocular image sequences of road traffic scenes , 1993, International Journal of Computer 11263on.

[3]  Michael Isard,et al.  BraMBLe: a Bayesian multiple-blob tracker , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[4]  Andrew Blake,et al.  A Probabilistic Exclusion Principle for Tracking Multiple Objects , 2000, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[5]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[6]  P. Green.  Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[7]  Kevin Smith,et al.  Bayesian methods for visual multi-object tracking with applications to human activity recognition , 2007 .

[8]  Shrinivas J. Pundlik,et al.  Vehicle segmentation and tracking from a low-angle off-axis camera , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[10]  Frank Dellaert,et al.  MCMC-based particle filtering for tracking a variable number of interacting targets , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Wanming Zhai,et al.  Fundamentals of vehicle–track coupled dynamics , 2009 .

[12]  Daniel Gatica-Perez,et al.  Order Matters: A Distributed Sampling Method for Multi-Object Tracking , 2004, BMVC.

[13]  Gérard G. Medioni,et al.  Multiple Target Tracking Using Spatio-Temporal Markov Chain Monte Carlo Data Association , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Patrick Pérez,et al.  Color-Based Probabilistic Tracking , 2002, ECCV.