Joint Tracking and Ground Plane Estimation

We propose a novel framework that jointly estimates the ground plane and a target's motion trajectory. This results in improvements for both. Estimating their joint posterior is based on Particle Markov Chain Monte Carlo (Particle MCMC). In Particle MCMC, the best target state is inferred by a particle filter and the best ground plane is obtained by MCMC. Compared with conventional sampling methods that iteratively infer the best target states and ground plane parameters, our method infers them jointly. This reduces sampling errors drastically. Experimental results demonstrate that our method outperforms several state-of-the-art tracking methods, while the ground plane accuracy is also improved.

[1]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[2]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Michael Isard,et al.  ICONDENSATION: Unifying Low-Level and High-Level Tracking in a Stochastic Framework , 1998, ECCV.

[4]  Nando de Freitas,et al.  Rao-Blackwellised Particle Filtering for Dynamic Bayesian Networks , 2000, UAI.

[5]  Frank Dellaert,et al.  MCMC-based particle filtering for tracking a variable number of interacting targets , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Pascal Fua,et al.  Robust People Tracking with Global Trajectory Optimization , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[7]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[8]  Horst Bischof,et al.  Semi-supervised On-Line Boosting for Robust Tracking , 2008, ECCV.

[9]  Luc Van Gool,et al.  A mobile vision system for robust multi-person tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Luc Van Gool,et al.  Robust Multiperson Tracking from a Mobile Platform , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Serge J. Belongie,et al.  Visual tracking with online Multiple Instance Learning , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  A. Doucet,et al.  Particle Markov chain Monte Carlo methods , 2010 .

[13]  Thomas Mauthner,et al.  Multi-camera multi-object tracking by robust hough-based homography projections , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[14]  Rui Caseiro,et al.  Exploiting the Circulant Structure of Tracking-by-Detection with Kernels , 2012, ECCV.

[15]  Huchuan Lu,et al.  Visual tracking via adaptive structural local sparse appearance model , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Thomas Mauthner,et al.  Robust Real-Time Tracking of Multiple Objects by Volumetric Mass Densities , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Junseok Kwon,et al.  Visual tracking using the joint inference of target state and segment-based appearance models , 2013, 2013 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference.

[19]  Bernt Schiele,et al.  Monocular Visual Scene Understanding: Understanding Multi-Object Traffic Scenes , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Luc Van Gool,et al.  Ground Plane Estimation Using a Hidden Markov Model , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Alberto Del Bimbo,et al.  Object Tracking by Oversampling Local Features , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Fredrik Lindsten,et al.  Particle gibbs with ancestor sampling , 2014, J. Mach. Learn. Res..

[23]  Rui Caseiro,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence High-speed Tracking with Kernelized Correlation Filters , 2022 .

[24]  Junseok Kwon,et al.  Tracking by switching state space models , 2016, Comput. Vis. Image Underst..

[25]  Vibhav Vineet,et al.  Struck: Structured Output Tracking with Kernels , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.