Visual tracking of numerous targets via multi-Bernoulli filtering of image data

This paper presents a novel Bayesian method to track multiple targets in an image sequence without explicit detection. Our method is formulated based on finite set representation of the multi-target state and the recently developed multi-Bernoulli filter. Experimental results on sport player and cell tracking studies show that our method can automatically track numerous targets, and it outperforms the state-of-the-art in terms of false positive (false alarm) and false negative (missing) rates as detection error measures, and in terms of label switching rate and lost tracks ratio as tracking error measures.

[1]  James J. Little,et al.  A Boosted Particle Filter: Multitarget Detection and Tracking , 2004, ECCV.

[2]  A. Doucet,et al.  Sequential Monte Carlo methods for multitarget filtering with random finite sets , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[3]  Patrick Pérez,et al.  Bayesian visual tracking with existence process , 2005, IEEE International Conference on Image Processing 2005.

[4]  Ramakant Nevatia,et al.  Segmentation and Tracking of Multiple Humans in Crowded Environments , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Patrick Pérez,et al.  Maintaining multimodality through mixture tracking , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[6]  Luc Van Gool,et al.  Object Tracking with an Adaptive Color-Based Particle Filter , 2002, DAGM-Symposium.

[7]  S. Buzzi,et al.  Track-before-detect procedures in a multi-target environment , 2008, IEEE Transactions on Aerospace and Electronic Systems.

[8]  I. Haritaoglu,et al.  Background and foreground modeling using nonparametric kernel density estimation for visual surveillance , 2002 .

[9]  Sim Heng Ong,et al.  Tracking Multiple Objects using Probability Hypothesis Density Filter and Color Measurements , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[10]  Robert G. Abbott,et al.  Multiple target tracking with lazy background subtraction and connected components analysis , 2009, Machine Vision and Applications.

[11]  Michael Isard,et al.  BraMBLe: a Bayesian multiple-blob tracker , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[12]  Ba-Ngu Vo,et al.  A Consistent Metric for Performance Evaluation of Multi-Object Filters , 2008, IEEE Transactions on Signal Processing.

[13]  Patrick Pérez,et al.  Color-Based Probabilistic Tracking , 2002, ECCV.

[14]  Ming Yang,et al.  Game-Theoretic Multiple Target Tracking , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[15]  Ingemar J. Cox,et al.  An Efficient Implementation of Reid's Multiple Hypothesis Tracking Algorithm and Its Evaluation for the Purpose of Visual Tracking , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Branko Ristic,et al.  A particle filter for joint detection and tracking of color objects , 2007, Image Vis. Comput..

[17]  Mubarak Shah,et al.  A noniterative greedy algorithm for multiframe point correspondence , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Matej Kristan,et al.  Closed-world tracking of multiple interacting targets for indoor-sports applications , 2009, Comput. Vis. Image Underst..

[19]  R. Mahler Multitarget Bayes filtering via first-order multitarget moments , 2003 .

[20]  Rama Chellappa,et al.  A Multiple-Hypothesis Approach for Multiobject Visual Tracking , 2007, IEEE Transactions on Image Processing.

[21]  Jean-Marc Odobez,et al.  Tracking the multi person wandering visual focus of attention , 2006, ICMI '06.

[22]  Ba-Ngu Vo,et al.  The Cardinality Balanced Multi-Target Multi-Bernoulli Filter and Its Implementations , 2009, IEEE Transactions on Signal Processing.

[23]  Lin Zhu,et al.  Tracking multiple objects through occlusion with online sampling and position estimation , 2008, Pattern Recognit..

[24]  Ba-Ngu Vo,et al.  Analytic Implementations of the Cardinalized Probability Hypothesis Density Filter , 2007, IEEE Transactions on Signal Processing.

[25]  Ramakant Nevatia,et al.  Tracking multiple humans in crowded environment , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[26]  Chee-Yee Chong,et al.  Evaluating a multiple-hypothesis multitarget tracking algorithm , 1994 .

[27]  Jean-Marc Odobez,et al.  Using particles to track varying numbers of interacting people , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[28]  David Suter,et al.  A consensus-based method for tracking: Modelling background scenario and foreground appearance , 2007, Pattern Recognit..

[29]  P. Moral Feynman-Kac Formulae: Genealogical and Interacting Particle Systems with Applications , 2004 .

[30]  Henry Medeiros,et al.  A parallel color-based particle filter for object tracking , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[31]  R. Laubenfels,et al.  Feynman–Kac Formulae: Genealogical and Interacting Particle Systems with Applications , 2005 .

[32]  Ronald P. S. Mahler,et al.  Statistical Multisource-Multitarget Information Fusion , 2007 .

[33]  Gérard G. Medioni,et al.  Multiple-Target Tracking by Spatiotemporal Monte Carlo Markov Chain Data Association , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  David Suter,et al.  Joint Detection and Estimation of Multiple Objects From Image Observations , 2010, IEEE Transactions on Signal Processing.

[35]  D. Scott Wills,et al.  Tracking multiple pedestrians in real-time using kinematics , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[36]  Ashraf A. Kassim,et al.  Gaussian mixture probability hypothesis density for visual people racking , 2007, 2007 10th International Conference on Information Fusion.

[37]  Frank Dellaert,et al.  MCMC-based particle filtering for tracking a variable number of interacting targets , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.