Labeled multi-Bernoulli track-before-detect for multi-target tracking in video

This paper presents a labeled multi-Bernoulli filter for track-before-detect with a special focus on visual tracking of multiple targets in video. We show that labeled multi-Bernoulli distribution is a conjugate prior for an image likelihood function with a specific separable form. Following a previously formulated likelihood function (with the desirable separable form) using background subtraction, we apply our proposed labeled multi-Bernoulli filter. Our simulation results show that the proposed solution can successfully track multiple targets in a public visual tracking dataset. Comparative results show superior tracking performance compared with recent competing methods.

[1]  Ba-Ngu Vo,et al.  Labeled Random Finite Sets and the Bayes Multi-Target Tracking Filter , 2013, IEEE Transactions on Signal Processing.

[2]  Ba-Ngu Vo,et al.  Tracking an unknown time-varying number of speakers using TDOA measurements: a random finite set approach , 2006, IEEE Transactions on Signal Processing.

[3]  Luc Van Gool,et al.  You'll never walk alone: Modeling social behavior for multi-target tracking , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[4]  Ba-Ngu Vo,et al.  Visual Tracking in Background Subtracted Image Sequences via Multi-Bernoulli Filtering , 2013, IEEE Transactions on Signal Processing.

[5]  Ba-Ngu Vo,et al.  Visual Tracking of Multiple Targets by Multi-Bernoulli Filtering of Background Subtracted Image Data , 2011, ICSI.

[6]  David Suter,et al.  Joint Detection and Estimation of Multiple Objects From Image Observations , 2010, IEEE Transactions on Signal Processing.

[7]  D. J. Salmond,et al.  A particle filter for track-before-detect , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[8]  Ba-Ngu Vo,et al.  A Tutorial on Bernoulli Filters: Theory, Implementation and Applications , 2013, IEEE Transactions on Signal Processing.

[9]  Rainer Stiefelhagen,et al.  The CLEAR 2006 Evaluation , 2006, CLEAR.

[10]  Ba-Ngu Vo,et al.  A Consistent Metric for Performance Evaluation of Multi-Object Filters , 2008, IEEE Transactions on Signal Processing.

[11]  Simon J. Godsill,et al.  Acoustic Source Localization and Tracking Using Track Before Detect , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[12]  Y. Boers,et al.  Particle filter track-before-detect application using inequality constraints , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[13]  Ba-Ngu Vo,et al.  Labeled Random Finite Sets and Multi-Object Conjugate Priors , 2013, IEEE Transactions on Signal Processing.

[14]  A. Doucet,et al.  Sequential Monte Carlo methods for multitarget filtering with random finite sets , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[15]  R. Mahler Multitarget Bayes filtering via first-order multitarget moments , 2003 .

[16]  S. Buzzi,et al.  Track-before-detect procedures for early detection of moving target from airborne radars , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[17]  Ba-Ngu Vo,et al.  Analytic Implementations of the Cardinalized Probability Hypothesis Density Filter , 2007, IEEE Transactions on Signal Processing.

[18]  R. Mahler PHD filters of higher order in target number , 2007 .

[19]  David Suter,et al.  Multi-object filtering from image sequence without detection , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[20]  Samuel J. Davey,et al.  A Comparison of Detection Performance for Several Track-before-Detect Algorithms , 2008, 2008 11th International Conference on Information Fusion.

[21]  Jouko Lampinen,et al.  Rao-Blackwellized particle filter for multiple target tracking , 2007, Inf. Fusion.

[22]  Youfu Li,et al.  Multi-target visual tracking with game theory-based mutual occlusion handling , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Ashraf A. Kassim,et al.  Data-Driven Probability Hypothesis Density Filter for Visual Tracking , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Ronald P. S. Mahler,et al.  Statistical Multisource-Multitarget Information Fusion , 2007 .

[25]  T.A. Wettergren Performance of search via track-before-detect for distributed sensor networks , 2008, IEEE Transactions on Aerospace and Electronic Systems.

[26]  Reza Hoseinnezhad,et al.  Multiple target tracking in video data using labeled random finite set , 2014, The 2014 International Conference on Control, Automation and Information Sciences (ICCAIS 2014).

[27]  Rainer Stiefelhagen,et al.  Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics , 2008, EURASIP J. Image Video Process..

[28]  Jerry D. Gibson,et al.  Handbook of Image and Video Processing , 2000 .

[29]  Ba-Ngu Vo,et al.  The Gaussian Mixture Probability Hypothesis Density Filter , 2006, IEEE Transactions on Signal Processing.

[30]  David Suter,et al.  Visual tracking of numerous targets via multi-Bernoulli filtering of image data , 2012, Pattern Recognit..

[31]  Ba-Ngu Vo,et al.  The Cardinality Balanced Multi-Target Multi-Bernoulli Filter and Its Implementations , 2009, IEEE Transactions on Signal Processing.

[32]  Ba-Ngu Vo,et al.  Multi-Bernoulli based track-before-detect with road constraints , 2012, 2012 15th International Conference on Information Fusion.

[33]  Klaus C. J. Dietmayer,et al.  The Labeled Multi-Bernoulli Filter , 2014, IEEE Transactions on Signal Processing.

[34]  Danilo Orlando,et al.  Track-Before-Detect Strategies for STAP Radars , 2010, IEEE Transactions on Signal Processing.