Multi-Target Tracking and Occlusion Handling With Learned Variational Bayesian Clusters and a Social Force Model

This paper considers the problem of multiple human target tracking in a sequence of video data. A solution is proposed which is able to deal with the challenges of a varying number of targets, interactions, and when every target gives rise to multiple measurements. The developed novel algorithm comprises variational Bayesian clustering combined with a social force model, integrated within a particle filter with an enhanced prediction step. It performs measurement-to-target association by automatically detecting the measurement relevance. The performance of the developed algorithm is evaluated over several sequences from publicly available data sets: AV16.3, CAVIAR, and PETS2006, which demonstrates that the proposed algorithm successfully initializes and tracks a variable number of targets in the presence of complex occlusions. A comparison with state-of-the-art techniques due to Khan , Laet , and Czyz shows improved tracking performance.

[1]  K. G. Murty.  An Algorithm for Ranking All the Assignment in Order of Increasing Cost , 1968 .

[2]  Ángel F. García-Fernández,et al.  Performance evaluation of random set based pedestrian tracking algorithms , 2013, 2013 IEEE Eighth International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[3]  Abdelaziz Ouamri,et al.  New Efficient Schemes for Adaptive Selection of the Update Time in the IMMJPDAF , 2012, IEEE Transactions on Aerospace and Electronic Systems.

[4]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[5]  Rob J. Evans,et al.  A new performance metric for multiple target tracking based on optimal subpattern assignment , 2014, 17th International Conference on Information Fusion (FUSION).

[6]  Miao Yu,et al.  A Multimodal Approach to Blind Source Separation of Moving Sources , 2010, IEEE Journal of Selected Topics in Signal Processing.

[7]  Frank Dellaert,et al.  MCMC-based particle filtering for tracking a variable number of interacting targets , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  S. Godsill,et al.  Monte Carlo filtering for multi target tracking and data association , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[9]  Ronald P. S. Mahler,et al.  Statistical Multisource-Multitarget Information Fusion , 2007 .

[10]  Branko Ristic,et al.  Beyond the Kalman Filter: Particle Filters for Tracking Applications , 2004 .

[11]  Katta G. Murty,et al.  Letter to the Editor - An Algorithm for Ranking all the Assignments in Order of Increasing Cost , 1968, Oper. Res..

[12]  Ramakant Nevatia,et al.  Tracking multiple humans in crowded environment , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[13]  Wayne H. Wolf,et al.  Multiple object tracking and occlusion handling by information exchange between uncalibrated cameras , 2005, IEEE International Conference on Image Processing 2005.

[14]  Larry S. Davis,et al.  Efficient non-parametric adaptive color modeling using fast Gauss transform , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[15]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[16]  Simon J. Godsill,et al.  Detection and Tracking of Coordinated Groups , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[17]  Y. Bar-Shalom.  Tracking and data association , 1988 .

[18]  Joris De Schutter,et al.  Shape-Based Online Multitarget Tracking and Detection for Targets Causing Multiple Measurements: Variational Bayesian Clustering and Lossless Data Association , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Ioannis A. Kakadiaris,et al.  Modeling local behavior for predicting social interactions towards human tracking , 2014, Pattern Recognit..

[20]  Isaac Cohen,et al.  Target tracking with incomplete detection , 2009, Comput. Vis. Image Underst..

[21]  Cedric Nishan Canagarajah,et al.  Sequential Monte Carlo tracking by fusing multiple cues in video sequences , 2007, Image Vis. Comput..

[22]  Thia Kirubarajan,et al.  A Multiple-Detection Joint Probabilistic Data Association Filter , 2013, IEEE Journal of Selected Topics in Signal Processing.

[23]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[24]  Wolfram Burgard,et al.  People Tracking with Mobile Robots Using Sample-Based Joint Probabilistic Data Association Filters , 2003, Int. J. Robotics Res..

[25]  Simon J. Godsill,et al.  Multitarget Initiation, Tracking and Termination Using Bayesian Monte Carlo Methods , 2007, Comput. J..

[26]  Ingemar J. Cox,et al.  A review of statistical data association techniques for motion correspondence , 1993, International Journal of Computer Vision.

[27]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[28]  Miao Yu,et al.  A Posture Recognition-Based Fall Detection System for Monitoring an Elderly Person in a Smart Home Environment , 2012, IEEE Transactions on Information Technology in Biomedicine.

[29]  Luc Van Gool,et al.  You'll never walk alone: Modeling social behavior for multi-target tracking , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[30]  Muhammad Salman Khan,et al.  Multimodal (audio-visual) source separation exploiting multi-speaker tracking, robust beamforming and time-frequency masking , 2012, IET Signal Process..

[31]  Branko Ristic,et al.  A particle filter for joint detection and tracking of color objects , 2007, Image Vis. Comput..

[32]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[33]  J CoxIngemar.  A review of statistical data association for motion correspondence , 1993 .

[34]  Dinesh Manocha,et al.  Modeling, Simulation and Visual Analysis of Crowds , 2013, The International Series in Video Computing.

[35]  Andrea Cavallaro,et al.  Multi-camera tracking using a Multi-Goal Social Force Model , 2013, Neurocomputing.

[36]  William Whittaker,et al.  Conditional particle filters for simultaneous mobile robot localization and people-tracking , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[37]  Sze Kim Pang,et al.  On MCMC-Based particle methods for Bayesian filtering: Application to multitarget tracking , 2009, 2009 3rd IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[38]  Luc Van Gool,et al.  An adaptive color-based particle filter , 2003, Image Vis. Comput..

[39]  Rainer Stiefelhagen,et al.  Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics , 2008, EURASIP J. Image Video Process..