Social Force Model-Based MCMC-OCSVM Particle PHD Filter for Multiple Human Tracking

Video-based multiple human tracking often involves several challenges, including target number variation, object occlusions, and noise corruption in sensor measurements. In this paper, we propose a novel method to address these challenges based on probability hypothesis density (PHD) filtering with a Markov chain Monte Carlo (MCMC) implementation. More specifically, a novel social force model (SFM) for describing the interaction between the targets is used to calculate the likelihood within the MCMC resampling step in the prediction step of the PHD filter, and a one class support vector machine (OCSVM) is then used in the update step to mitigate the noise in the measurements, where the SVM is trained with features from both color and oriented gradient histograms. The proposed method is evaluated and compared with state-of-the-art techniques using sequences from the CAVIAR, TUD, and PETS2009 datasets based on the mean Euclidean tracking error on each frame, the optimal subpattern assignment metric, and the multiple object tracking precision metric. The results show improved performance of the proposed method over the baseline algorithms, including the traditional particle PHD filtering method, the traditional SFM-based particle filtering method, multi-Bernoulli filtering, and an online-learning-based tracking method.

[1]  Emilio Maggio,et al.  Video Tracking - Theory and Practice , 2011 .

[2]  Ba-Ngu Vo,et al.  On performance evaluation of multi-object filters , 2008, 2008 11th International Conference on Information Fusion.

[3]  Ba-Ngu Vo,et al.  A Consistent Metric for Performance Evaluation of Multi-Object Filters , 2008, IEEE Transactions on Signal Processing.

[4]  Satnam Singh Dlay,et al.  Social force model aided robust particle PHD filter for multiple human tracking , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[6]  Lu Wang,et al.  Multiple-Human Tracking by Iterative Data Association and Detection Update , 2014, IEEE Transactions on Intelligent Transportation Systems.

[7]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[8]  Narendra Ahuja,et al.  Robust Visual Tracking via Structured Multi-Task Sparse Learning , 2012, International Journal of Computer Vision.

[9]  Hanzi Wang,et al.  Incremental Learning of 3D-DCT Compact Representations for Robust Visual Tracking , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Ashraf A. Kassim,et al.  Tracking a Variable Number of Human Groups in Video Using Probability Hypothesis Density , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[11]  Bernt Schiele,et al.  Monocular 3D pose estimation and tracking by detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Lifeng Sun,et al.  Contextual Mixture Tracking , 2009, IEEE Transactions on Multimedia.

[13]  Dirk Helbing,et al.  Simulating dynamical features of escape panic , 2000, Nature.

[14]  Narendra Ahuja,et al.  Robust Visual Tracking Via Consistent Low-Rank Sparse Learning , 2014, International Journal of Computer Vision.

[15]  Branko Ristic,et al.  Beyond the Kalman Filter: Particle Filters for Tracking Applications , 2004 .

[16]  Daniel E. Clark,et al.  Convergence results for the particle PHD filter , 2006, IEEE Transactions on Signal Processing.

[17]  Zhongfei Zhang,et al.  A survey of appearance models in visual object tracking , 2013, ACM Trans. Intell. Syst. Technol..

[18]  Emilio Maggio,et al.  Efficient Multitarget Visual Tracking Using Random Finite Sets , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Changsheng Xu,et al.  Structural Correlation Filter for Robust Visual Tracking , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Mikhail J. Atallah,et al.  Privacy Enhancing Technologies, 9th International Symposium, PETS 2009, Seattle, WA, USA, August 5-7, 2009. Proceedings , 2009, Privacy Enhancing Technologies.

[21]  Yueting Zhuang,et al.  Online Metric-Weighted Linear Representations for Robust Visual Tracking , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Changsheng Xu,et al.  Structural Sparse Tracking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Ramakant Nevatia,et al.  Multi-target tracking by online learning of non-linear motion patterns and robust appearance models , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Josef Kittler,et al.  Audio Assisted Robust Visual Tracking With Adaptive Particle Filtering , 2015, IEEE Transactions on Multimedia.

[25]  Ramakant Nevatia,et al.  Multiple Target Tracking by Learning-Based Hierarchical Association of Detection Responses , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Miao Yu,et al.  A Robust student's-t distribution PHD filter with OCSVM updating for multiple human tracking , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[27]  Josef Kittler,et al.  Robust Multi-Speaker Tracking via Dictionary Learning and Identity Modeling , 2014, IEEE Transactions on Multimedia.

[28]  S. Singh,et al.  Novel data association schemes for the probability hypothesis density filter , 2007, IEEE Transactions on Aerospace and Electronic Systems.

[29]  Changsheng Xu,et al.  Partial Occlusion Handling for Visual Tracking via Robust Part Matching , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Jenq-Neng Hwang,et al.  Tracking Human Under Occlusion Based on Adaptive Multiple Kernels With Projected Gradients , 2013, IEEE Transactions on Multimedia.

[32]  Jonathon A. Chambers,et al.  Multi-Target Tracking and Occlusion Handling With Learned Variational Bayesian Clusters and a Social Force Model , 2015, IEEE Transactions on Signal Processing.

[33]  Rob J. Evans,et al.  A new performance metric for multiple target tracking based on optimal subpattern assignment , 2014, 17th International Conference on Information Fusion (FUSION).

[34]  Frank Dellaert,et al.  MCMC-based particle filtering for tracking a variable number of interacting targets , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Pascal Fua,et al.  Multi-Commodity Network Flow for Tracking Multiple People , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Ba-Ngu Vo,et al.  Performance evaluation of multi-target tracking using the OSPA metric , 2010, 2010 13th International Conference on Information Fusion.

[37]  Ba-Ngu Vo,et al.  Visual Tracking in Background Subtracted Image Sequences via Multi-Bernoulli Filtering , 2013, IEEE Transactions on Signal Processing.

[38]  Mrinal Kumar,et al.  An MCMC-based particle filter for multiple target tracking , 2012, 2012 15th International Conference on Information Fusion.

[39]  T. Vicsek,et al.  Simulation of pedestrian crowds in normal and evacuation situations , 2002 .

[40]  Mustafa Ozden,et al.  A Nonparametric Adaptive Tracking Algorithm Based on Multiple Feature Distributions , 2006, IEEE Transactions on Multimedia.

[41]  Jonathon A. Chambers,et al.  Adaptive Retrodiction Particle PHD Filter for Multiple Human Tracking , 2016, IEEE Signal Processing Letters.

[42]  Rainer Stiefelhagen,et al.  Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics , 2008, EURASIP J. Image Video Process..

[43]  Xin Yu,et al.  Object Tracking With Multi-View Support Vector Machines , 2015, IEEE Transactions on Multimedia.

[44]  Ming-Hsuan Yang,et al.  DETRAC: A New Benchmark and Protocol for Multi-Object Tracking , 2015, ArXiv.

[45]  Kai Oliver Arras,et al.  People tracking with human motion predictions from social forces , 2010, 2010 IEEE International Conference on Robotics and Automation.

[46]  Luc Van Gool,et al.  You'll never walk alone: Modeling social behavior for multi-target tracking , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[47]  Emilio Maggio,et al.  Particle PHD Filtering for Multi-Target Visual Tracking , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[48]  Hong Wang,et al.  A t-distribution based particle filter for target tracking , 2006, 2006 American Control Conference.

[49]  Allan G. Bluman,et al.  Elementary Statistics: A Step By Step Approach , 1980 .

[50]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[51]  W. Gilks,et al.  Following a moving target—Monte Carlo inference for dynamic Bayesian models , 2001 .

[52]  Miao Yu,et al.  Deep learning for posture analysis in fall detection , 2014, 2014 19th International Conference on Digital Signal Processing.

[53]  Zhongfei Zhang,et al.  Visual Tracking With Spatio-Temporal Dempster–Shafer Information Fusion , 2013, IEEE Transactions on Image Processing.