Multi-person tracking by discriminative affinity model and hierarchical association

Occlusion is probably the most challenging part of multi-person tracking. In this paper, we exploit a new discriminative affinity model which combines deep convolution appearance features, random walk motion model, and object shape to robustly handle occlusion during a long period of time. Moreover, We propose a hierarchical association framework based on the observation that association increase the uncertainty when the object is occluded over time, and decompose a data association problem into several sub-problems. Our approach runs online from a single camera and does not require extra calibration information. Experiments on public Multiple Object Tracking 2016 benchmark datasets show distinct performance improvement compared to state-of-the-art online and batch multi-person tracking methods.

[1]  Ian D. Reid,et al.  Joint Probabilistic Data Association Revisited , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Yang Yi,et al.  Hierarchical Data Association Framework with Occlusion Handling for Multiple Targets Tracking , 2014, IEEE Signal Processing Letters.

[3]  Edward A. Codling,et al.  Random walk models in biology , 2008, Journal of The Royal Society Interface.

[4]  Yu Liu,et al.  POI: Multiple Object Tracking with High Performance Detection and Appearance Feature , 2016, ECCV Workshops.

[5]  Fabio Tozeto Ramos,et al.  Simple online and realtime tracking , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[6]  Thomas Mauthner,et al.  Occlusion Geodesics for Online Multi-object Tracking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Qi Tian,et al.  Scalable Person Re-identification: A Benchmark , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[8]  James M. Rehg,et al.  Multiple Hypothesis Tracking Revisited , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[9]  Yaakov Bar-Shalom,et al.  Sonar tracking of multiple targets using joint probabilistic data association , 1983 .

[10]  Stan Sclaroff,et al.  Online Multi-person Tracking by Tracker Hierarchy , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.

[11]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  J. Munkres ALGORITHMS FOR THE ASSIGNMENT AND TRANSIORTATION tROBLEMS* , 1957 .

[13]  Fabio Poiesi,et al.  Online Multi-target Tracking with Strong and Weak Detections , 2016, ECCV Workshops.

[14]  Rainer Stiefelhagen,et al.  Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics , 2008, EURASIP J. Image Video Process..

[15]  Margrit Betke,et al.  Online Motion Agreement Tracking , 2013, BMVC.

[16]  Thomas Deselaers,et al.  Measuring the Objectness of Image Windows , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Dietrich Paulus,et al.  Simple online and realtime tracking with a deep association metric , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[18]  Wongun Choi,et al.  Near-Online Multi-target Tracking with Aggregated Local Flow Descriptor , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[19]  Stefan Roth,et al.  MOT16: A Benchmark for Multi-Object Tracking , 2016, ArXiv.

[20]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[21]  Min C. Shin,et al.  Tracking multiple ants in a colony , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[22]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .