Introducing target profiling for context-aware tracking

In this paper, an automated methodology that builds a profile for each pedestrian tracked based on its appearance, its occlusion status and the semantic information related to its position, is presented. The extracted profiles are utilized to perform context-aware tracking in multi-target tracking scenarios. A novel fusion scheme that combines the output of multiple trackers, exploiting context-related information cues is proposed. A set of decision rules is created that implicitly integrates occlusion reasoning capabilities in multi-target scenarios. Key aspects of the fusion process presented are (a) a common, context-aware methodology to assess the confidence of each tracker's output and (b) a correlation scheme that evaluates the consistency of the trackers' output. The confidence and consistency metrics extracted are used to produce weights for the fusion of the available trackers.

[1]  Ramakant Nevatia,et al.  Learning affinities and dependencies for multi-target tracking using a CRF model , 2011, CVPR 2011.

[2]  Petros Daras,et al.  Introducing context awareness in multi-target tracking using re-identification methodologies , 2013, ICDP.

[3]  Rongrong Ji,et al.  Visual tracking via weakly supervised learning from multiple imperfect oracles , 2014, Pattern Recognit..

[4]  Dinesh Manocha,et al.  AdaPT: Real-time adaptive pedestrian tracking for crowded scenes , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Yue Gao,et al.  Symbiotic Tracker Ensemble Toward A Unified Tracking Framework , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Luc Van Gool,et al.  Online Multiperson Tracking-by-Detection from a Single, Uncalibrated Camera , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Sergio A. Velastin,et al.  Re-identification of Pedestrians in Crowds Using Dynamic Time Warping , 2012, ECCV Workshops.

[8]  Ramakant Nevatia,et al.  Multi-target tracking by online learning of non-linear motion patterns and robust appearance models , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Ramakant Nevatia,et al.  Multi-target tracking by on-line learned discriminative appearance models , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Jesús García,et al.  Context-based Information Fusion: A survey and discussion , 2015, Inf. Fusion.

[11]  Jesús Martínez del Rincón,et al.  Online multiperson tracking with occlusion reasoning and unsupervised track motion model , 2013, 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[12]  Stan Sclaroff,et al.  Online Multi-person Tracking by Tracker Hierarchy , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.

[13]  Song Cao,et al.  Scene Aware Detection and Block Assignment Tracking in crowded scenes , 2012, Image Vis. Comput..

[14]  Luc Van Gool,et al.  Non-parametric motion-priors for flow understanding , 2012, 2012 IEEE Workshop on the Applications of Computer Vision (WACV).

[15]  Zhen Qin,et al.  Improving multi-target tracking via social grouping , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.