Color and motion-based particle filter target tracking in a network of overlapping cameras with multi-threading and GPGPU

This paper describes an efficient implementation of multiple-target multiple-view tracking in video-surveillance sequences. It takes advantage of the capabilities of multiple core Central Processing Units (CPUs) and of graphical processing units under the Compute Unifie Device Arquitecture (CUDA) framework. The principle of our algorithm is 1) in each video sequence, to perform tracking on all persons to track by independent particle filters and 2) to fuse the tracking results of all sequences. Particle filters belong to the category of recursive Bayesian filters. They update a Monte-Carlo representation of the posterior distribution over the target position and velocity. For this purpose, they combine a probabilistic motion model, i.e . prior knowledge about how targets move ( e.g . constant velocity) and a likelihood model associated to the observations on targets. At this first level of single video sequences, the multi-threading library Threading Buildings Blocks (TBB) has been used to parallelize the processing of the per-target independent particle filters. Afterwards at the higher level, we rely on General Purpose Programming on Graphical Processing Units (generally termed as GPGPU) through CUDA in order to fuse target-tracking data collected on multiple video sequences, by solving the data association problem. Tracking results are presented on various challenging tracking datasets.

[1]  Jean-Marc Odobez,et al.  Multi-camera 3D person tracking with particle filter in a surveillance environment , 2008, 2008 16th European Signal Processing Conference.

[2]  Namrata Vaswani,et al.  Particle Filter With a Mode Tracker for Visual Tracking Across Illumination Changes , 2012, IEEE Transactions on Image Processing.

[3]  Mariano Rivera,et al.  Binary Segmentation of Video Sequences in Real Time , 2010, 2010 Ninth Mexican International Conference on Artificial Intelligence.

[4]  Xiaogang Wang,et al.  Intelligent multi-camera video surveillance: A review , 2013, Pattern Recognit. Lett..

[5]  Tim Ellis,et al.  Multi-camera image measurement and correspondence , 2002 .

[6]  Dan Schonfeld,et al.  Distributed Bayesian Multiple-Target Tracking in Crowded Environments Using Multiple Collaborative Cameras , 2007, EURASIP J. Adv. Signal Process..

[7]  Patrick Pérez,et al.  Data fusion for visual tracking with particles , 2004, Proceedings of the IEEE.

[8]  Pascal Fua,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Multiple Object Tracking Using K-shortest Paths Optimization , 2022 .

[9]  Robert T. Collins,et al.  Multitarget data association with higher-order motion models , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Dariu Gavrila,et al.  Multi-person Tracking with Overlapping Cameras in Complex, Dynamic Environments , 2009, BMVC.

[11]  Justus H. Piater,et al.  Ground-Target Tracking in Multiple Cameras Using Collaborative Particle Filters and Principal Axis-Based Integration , 2009, IPSJ Trans. Comput. Vis. Appl..