Online Multiple View Tracking: Targets Association Across Cameras

Most multiple object tracking algorithms relying on a single view have failed to follow the trajectories of targets when they have been completely hidden by obstacles. In this paper, we introduce a novel method of collaborative tracking in a synchronized overlapping cameras network. We propose an efficient target association method between cameras based on the tracking results of each target on each view. Our framework naturally handles obstacle occlusions and mutual target occlusions. We implemented our multiple object tracking algorithm by Decision Making algorithm [30] on each view. The tracking outcomes on each camera are collected and associated into targets. The feedback from the central association helps the individual cameras in tracking hidden targets, even in the case of complete occlusion. We use the standard MOT metric to validate our method. The experimental results on each view show that the multiple view tracking system outperforms the single view ones. The source code will be available publicly.

[1]  Ramakant Nevatia,et al.  Learning to associate: HybridBoosted multi-target tracker for crowded scene , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Pascal Fua,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Multiple Object Tracking Using K-shortest Paths Optimization , 2022 .

[3]  Afshin Dehghan,et al.  GMCP-Tracker: Global Multi-object Tracking Using Generalized Minimum Clique Graphs , 2012, ECCV.

[4]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Nenghai Yu,et al.  Online Multi-object Tracking Using CNN-Based Single Object Tracker with Spatial-Temporal Attention Mechanism , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[6]  Rama Chellappa,et al.  Object Detection, Tracking and Recognition for Multiple Smart Cameras , 2008, Proceedings of the IEEE.

[7]  Wongun Choi,et al.  Near-Online Multi-target Tracking with Aggregated Local Flow Descriptor , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[8]  B. S. Manjunath,et al.  Multiple view discriminative appearance modeling with IMCMC for distributed tracking , 2013, 2013 Seventh International Conference on Distributed Smart Cameras (ICDSC).

[9]  Pascal Fua,et al.  Multicamera People Tracking with a Probabilistic Occupancy Map , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Thomas Brox,et al.  A Multi-cut Formulation for Joint Segmentation and Tracking of Multiple Objects , 2016, ArXiv.

[11]  Pietro Perona,et al.  Fast Feature Pyramids for Object Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Ivana Mikic,et al.  Video Processing and Integration from Multiple Cameras , 1998 .

[14]  Dan Schonfeld,et al.  Distributed Bayesian Multiple-Target Tracking in Crowded Environments Using Multiple Collaborative Cameras , 2007, EURASIP J. Adv. Signal Process..

[15]  Ming Tang,et al.  High-Speed Tracking with Multi-kernel Correlation Filters , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[16]  Ming-Hsuan Yang,et al.  Visual tracking with online Multiple Instance Learning , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Justus H. Piater,et al.  Multi-view Object Tracking Using Sequential Belief Propagation , 2006, ACCV.

[18]  Thomas Mauthner,et al.  Robust Real-Time Tracking of Multiple Objects by Volumetric Mass Densities , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Ramakant Nevatia,et al.  Global data association for multi-object tracking using network flows , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  King-Sun Fu,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Publication Information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Bernt Schiele,et al.  Subgraph decomposition for multi-target tracking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Bernt Schiele,et al.  Multi-person Tracking by Multicut and Deep Matching , 2016, ECCV Workshops.

[23]  Horst Bischof,et al.  Real-Time Tracking via On-line Boosting , 2006, BMVC.

[24]  Xiaogang Wang,et al.  Intelligent multi-camera video surveillance: A review , 2013, Pattern Recognit. Lett..

[25]  Romaric Audigier,et al.  Improving Multi-frame Data Association with Sparse Representations for Robust Near-online Multi-object Tracking , 2016, ECCV.

[26]  Ian D. Reid,et al.  Joint tracking and segmentation of multiple targets , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Silvio Savarese,et al.  Learning to Track: Online Multi-object Tracking by Decision Making , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[28]  Amit K. Roy-Chowdhury,et al.  Tracking multiple interacting targets in a camera network , 2015, Comput. Vis. Image Underst..

[29]  J. Ferryman,et al.  PETS2009: Dataset and challenge , 2009, 2009 Twelfth IEEE International Workshop on Performance Evaluation of Tracking and Surveillance.

[30]  Rainer Stiefelhagen,et al.  Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics , 2008, EURASIP J. Image Video Process..

[31]  Horst Bischof,et al.  Localization and Trajectory Reconstruction in Surveillance Cameras with Nonoverlapping Views , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Francesco Solera,et al.  Performance Measures and a Data Set for Multi-target, Multi-camera Tracking , 2016, ECCV Workshops.