Tracking of multiple objects across multiple cameras with overlapping and non-overlapping views

In this paper, we propose a fully automated approach for tracking of multiple objects across multiple cameras with overlapping and non-overlapping views in a unified framework without initial training. For single camera cases, Kalman filter and adaptive particle sampling are integrated for multiple objects tracking. When extended to multiple cameras cases, the relations between adjacent cameras are learned systematically by using image registration techniques for consistent handoff of tracking-object labels across cameras. In addition, object appearance measurement is employed to validate the labeling results. Experimental results demonstrate the performance of our approach on real video sequences for cameras with overlapping and non-overlapping views.

[1]  Shaogang Gong,et al.  Tracking multiple people with a multi-camera system , 2001, Proceedings 2001 IEEE Workshop on Multi-Object Tracking.

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  David G. Lowe,et al.  Shape indexing using approximate nearest-neighbour search in high-dimensional spaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Mubarak Shah,et al.  KNIGHT/spl trade/: a real time surveillance system for multiple and non-overlapping cameras , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[5]  Lily Lee,et al.  Monitoring Activities from Multiple Video Streams: Establishing a Common Coordinate Frame , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Mubarak Shah,et al.  Consistent Labeling of Tracked Objects in Multiple Cameras with Overlapping Fields of View , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Wayne H. Wolf,et al.  Recovering field of view lines by using projective invariants , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[8]  Yi-Ping Hung,et al.  An adaptive learning method for target tracking across multiple cameras , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Jenq-Neng Hwang,et al.  Multiple-Target Tracking for Crossroad Traffic Utilizing Modified Probabilistic Data Association , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[10]  Jenq-Neng Hwang,et al.  Resolving occlusion and segmentation errors in multiple video object tracking , 2009, Electronic Imaging.

[11]  Dimitrios Makris,et al.  Bridging the gaps between cameras , 2004, CVPR 2004.

[12]  Surendra Ranganath,et al.  Multi-Camera Target Tracking in Blind Regions of Cameras with Non-overlapping Fields of View , 2004, BMVC.

[13]  Jake K. Aggarwal,et al.  Tracking Human Motion in Structured Environments Using a Distributed-Camera System , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  M. Barkowsky,et al.  Improving the Prediction Efficiency for MultiView Video Coding Using Histogram Matching , 2006 .

[15]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[16]  M. Shah,et al.  KNIGHT M : A REAL TIME SURVEILLANCE SYSTEM FOR MULTIPLE OVERLAPPING AND NON-OVERLAPPING CAMERAS , 2003 .