Calibration and object correspondence in camera networks with widely separated overlapping views

This study contributes in two ways to the research of multi-camera object tracking in the context of visual surveillance. Firstly, a semi-automatic scene calibration method is proposed to deal with mapping a network of cameras with overlapped fields of view onto a single ground plane view, even when the overlap is not substantial. The proposed method uses a semi-supervised approach that combines tracked blobs with user-selected line scene features to recover the homographies between camera views that are both simple and accurate. Then, based on the scene calibration information, the intersection points of the projected vertical axis of single camera blobs are used to make object correspondences across multiple views. The method works in mixed environments of both pedestrians and vehicles, and is shown to be accurate and robust against segmentation noise and occlusions. Finally, the advantage of the proposed method is demonstrated by quantitative tracking performance evaluation and comparison against previous methods.

[1]  Mubarak Shah,et al.  Consistent Labeling of Tracked Objects in Multiple Cameras with Overlapping Fields of View , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Tim J. Ellis,et al.  Multi camera image tracking , 2006, Image Vis. Comput..

[3]  Robert J. Woodham,et al.  Combining Line and Point Correspondences for Homography Estimation , 2008, ISVC.

[4]  Chris Stauffer,et al.  Automated multi-camera planar tracking correspondence modeling , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[5]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[6]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[7]  T. Ellis,et al.  Wide area surveillance with a multi camera network , 2004 .

[8]  Xiaogang Wang,et al.  Intelligent multi-camera video surveillance: A review , 2013, Pattern Recognit. Lett..

[9]  Remco C. Veltkamp,et al.  Multi-person tracking based on vertical reference lines and dynamic visibility analysis , 2011, 2011 18th IEEE International Conference on Image Processing.

[10]  Dimitrios Makris,et al.  Performance evaluation of object tracking algorithms , 2007 .

[11]  Yanxi Liu,et al.  Automatic Surveillance Camera Calibration without Pedestrian Tracking , 2011, BMVC.

[12]  Hongbin Zha,et al.  Simultaneous Vanishing Point Detection and Camera Calibration from Single Images , 2010, ISVC.

[13]  Zhong Zhang,et al.  Video Surveillance Using a Multi-Camera Tracking and Fusion System , 2009, Multi-Camera Networks.

[14]  Mubarak Shah,et al.  Tracking Multiple Occluding People by Localizing on Multiple Scene Planes , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Tieniu Tan,et al.  Principal axis-based correspondence between multiple cameras for people tracking , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.