Unsupervised Calibration of Camera Networks an Virtual PTZ Cameras

Pan-Tilt-Zoom (PTZ) cameras are widely used in video surveillance tasks. In particular, they can be used in combination with static cameras to provide high resolution imagery of interesting events in a scene on demand. Nevertheless, PTZ cameras only provide a single trajectory at a time. Hence, engineering algorithms for common computer vision tasks, such as automatic calibration or tracking, for camera networks including PTZ cameras is difficult. Therefore, we propose a virtual PTZ (vPTZ) camera to simplify the algorithm development for such camera networks. The vPTZ camera is built on a cylindrical panoramic view of the scene and allows to reposition its field of view arbitrarily to provide several trajectories. Further, we propose an unsupervised extrinsic self-calibration method for a network of static cameras and PTZ cameras solely based on correspondences between tracks of a walking human. Our experimental results show that we can obtain accurate estimates of the extrinsic camera parameters in both, outdoor and indoor scenarios.

[1]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[2]  Richard I. Hartley,et al.  Self-Calibration of Stationary Cameras , 1997, International Journal of Computer Vision.

[3]  Richard Szeliski,et al.  Image Alignment and Stitching , 2006, Handbook of Mathematical Models in Computer Vision.

[4]  C. Jaynes.  Multi-view calibration from planar motion for video surveillance , 1999, Proceedings Second IEEE Workshop on Visual Surveillance (VS'99) (Cat. No.98-89223).

[5]  Radu Horaud,et al.  Camera cooperation for achieving visual attention , 2005, Machine Vision and Applications.

[6]  Roman P. Pflugfelder,et al.  A self-calibration method for smart video cameras , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[7]  Matthew A. Brown,et al.  Unsupervised 3D object recognition and reconstruction in unordered datasets , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[8]  Alberto Del Bimbo,et al.  Uncalibrated Framework for On-line Camera Cooperation to Acquire Human Head Imagery in Wide Areas , 2008, 2008 IEEE Fifth International Conference on Advanced Video and Signal Based Surveillance.

[9]  Marcus Thaler,et al.  Establishing correspondence in distributed cameras by observing humans , 2010, ICDSC '10.

[10]  Trevor Darrell,et al.  Simultaneous calibration and tracking with a network of non-overlapping sensors , 2004, CVPR 2004.

[11]  Hassan Foroosh,et al.  Refining PTZ camera calibration , 2008, 2008 19th International Conference on Pattern Recognition.

[12]  Tomás Pajdla,et al.  Simultaneous surveillance camera calibration and foot-head homology estimation from human detections , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Xing Chen,et al.  Calibrating pan-tilt cameras in wide-area surveillance networks , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[14]  Richard I. Hartley,et al.  Linear self-calibration of a rotating and zooming camera , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[15]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[16]  Horst Bischof,et al.  Localization and Trajectory Reconstruction in Surveillance Cameras with Nonoverlapping Views , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  T. Kanade,et al.  A master-slave system to acquire biometric imagery of humans at distance , 2003, IWVS '03.

[18]  Ramakant Nevatia,et al.  Self-calibration of a camera from video of a walking human , 2002, Object recognition supported by user interaction for service robots.

[19]  Paulo R. S. Mendonça,et al.  Autocalibration from Tracks of Walking People , 2006, BMVC.

[20]  Gideon P. Stein,et al.  Tracking from multiple view points: Self-calibration of space and time , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[21]  Marc Pollefeys,et al.  PTZ camera network calibration from moving people in sports broadcasts , 2012, 2012 IEEE Workshop on the Applications of Computer Vision (WACV).

[22]  D. Terzopoulos,et al.  Surveillance camera scheduling: a virtual vision approach , 2005, VSSN@MM.

[23]  H. Bischof,et al.  Region matching for omnidirectional images using virtual camera planes , 2006 .

[24]  Lily Lee,et al.  Monitoring Activities from Multiple Video Streams: Establishing a Common Coordinate Frame , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .