Camera auto-calibration using pedestrians and zebra-crossings

In this paper we present a novel camera self-calibration technique to automatically recover intrinsic and extrinsic parameters of a static surveillance camera by observing a traffic scene. The scene must consist of one or more pedestrians and a zebra-crossing. We first extract a horizontal vanishing point and a vanishing line from a zebra-crossing. The observation of pedestrians allows calculating a so called vertical line of mass. All lines of mass are parallel in 3D space and therefore the vertical vanishing point can be estimated. The second horizontal vanishing point can be calculated by introducing the triangle spanned by three orthogonal vanishing points. All three vanishing points are then taken to gather the intrinsic parameters. The extrinsic parameters are calculated after the determination of the camera's height from the distance between two zebra-crossing edges. By combining static and dynamic calibration objects, the method gets robust against outliers. This robustness in combination with the practicability is shown in our experiments, which are carried out by using synthetic and real data of different application scenarios.

[1]  Andrew Zisserman,et al.  Planar grouping for automatic detection of vanishing lines and points , 2000, Image Vis. Comput..

[2]  Sergio A. Velastin,et al.  3D Extended Histogram of Oriented Gradients (3DHOG) for Classification of Road Users in Urban Scenes , 2009, BMVC.

[3]  Chia-Hung Yeh,et al.  Robust Vehicle and Traffic Information Extraction for Highway Surveillance , 2005, EURASIP J. Adv. Signal Process..

[4]  Tieniu Tan,et al.  3D model based vehicle localization by optimizing local gradient based fitness evaluation , 2008, 2008 19th International Conference on Pattern Recognition.

[5]  Tieniu Tan,et al.  Practical camera auto-calibration based on object appearance and motion for traffic scene visual surveillance , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[7]  Roberto Cipolla,et al.  Camera Calibration from Vanishing Points in Image of Architectural Scenes , 1999, BMVC.

[8]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[9]  Zuzana Kukelova,et al.  3D reconstruction from image collections with a single known focal length , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[10]  Zhanyi Hu,et al.  Single view metrology from scene constraints , 2005, Image Vis. Comput..

[11]  Tomás Pajdla,et al.  Simultaneous surveillance camera calibration and foot-head homology estimation from human detections , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Ramakant Nevatia,et al.  Camera calibration from video of a walking human , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Rama Chellappa,et al.  Video Metrology Using a Single Camera , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[15]  Ian D. Reid,et al.  Single View Metrology , 2000, International Journal of Computer Vision.

[16]  Luc Van Gool,et al.  Dynamic 3D Scene Analysis from a Moving Vehicle , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Hongdong Li,et al.  A Direct Method to Self-Calibrate a Surveillance Camera by Observing a Walking Pedestrian , 2009, 2009 Digital Image Computing: Techniques and Applications.

[18]  Stephen Se Zebra-crossing detection for the partially sighted , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[19]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[20]  D. W. Murray,et al.  Camera Calibration using Vanishing Points , 1992 .

[21]  Imran N. Junejo Using pedestrians walking on uneven terrains for camera calibration , 2009, Machine Vision and Applications.