Practical Camera Calibration From Moving Objects for Traffic Scene Surveillance

We address the problem of camera calibration for traffic scene surveillance, which supplies a connection between 2-D image features and 3-D measurement. It is helpful to deal with appearance distortion related to view angles, establish multiview correspondences, and make use of 3-D object models as prior information to enhance surveillance performance. A convenient and practical camera calibration method is proposed in this paper. With the camera height H measured as the only user input, we can recover both intrinsic and extrinsic parameters of the camera based on redundant information supplied by moving objects in monocular videos. All cases of traffic scene layouts are considered and corresponding solutions are given to make our method applicable to almost all kinds of traffic scenes in reality. Numerous experiments are conducted in different scenes, and experimental results demonstrate the accuracy and practicability of our approach. It is shown that our approach can be effectively adopted in all kinds of traffic scene surveillance applications.

[1]  W. Grimson,et al.  Ground Plane Rectification by Tracking Moving Objects , 2003 .

[2]  Hassan Foroosh,et al.  Robust Auto-Calibration from Pedestrians , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[3]  Zhanyi Hu,et al.  A New Linear Camera Self-Calibration Technique , 2000 .

[4]  Hassan Foroosh,et al.  Euclidean path modeling for video surveillance , 2008, Image Vis. Comput..

[5]  Tieniu Tan,et al.  Model-Based Localisation and Recognition of Road Vehicles , 1998, International Journal of Computer Vision.

[6]  Tieniu Tan,et al.  Cast Shadow Removal with GMM for Surface Reflectance Component , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[7]  Takeo Kanade,et al.  A robust shape model for multi-view car alignment , 2009, CVPR.

[8]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[9]  B. Caprile,et al.  Using vanishing points for camera calibration , 1990, International Journal of Computer Vision.

[10]  Tieniu Tan,et al.  Real-Time Moving Object Classification with Automatic Scene Division , 2007, 2007 IEEE International Conference on Image Processing.

[11]  Liang-Tien Chia,et al.  Estimating camera pose from a single urban ground-view omnidirectional image and a 2D building outline map , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Camera Calibration with 1 D Objects , .

[13]  Giovanni Maria Farinella,et al.  Robust Image Alignment for Tampering Detection , 2012, IEEE Transactions on Information Forensics and Security.

[14]  Antonio Criminisi,et al.  Accurate Visual Metrology from Single and Multiple Uncalibrated Images , 2001, Distinguished Dissertations.

[15]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[16]  Tomás Pajdla,et al.  Simultaneous surveillance camera calibration and foot-head homology estimation from human detections , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Kostas Daniilidis,et al.  Shape-based object recognition in videos using 3D synthetic object models , 2009, CVPR.

[18]  Chris Stauffer,et al.  Robust automated planar normalization of tracking data , 2003 .

[19]  Roberto Cipolla,et al.  Camera Calibration from Vanishing Points in Image of Architectural Scenes , 1999, BMVC.

[20]  Jake K. Aggarwal,et al.  Tracking Human Motion in Structured Environments Using a Distributed-Camera System , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Tieniu Tan,et al.  Practical camera auto-calibration based on object appearance and motion for traffic scene visual surveillance , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Andrew Zisserman,et al.  Combining scene and auto-calibration constraints , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[23]  Ramakant Nevatia,et al.  Camera calibration from video of a walking human , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Geoffrey D. Sullivan,et al.  A Generic Deformable Model for Vehicle Recognition , 1995, BMVC.

[25]  Zhengyou Zhang,et al.  Camera calibration with one-dimensional objects , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Bill Triggs,et al.  Autocalibration from Planar Scenes , 1998, ECCV.

[28]  M. Isard,et al.  Automatic Camera Calibration from a Single Manhattan Image , 2002, ECCV.

[29]  Paulo R. S. Mendonça,et al.  Bayesian autocalibration for surveillance , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[30]  Tieniu Tan,et al.  Three-Dimensional Deformable-Model-Based Localization and Recognition of Road Vehicles , 2012, IEEE Transactions on Image Processing.

[31]  Hassan Foroosh,et al.  Trajectory Rectification and Path Modeling for Video Surveillance , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[32]  Antonio Criminisi,et al.  Creating Architectural Models from Images , 1999, Comput. Graph. Forum.

[33]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[34]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[35]  James M. Ferryman,et al.  Surveillance Camera Calibration from Observations of a Pedestrian , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[36]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .