A Practical Roadside Camera Calibration Method Based on Least Squares Optimization

In this paper, we propose a more practical and accurate method for calibrating the roadside camera used in traffic surveillance systems. Considering the characteristics of the traffic scenes, we propose a minimum calibration condition that consists of two vanishing points and a vanishing line, which can be easily satisfied in most traffic scenes. Based on the minimum calibration condition, we provide a calibration method to estimate camera intrinsic parameters and rotation angles, which employs least squares optimization instead of closed-form computation. Compared with the existing calibration methods, our method is suitable for more traffic scenes and is able to accurately determine more camera parameters including the principal point. By making full use of video information, multiple observations of the vanishing points are available from different objects. For more accurate calibration, we present a dynamic calibration method using these observations to correct camera parameters. As for the estimation of the camera translation vector, known lengths in the road or known heights above the road are exploited. The experimental results on synthetic data and real traffic images demonstrate the accuracy, robustness, and practicability of the proposed calibration method.

[1]  Horst Bischof,et al.  Online Auto-Calibration in Man-Made Worlds , 2005, Digital Image Computing: Techniques and Applications (DICTA'05).

[2]  Tieniu Tan,et al.  Practical camera auto-calibration based on object appearance and motion for traffic scene visual surveillance , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  J. D. Crisman,et al.  An easy to install camera calibration for traffic monitoring , 1997, Proceedings of Conference on Intelligent Transportation Systems.

[4]  Wayne A Sarasua,et al.  Automatic Camera Calibration Using Pattern Detection for Vision-Based Speed Sensing , 2008 .

[5]  G. F. McLean,et al.  Vanishing Point Detection by Line Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Hong Qiao,et al.  Overview of camera calibration for computer vision , 2014, Proceeding of the 11th World Congress on Intelligent Control and Automation.

[7]  Ramakant Nevatia,et al.  Robust camera calibration tool for video surveillance camera in urban environment , 2011, CVPR 2011 WORKSHOPS.

[8]  O. D. Faugeras,et al.  Camera Self-Calibration: Theory and Experiments , 1992, ECCV.

[9]  Hui Kong,et al.  Generalizing Laplacian of Gaussian Filters for Vanishing-Point Detection , 2013, IEEE Transactions on Intelligent Transportation Systems.

[10]  F. A. Heuvel VANISHING POINT DETECTION FOR ARCHITECTURAL PHOTOGRAMMETRY , 1998 .

[11]  Daniel J. Dailey,et al.  Dynamic camera calibration of roadside traffic management cameras for vehicle speed estimation , 2003, IEEE Trans. Intell. Transp. Syst..

[12]  Xavier Armangué,et al.  A comparative review of camera calibrating methods with accuracy evaluation , 2002, Pattern Recognit..

[13]  Rama Chellappa,et al.  Robust Height Estimation of Moving Objects From Uncalibrated Videos , 2010, IEEE Transactions on Image Processing.

[14]  Jian Zhang,et al.  Self-Calibration of Traffic Surveillance Camera using Motion Tracking , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[15]  Roberto Cipolla,et al.  Camera Calibration from Vanishing Points in Image of Architectural Scenes , 1999, BMVC.

[16]  Lili Huang Roadside camera calibration and its application in length-based vehicle classification , 2010, 2010 2nd International Asia Conference on Informatics in Control, Automation and Robotics (CAR 2010).

[17]  Jean-Philippe Tardif,et al.  Non-iterative approach for fast and accurate vanishing point detection , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[18]  Stanley T. Birchfield,et al.  A Taxonomy and Analysis of Camera Calibration Methods for Traffic Monitoring Applications , 2010, IEEE Transactions on Intelligent Transportation Systems.

[19]  Thomas F. Coleman,et al.  An Interior Trust Region Approach for Nonlinear Minimization Subject to Bounds , 1993, SIAM J. Optim..

[20]  Silong Peng,et al.  Model based vehicle localization for urban traffic surveillance using image gradient based matching , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[21]  Kai-Tai Song,et al.  Dynamic Calibration of Pan–Tilt–Zoom Cameras for Traffic Monitoring , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Richard I. Hartley,et al.  Sensitivity of Calibration to Principal Point Position , 2002, ECCV.

[24]  Jun Ota,et al.  Self-calibration of environmental camera for mobile robot navigation , 2007, Robotics Auton. Syst..

[25]  L. Havasi,et al.  Extraction of horizontal vanishing line using shapes and statistical error propagation , 2006 .

[26]  Martin Kampel,et al.  Camera auto-calibration using pedestrians and zebra-crossings , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[27]  Stanley T. Birchfield,et al.  An Energy Minimization Approach to Automatic Traffic Camera Calibration , 2013, IEEE Transactions on Intelligent Transportation Systems.

[28]  Eric Maisel,et al.  Using vanishing points for camera calibration and coarse 3D reconstruction from a single image , 2000, The Visual Computer.

[29]  Ramakant Nevatia,et al.  Camera calibration from video of a walking human , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.