Self-Calibration of Traffic Surveillance Cameras Based on Moving Vehicle Appearance and 3-D Vehicle Modeling

This paper proposes an effective and practical method for self-calibration of traffic surveillance cameras. Based on analyzing multiple moving vehicles across multiple frames, the Canny edge detector and Hough transform are first adopted to obtain orthogonal horizontal vanishing points pairs, from which corresponding vertical vanishing points are derived. Next, mean shift clustering and Laplace linear regression are employed to deal with noise and outliers during estimation of vanishing points. To overcome the unreliable estimation issues of orthogonal vanishing points pairs, we further utilize the projective line segments obtained from 3-D vehicle model to create more reliable pairs and iteratively improve the calibration results. Finally, the estimation of distribution algorithm (EDA) is also applied to relax the assumptions made on camera parameters and the moving trajectories of vehicles during the iterations. Experimental results on different datasets prove the feasibility of our proposed scheme.

[1]  Jean-Philippe Tardif,et al.  Non-iterative approach for fast and accurate vanishing point detection , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[2]  Hongdong Li,et al.  A Direct Method to Self-Calibrate a Surveillance Camera by Observing a Walking Pedestrian , 2009, 2009 Digital Image Computing: Techniques and Applications.

[3]  Ramakant Nevatia,et al.  Camera calibration from video of a walking human , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  M. Isard,et al.  Automatic Camera Calibration from a Single Manhattan Image , 2002, ECCV.

[5]  Jenq-Neng Hwang,et al.  Camera self-calibration from tracking of moving persons , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[6]  Roberto Cipolla,et al.  Camera Calibration from Vanishing Points in Image of Architectural Scenes , 1999, BMVC.

[7]  B. Caprile,et al.  Using vanishing points for camera calibration , 1990, International Journal of Computer Vision.

[8]  Daniel J. Dailey,et al.  Dynamic camera calibration of roadside traffic management cameras for vehicle speed estimation , 2003, IEEE Trans. Intell. Transp. Syst..

[9]  Tieniu Tan,et al.  Practical camera auto-calibration based on object appearance and motion for traffic scene visual surveillance , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Tieniu Tan,et al.  Three-Dimensional Deformable-Model-Based Localization and Recognition of Road Vehicles , 2012, IEEE Transactions on Image Processing.

[11]  Jenq-Neng Hwang,et al.  Multiple-kernel adaptive segmentation and tracking (MAST) for robust object tracking , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Xiao Lu,et al.  A method for vehicle-mounted camera calibration under urban traffic scenes , 2013, 2013 Chinese Automation Congress.

[13]  Qi Wu,et al.  Robust Self-calibration from Single Image Using RANSAC , 2007, ISVC.

[14]  Ramakant Nevatia,et al.  Self-calibration of a camera from video of a walking human , 2002, Object recognition supported by user interaction for service robots.

[15]  Paulo R. S. Mendonça,et al.  Autocalibration from Tracks of Walking People , 2006, BMVC.

[16]  Martin Kampel,et al.  Camera auto-calibration using pedestrians and zebra-crossings , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).