Easy to calib: Auto-calibration of camera from sequential images based on VP and EKF

Camera calibration is an important issue in computer vision. In this paper, we propose an improved camera auto-calibration algorithm from sequential images based on VP (vanishing point) and EKF (extended Kalman filter) to determine camera intrinsic parameters. This is the first vanishing point-based auto-calibration algorithm, which only uses a sequence of monocular images as input without any other information. According to geometry constraints of projective projection, we compute the vanishing points in three orthogonal directions by observing an object moving in one direction from an image sequence. Afterwards intrinsic parameters can be calculated. The extended Kalman filter is used to track the feature points in the image sequence rapidly and accurately. Compared with existing methods based on vanishing point, our approach simplifies calibration process, gets rid of calibration objects and manual intervention, avoids correspondences between 2D image and 3D world features and reduces errors to a large extent. Simulations and real image experiments validate the proposed approach and indicate that it is accurate and robust to noise. As a result, it could be applied to almost all real scenes like on-orbit camera calibration, autonomous vehicle navigation, space vehicle rendezvous and docking.

[1]  Rama Chellappa,et al.  Estimation of Object Motion Parameters from Noisy Images , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Y. Bar-Shalom Tracking and data association , 1988 .

[3]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[4]  Roberto Cipolla,et al.  Camera Calibration from Vanishing Points in Image of Architectural Scenes , 1999, BMVC.

[5]  Antonio Criminisi,et al.  Creating Architectural Models from Images , 1999, Comput. Graph. Forum.

[6]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[8]  M. Isard,et al.  Automatic Camera Calibration from a Single Manhattan Image , 2002, ECCV.

[9]  Ramakant Nevatia,et al.  Self-calibration of a camera from video of a walking human , 2002, Object recognition supported by user interaction for service robots.

[10]  Grantham K. H. Pang,et al.  Camera calibration from road lane markings , 2003 .

[11]  B. Caprile,et al.  Using vanishing points for camera calibration , 1990, International Journal of Computer Vision.

[12]  Ramakant Nevatia,et al.  Camera calibration from video of a walking human , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Kai-Tai Song,et al.  Dynamic Calibration of Pan–Tilt–Zoom Cameras for Traffic Monitoring , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  X. Qin,et al.  A new camera calibration based on vanishing point , 2008, 2008 7th World Congress on Intelligent Control and Automation.

[15]  Rong Dong,et al.  An Automatic Calibration Method for PTZ Camera in Expressway Monitoring System , 2009, 2009 WRI World Congress on Computer Science and Information Engineering.

[16]  Adam Herout,et al.  Automatic Camera Calibration for Traffic Understanding , 2014, BMVC.

[17]  Silong Peng,et al.  A Practical Roadside Camera Calibration Method Based on Least Squares Optimization , 2014, IEEE Transactions on Intelligent Transportation Systems.