Towards the intrinsic self-calibration of a vehicle-mounted omni-directional radially symmetric camera

Intrinsic calibration, i.e. finding the mapping between a camera's image positions and corresponding view rays, is a cumbersome, yet unavoidable task in order to accurately generate and interpret results from many kinds of image processing algorithms. We address this problem in the context of vehicle-mounted cameras with arbitrary fields of view with applications in advanced driver assistance systems. In particular, we present algorithms to gather the necessary data from unknown scenes and to subsequently estimate the camera parameters. These do rely on vehicle odometry only to resolve the focal scale ambiguity and to recognize when a purely translational motion is performed. We pay special attention to noise handling and circumvention of numerical instabilities. The proposed pipeline is tested by means of simulations to examine its noise sensitivity. Additionally we calibrate a fisheye camera from a natural scene of only 14 seconds length. First results show that the self-calibration in natural scenes is eligible and outperforms the straightforward approach of using all calibration parameters from an identically constructed camera.

[1]  Javier Civera,et al.  Camera self-calibration for sequential Bayesian structure from motion , 2009, 2009 IEEE International Conference on Robotics and Automation.

[2]  Luis Puig,et al.  Calibration of omnidirectional cameras in practice: A comparison of methods , 2012, Comput. Vis. Image Underst..

[3]  Roland Siegwart,et al.  A Flexible Technique for Accurate Omnidirectional Camera Calibration and Structure from Motion , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[4]  Gaurav S. Sukhatme,et al.  Visual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-calibration , 2011, Int. J. Robotics Res..

[5]  Tomás Pajdla,et al.  Estimation of omnidirectional camera model from epipolar geometry , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[6]  Peter F. Sturm,et al.  Generic self-calibration of central cameras , 2010, Comput. Vis. Image Underst..

[7]  Andrew W. Fitzgibbon,et al.  Simultaneous linear estimation of multiple view geometry and lens distortion , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Josechu J. Guerrero,et al.  Line extraction in uncalibrated central images with revolution symmetry , 2013, BMVC.

[9]  Roland Siegwart,et al.  A Toolbox for Easily Calibrating Omnidirectional Cameras , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[12]  Roland Siegwart,et al.  Automatic detection of checkerboards on blurred and distorted images , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Peter F. Sturm,et al.  Self-calibration of a General Radially Symmetric Distortion Model , 2006, ECCV.

[14]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .