Calibration of stereo rigs based on the backward projection process

High-accuracy 3D measurement based on binocular vision system is heavily dependent on the accurate calibration of two rigidly-fixed cameras. In most traditional calibration methods, stereo parameters are iteratively optimized through the forward imaging process (FIP). However, the results can only guarantee the minimal 2D pixel errors, but not the minimal 3D reconstruction errors. To address this problem, a simple method to calibrate a stereo rig based on the backward projection process (BPP) is proposed. The position of a spatial point can be determined separately from each camera by planar constraints provided by the planar pattern target. Then combined with pre-defined spatial points, intrinsic and extrinsic parameters of the stereo-rig can be optimized by minimizing the total 3D errors of both left and right cameras. An extensive performance study for the method in the presence of image noise and lens distortions is implemented. Experiments conducted on synthetic and real data demonstrate the accuracy and robustness of the proposed method.

[1]  Feifei Gu,et al.  Camera calibration based on the back projection process , 2015 .

[2]  Suping Fang,et al.  Eccentricity error compensation for geometric camera calibration based on circular features , 2014 .

[3]  Gary R. Bradski,et al.  Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library , 2016 .

[4]  Deepak Mishra,et al.  3D information retrieval for visual odometry system of planetary exploration rovers - A stereo vision approach , 2013, 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[5]  Fuqiang Zhou,et al.  Precise calibration of binocular vision system used for vision measurement. , 2014, Optics express.

[6]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Nicholas Krouglicof,et al.  An Efficient Camera Calibration Technique Offering Robustness and Accuracy Over a Wide Range of Lens Distortion , 2012, IEEE Transactions on Image Processing.

[8]  Ben Upcroft,et al.  Online calibration of stereo rigs for long-term autonomy , 2013, 2013 IEEE International Conference on Robotics and Automation.

[9]  Joan Lasenby,et al.  ChESS - Quick and robust detection of chess-board features , 2013, Comput. Vis. Image Underst..

[10]  Jorge J. Moré,et al.  The Levenberg-Marquardt algo-rithm: Implementation and theory , 1977 .

[11]  Arturo de la Escalera,et al.  Automatic Chessboard Detection for Intrinsic and Extrinsic Camera Parameter Calibration , 2010, Sensors.

[12]  A. W. Winkler,et al.  A curve fitting method for extrinsic camera calibration from a single image of a cylindrical object , 2013 .

[13]  Zhengyou Zhang,et al.  Camera calibration with one-dimensional objects , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Guoqiang Zhang,et al.  A Stratified Approach for Camera Calibration Using Spheres , 2011, IEEE Transactions on Image Processing.

[15]  Radu Horaud,et al.  Automatic detection of calibration grids in time-of-flight images , 2014, Comput. Vis. Image Underst..

[16]  Έλλη Πέτσα,et al.  Fully automatic camera calibration using regular planar patterns , 2015 .

[17]  Hideki Koike,et al.  Simple Camera Calibration From a Single Image Using Five Points on Two Orthogonal 1-D Objects , 2010, IEEE Transactions on Image Processing.

[18]  Xiaojin Gong,et al.  Self-calibration for a non-central catadioptric camera with approximate epipolar geometry , 2014 .

[19]  Javier Civera,et al.  Structure from Motion using the Extended Kalman Filter , 2012, Springer Tracts in Advanced Robotics.

[20]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.