Extrinsic Calibration of a Stereo Camera System Using a 3D CAD Model Considering the Uncertainties of Estimated Feature Points

The extrinsic calibration of a stereo camera system is a procedure that estimates the position and orientation of a stereo camera system relative to a calibration object. In this paper, a calibration object specified by a CAD model of known shape and arbitrary texture is used. Based on feature points located in the stereo image and using triangulation, 3D object points in the camera coordinate system are calculated. This point cloud is matched to the surface of the CAD model to estimate the position and the rotation of the stereo camera system relative to the object coordinate system. In order to improve the accuracy of known techniques for the calibration, two steps are proposed in this paper. First, a systematic error in the standard method of subpel feature point localization is eliminated by replacing the parabolic interpolation by a Gaussian regression. Second, the estimated accuracies of the 3D points are incorporated by propagating the uncertainties of the detected feature points in the images. To calculate the global minimum of the cost function, an evolutionary optimizer is combined with a two-stage strategy, refining a fast converging approximate result. The developed procedure reduces the error variance of observed points by a factor of about 80.

[1]  J. Goodman Introduction to Fourier optics , 1969 .

[2]  K. Kammeyer,et al.  Examination of Stopping Criteria for Differential Evolution based on a Power Allocation Problem , 2006 .

[3]  Ching-Cheng Wang,et al.  Extrinsic calibration of a vision sensor mounted on a robot , 1992, IEEE Trans. Robotics Autom..

[4]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Thorsten Thormählen,et al.  Error Analysis of Feature Based Disparity Estimation , 2006, PSIVT.

[6]  Anders Heyden,et al.  Stochastic modelling and analysis of sub-pixel edge detection , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[7]  Sang Wook Lee,et al.  Invariant features and the registration of rigid bodies , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[8]  Karl-Dirk Kammeyer,et al.  Parameter Study for Differential Evolution Using a Power Allocation Problem Including Interference Cancellation , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[9]  Peter Rockett,et al.  The Accuracy of Sub-Pixel Localisation in the Canny Edge Detector , 1999, BMVC.

[10]  Onay Urfalioglu,et al.  Scale Invariant Robust Registration of 3D-Point Data and a Triangle Mesh by Global Optimization , 2006, ACIVS.

[11]  Christopher O. Jaynes,et al.  Feature uncertainty arising from covariant image noise , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[13]  Fadi Dornaika,et al.  Hand-Eye Calibration , 1995, Int. J. Robotics Res..

[14]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[15]  Bodo Rosenhahn,et al.  HALF-SIFT: High-Accurate Localized Features for SIFT , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[16]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[17]  P. Mahalanobis On the generalized distance in statistics , 1936 .

[18]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[19]  Rama Chellappa,et al.  Statistical Error Propagation in 3D Modeling From Monocular Video , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[20]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[21]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision: From Images to Geometric Models , 2003 .

[22]  Kim L. Boyer,et al.  Robust multiview range image registration , 2003, 16th Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI 2003).