Motion of an uncalibrated stereo rig: self-calibration and metric reconstruction

We address in this paper the problem of self-calibration and metric reconstruction (up to a scale factor) from one unknown motion of an uncalibrated stereo rig. The epipolar constraint is first formulated for two uncalibrated images. The problem then becomes one of estimating unknowns such that the discrepancy from the epipolar constraint, in terms of sum of squared distances between points and their corresponding epipolar lines, is minimized. Although the full self-calibration is theoretically possible, we assume in this paper that the coordinates of the principal point of each camera are known. Then, the initialization of the unknowns can be done based on our previous work on self-calibration of a single moving camera, which requires to solve a set of so-called Kruppa equations. Redundancy of the information contained in a sequence of stereo images makes this method more robust than using a sequence of monocular images. Real data has been used to test the proposed method, and the results obtained are quite good. We also show experimentally that it is very difficult to estimate precisely the coordinates of the principal points of cameras. A variation of as high as several dozen pixels in the principal point coordinates does not affect significantly the 3-D reconstruction.

[1]  John E. W. Mayhew,et al.  Psychophysical and Computational Studies Towards a Theory of Human Stereopsis , 1981, Artif. Intell..

[2]  Paul R. Cohen,et al.  Camera Calibration with Distortion Models and Accuracy Evaluation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Roger Tsai,et al.  Synopsis of recent progress on camera calibration for 3D machine vision , 1989 .

[4]  Roger Y. Tsai,et al.  Techniques for calibration of the scale factor and image center for high accuracy 3D machine vision metrology , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[5]  Yoshiaki Shirai,et al.  Three-Dimensional Computer Vision , 1987, Symbolic Computation.

[6]  Narendra Ahuja,et al.  Motion and Structure From Two Perspective Views: Algorithms, Error Analysis, and Error Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  T. Poggio,et al.  A computational theory of human stereo vision , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[8]  Olivier D. Faugeras,et al.  Self-calibration of an Uncalibrated Stereo Rig from One Unknown Motion , 1994, BMVC.

[9]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[10]  W. Faig.  CALIBRATION OF CLOSE-RANGE PHOTOGRAMMETRIC SYSTEMS: MATHEMATICAL FORMULATION , 1975 .

[11]  Zhengyou Zhang.  Motion and Structure of Four Points from One Motion of a Stereo Rig with Unknown Extrinsic Parameters , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  R. Y. Tsai,et al.  An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision , 1986, CVPR 1986.

[13]  Roger Y. Tsai,et al.  Techniques for Calibration of the Scale Factor and Image Center for High Accuracy 3-D Machine Vision Metrology , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Soren W. Henriksen,et al.  Manual of photogrammetry , 1980 .

[15]  Harit P. Trivedi.  Can multiple views make up for lack of camera registration? , 1988, Image Vis. Comput..

[16]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[17]  Richard I. Hartley,et al.  Estimation of Relative Camera Positions for Uncalibrated Cameras , 1992, ECCV.

[18]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[19]  Kenichi Kanatani,et al.  Anatomy of camera calibration using vanishing points , 1991 .

[20]  O. Faugeras,et al.  On determining the fundamental matrix : analysis of different methods and experimental results , 1993 .

[21]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[22]  Songde Ma,et al.  Two plane camera calibration: a unified model , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Olivier D. Faugeras,et al.  Some Properties of the E Matrix in Two-View Motion Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Rachid Deriche,et al.  Recovering and characterizing image features using an efficient model based approach , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Kenichi Kanatani.  Statistical analysis of focal-length calibration using vanishing points , 1992, IEEE Trans. Robotics Autom..

[26]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..