Camera Self-Calibration Using the Singular Value Decomposition of the Fundamental Matrix: From Point Correspondences to 3D Measurements

This paper deals with a fundamental problem in motion and stereo analysis, namely that of determining the camera intrinsic calibration parameters. A novel method is proposed that follows the autocalibration paradigm, according to which calibration is achieved not with the aid of a calibration pattern but by observing a number of image features in a set of successive images. The proposed method relies upon the Singular Value Decomposition of the fundamental matrix, which leads to a particularly simple form of the Kruppa equations. In contrast to the classical formulation that yields an over-determined system of constraints, the derivation proposed here provides a straightforward answer to the problem of determining which constraints to employ among the set of available ones. Moreover, the derivatio- n is a purely algebraic one, without a need for resorting to the somewhat non-intuitive geometric concept of the \em absolute conic. Apart from the fundamental matrix itself, no other quantities that can be extracted from it (e.g. the epipoles) are needed for the derivation. Experimental results from extensive simulations and several image sequences demonstrate the effectiveness of the proposed method in accurately estimating the intrinsic calibration matrices. It is also shown that the computed intrinsic calibration matrices are sufficient for recovering 3D motion and performing metric measurements from uncalibrated images.

[1]  HighWire Press Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[2]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[3]  Gene H. Golub,et al.  Matrix computations , 1983 .

[4]  Thomas S. Huang,et al.  Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[6]  Ed Anderson,et al.  LAPACK Users' Guide , 1995 .

[7]  Harit P. Trivedi Can multiple views make up for lack of camera registration? , 1988, Image Vis. Comput..

[8]  Olivier D. Faugeras,et al.  Some Properties of the E Matrix in Two-View Motion Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Roger Tsai,et al.  Synopsis of recent progress on camera calibration for 3D machine vision , 1989 .

[10]  Richard I. Hartley,et al.  Estimation of Relative Camera Positions for Uncalibrated Cameras , 1992, ECCV.

[11]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[12]  Andrew Zisserman,et al.  Geometric invariance in computer vision , 1992 .

[13]  Rajiv Gupta,et al.  Stereo from uncalibrated cameras , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Quang-Tuan Luong Matrice Fondamentale et Calibration Visuelle sur l''''Environnement - Vers une plus grande autonomie , 1992 .

[15]  Kenichi Kanatani,et al.  Geometric computation for machine vision , 1993 .

[16]  Fadi Dornaika,et al.  Self Calibration of a Stereo Head Mounted onto a Robot Arm , 1994, ECCV.

[17]  Thomas S. Huang,et al.  Motion and structure from feature correspondences: a review , 1994, Proc. IEEE.

[18]  Olivier Faugeras,et al.  Motion of an uncalibrated stereo rig: self-calibration and metric reconstruction , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[19]  Amnon Shashua,et al.  Projective Structure from Uncalibrated Images: Structure From Motion and Recognition , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  John F. Canny,et al.  Efficient Inceremtal Algorithms for the Sparse Resultant and the Mixed Volume , 1995, J. Symb. Comput..

[21]  O. Faugeras Stratification of three-dimensional vision: projective, affine, and metric representations , 1995 .

[22]  S. P. Mudur,et al.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[23]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[24]  Du Q. Huynh,et al.  Direct Methods for Self-Calibration of a Moving Stereo Head , 1996, ECCV.

[25]  Andrew Zisserman,et al.  Self-Calibration from Image Triplets , 1996, ECCV.

[26]  Zhengyou Zhang,et al.  A New Multistage Approach to Motion and Structure Estimation: From Essential Parameters to Euclidean , 1996 .

[27]  O. Faugeras,et al.  Camera Self-Calibration from Video Sequences: the Kruppa Equations Revisited , 1996 .

[28]  B. Triggs,et al.  Projective Geometry for Image Analysis , 1996 .

[29]  Anders Heyden,et al.  Algebraic Varieties in Multiple View Geometry , 1996, ECCV.

[30]  Shahriar Negahdaripour,et al.  Direct Computation of the FOE with Confidence Measures , 1996, Comput. Vis. Image Underst..

[31]  Kostas Daniilidis,et al.  Understanding noise sensitivity in structure from motion , 1996 .

[32]  Bill Triggs,et al.  Autocalibration and the absolute quadric , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  I. Emiris A General Solver Based on Sparse Resultants: Numerical Issues and Kinematic Applications , 1997 .

[34]  Peter F. Sturm Self-calibration of a moving zoom-lens camera by pre-calibration , 1997, Image Vis. Comput..

[35]  Olivier D. Faugeras,et al.  Characterizing the Uncertainty of the Fundamental Matrix , 1997, Comput. Vis. Image Underst..

[36]  Tomás Svoboda,et al.  A Badly Calibrated Camera in Ego-Motion Estimation Propagation of Uncertainty , 1997, CAIP.

[37]  Richard I. Hartley,et al.  Kruppa's Equations Derived from the Fundamental Matrix , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Anders Heyden,et al.  Euclidean reconstruction from image sequences with varying and unknown focal length and principal point , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[39]  Luc Van Gool,et al.  A stratified approach to metric self-calibration , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[40]  Peter F. Sturm,et al.  Critical motion sequences for monocular self-calibration and uncalibrated Euclidean reconstruction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[41]  Luc Van Gool,et al.  Self-Calibration from the Absolute Conic on the Plane at Infinity , 1997, CAIP.

[42]  Radu Horaud,et al.  Closed-Form Solutions for the Euclidean Calibration of a Stereo Rig , 1998, ECCV.

[43]  Radu Horaud,et al.  Self-calibration and Euclidean reconstruction using motions of a stereo rig , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[44]  Radu Horaud,et al.  Autocalibration in the Presence of Critical Motions , 1998, BMVC.

[45]  Reinhard Koch,et al.  Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[46]  Ian D. Reid,et al.  Self-Calibration of a Rotating Camera with Varying Intrinsic Parameters , 1998, BMVC.

[47]  Andrew Zisserman,et al.  Resolving ambiguities in auto–calibration , 1998, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[48]  S. Bougnoux,et al.  From projective to Euclidean space under any practical situation, a criticism of self-calibration , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[49]  Richard I. Hartley,et al.  Linear self-calibration of a rotating and zooming camera , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[50]  R. Hartley,et al.  Linear calibration of a rotating and zooming camera ∗ , 1999 .