Camera Self-Calibration and Three Dimensional Reconstruction under Quasi-Perspective Projection

The problem of camera self-calibration and Euclidean reconstruction from image sequences is addressed in the paper. We propose a quasi-perspective projection model and apply the model to structure and motion factorization to estimate the focal lengths of the cameras. Then we optimize the camera parameters based on Kruppa constraints and recover the metric structure from factorization of the normalized tracking matrix. The novelty and contribution of the paper lies in two aspects. First, under the assumption that the camera is far away from the object with small rotations, we propose that the imaging process can be modeled by quasi-perspective projection. The model is more accurate than affine camera model since the projective depths are implicitly embedded. Second, we propose to calibrate a more general camera model with 5 intrinsic parameters, while previous factorization algorithm can only calibrate the focal lengths. We validate and evaluate the proposed method on many synthetic and real image sequences and show the improvements over existing solutions.

[1]  Long Quan,et al.  Self-calibration of an affine camera from multiple views , 1996, International Journal of Computer Vision.

[2]  Luc Van Gool,et al.  Euclidean 3D Reconstruction from Image Sequences with Variable Focal Lenghts , 1996, ECCV.

[3]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[4]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[5]  Richard I. Hartley,et al.  Kruppa's Equations Derived from the Fundamental Matrix , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Takeo Kanade,et al.  A Paraperspective Factorization Method for Shape and Motion Recovery , 1994, ECCV.

[7]  O. D. Faugeras,et al.  Camera Self-Calibration: Theory and Experiments , 1992, ECCV.

[8]  Reinhard Koch,et al.  Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters , 1999, International Journal of Computer Vision.

[9]  Andrew Zisserman,et al.  Robust Detection of Degenerate Configurations while Estimating the Fundamental Matrix , 1998, Comput. Vis. Image Underst..

[10]  Anders Heyden,et al.  An iterative factorization method for projective structure and motion from image sequences , 1999, Image Vis. Comput..

[11]  Anders Heyden,et al.  Euclidean reconstruction from image sequences with varying and unknown focal length and principal point , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Martial Hebert,et al.  Iterative projective reconstruction from multiple views , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[13]  Sun Ji-zhou Creating 3D Models with Uncalibrated Cameras , 2001 .

[14]  Bill Triggs,et al.  Factorization methods for projective structure and motion , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Gang Xu,et al.  Algebraic derivation of the Kruppa equations and a new algorithm for self-calibration of cameras , 1999 .

[16]  Olivier D. Faugeras,et al.  A theory of self-calibration of a moving camera , 1992, International Journal of Computer Vision.

[17]  Stéphane Christy,et al.  Euclidean Shape and Motion from Multiple Perspective Views by Affine Iterations , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Peter F. Sturm,et al.  A Factorization Based Algorithm for Multi-Image Projective Structure and Motion , 1996, ECCV.

[19]  Quang-Tuan Luong,et al.  Self-Calibration of a Moving Camera from Point Correspondences and Fundamental Matrices , 1997, International Journal of Computer Vision.

[20]  Anders Heyden,et al.  Minimal Conditions on Intrinsic Parameters for Euclidean Reconstruction , 1998, ACCV.

[21]  Songde Ma,et al.  The Number of Independent Kruppa Constraints from N Images , 2006, Journal of Computer Science and Technology.