Euclidean upgrading from segment lengths: DLT-like algorithm and its variants

In this paper, how to calibrate a fixed multi-camera system and simultaneously achieve a Euclidean reconstruction from a set of segments is addressed. It is well known that only a projective reconstruction could be achieved without any prior information. Here, the known segment lengths are exploited to upgrade the projective reconstruction to a Euclidean reconstruction and simultaneously calibrate the intrinsic and extrinsic camera parameters. At first, a DLT(Direct Linear Transformation)-like algorithm for the Euclidean upgrading from segment lengths is derived in a very simple way. Although the intermediate results in the DLT-like algorithm are essentially equivalent to the quadric of segments (QoS), the DLT-like algorithm is of higher accuracy than the existing linear algorithms derived from the QoS because of a more accurate way to extract the plane at infinity from the intermediate results. Then, to further improve the accuracy of Euclidean upgrading, two weighted DLT-like algorithms are presented by weighting the linear constraint equations in the original DLT-like algorithm. Finally, using the results of these linear algorithms as the initial values, a new weighted nonlinear algorithm for Euclidean upgrading is explored to recover the Euclidean structure more accurately. Extensive experimental results on both the synthetic data and the real image data demonstrate the effectiveness of our proposed algorithms in Euclidean upgrading and multi-camera calibration.

[1]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[2]  Larry S. Davis,et al.  Multi-perspective analysis of human action , 1999 .

[3]  Richard I. Hartley Self-Calibration from Multiple Views with a Rotating Camera , 1994, ECCV.

[4]  Edward Hughes,et al.  Engineering Science , 1965 .

[5]  Marcelo Ricardo Stemmer,et al.  A new robust algorithmic for multi-camera calibration with a 1D object under general motions without prior knowledge of any camera intrinsic parameter , 2012, Pattern Recognit..

[6]  Bill Triggs,et al.  Autocalibration and the absolute quadric , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.

[9]  José Ignacio Ronda,et al.  Euclidean Upgrading from Segment Lengths , 2010, International Journal of Computer Vision.

[10]  Reinhard Koch,et al.  Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[11]  Olivier D. Faugeras,et al.  A theory of self-calibration of a moving camera , 1992, International Journal of Computer Vision.

[12]  Stan Birchheld,et al.  An Introduction to Projective Geometry for Computer Vision , 2022 .

[13]  R. Y. Tsai,et al.  An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision , 1986, CVPR 1986.

[14]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Liang Wang,et al.  Multi-Camera Calibration with One-Dimensional Object under General Motions , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[16]  Luc Van Gool,et al.  Stratified Self-Calibration with the Modulus Constraint , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Guillermo Gallego,et al.  Line Geometry and Camera Autocalibration , 2008, Journal of Mathematical Imaging and Vision.

[18]  Andrew W. Fitzgibbon,et al.  Automatic 3D Model Construction for Turn-Table Sequences , 1998, SMILE.

[19]  Janne Heikkilä,et al.  Geometric Camera Calibration Using Circular Control Points , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  PAUL D. SAMPSON,et al.  Fitting conic sections to "very scattered" data: An iterative refinement of the bookstein algorithm , 1982, Comput. Graph. Image Process..

[21]  Andrew Zisserman,et al.  Self-Calibration from Image Triplets , 1996, ECCV.

[22]  Kenichi Kanatani,et al.  Statistical Optimization for Geometric Fitting: Theoretical Accuracy Bound and High Order Error Analysis , 2008, International Journal of Computer Vision.

[23]  R. Hartley Triangulation, Computer Vision and Image Understanding , 1997 .

[24]  Stefan Carlsson,et al.  Uncalibrated Motion Capture Exploiting Articulated Structure Constraints , 2004, International Journal of Computer Vision.

[25]  Kunfeng Shi,et al.  Weighted Similarity-Invariant Linear Algorithm for Camera Calibration With Rotating 1-D Objects , 2012, IEEE Transactions on Image Processing.

[26]  Zhengyou Zhang,et al.  Camera calibration with one-dimensional objects , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  K. Kanatani,et al.  Extended FNS for Constrained Parameter Estimation , 2007 .

[28]  Stephen J. Maybank,et al.  On plane-based camera calibration: A general algorithm, singularities, applications , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[29]  J. Clarke Modelling uncertainty: A primer , 1998 .

[30]  Alexandru Tupan,et al.  Triangulation , 1997, Comput. Vis. Image Underst..