Three New Algorithms for Projective Bundle Adjustment with Minimum Parameters

Bundle adjustment is a technique used to compute the maximum likelihood estimate of structure and motion from image feature correspondences. It practice, large non-linear systems have to be solved, most of the time using an iterative optimization process starting from a sub-optimal solution obtained by using linear methods. The behaviour, in terms of convergence, and the computational cost of this process depend on the parameterization used to represent the problem, i.e. of structure and motion. In this paper, we address the problem of finding a minimal parameterization of projective structure and motion, i.e. when camera calibration is not available. Most of the existing parameterizations are either sub-optimal, in the sense that they do change the cost function, or quite complicated to implement, requiring different closed-form expressions, also called maps, to model every case. Without loss of generality, we restrict the problem to the minimal parameterization of the two-view projective motion, equivalent to the fundamental matrix. We propose to classify existing ways allowing to obtain a minimal set of parameters into three categories and present three new algorithms, one for each category. These algorithms are simple to implement and yield minimal parameterizations. We also address the problem of minimally parameterizing homogeneous entities. We present what we call mapped coordinates, a tool allowing to optimize homogeneous entities over a minimal number of parameters. We make extensive use of this tool for both structure and motion parameterization. We compare these algorithms with existing ones using both simulated data and real images. In the light of these experiments, it appears that the new algorithms perform better than existing ones in terms of computational cost while achieving equivalent performances in terms of convergence.

[1]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[2]  Richard I. Hartley,et al.  Projective Reconstruction and Invariants from Multiple Images , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Nassir Navab,et al.  Relative Affine Structure: Canonical Model for 3D From 2D Geometry and Applications , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Carsten Rother,et al.  Linear Multi View Reconstruction and Camera Recovery , 2001, ICCV.

[5]  Thierry Viéville,et al.  Canonic Representations for the Geometries of Multiple Projective Views , 1994, ECCV.

[6]  P. Anandan,et al.  Direct recovery of shape from multiple views: a parallax based approach , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[7]  Harpreet S. Sawhney,et al.  3D geometry from planar parallax , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Bill Triggs,et al.  Plane+Parallax, Tensors and Factorization , 2000, ECCV.

[9]  Nicholas Ayache Vision Stéréoscopique et Perception Multisensorielle: Application à la robotique mobile , 1989 .

[10]  Gunnar Sparr,et al.  A Common Framework for Kinetic Depth, Reconstruction and Motion for Deformable Objects , 1994, ECCV.

[11]  Peter F. Sturm,et al.  A Factorization Based Algorithm for Multi-Image Projective Structure and Motion , 1996, ECCV.

[12]  Alan D. Jones Manual of Photogrammetry, eds C.C. Slama, C. Theurer and S.W. Hendrikson, American Society of Photogrammetry, Falls Church, Va., 1980, Fourth Edition, 180 × 260mm, xvi and 1056 pages (with index), 72 tables, 866 figures. ISBN 0 937294 01 2. , 1982 .

[13]  Richard I. Hartley,et al.  In defence of the 8-point algorithm , 1995, Proceedings of IEEE International Conference on Computer Vision.

[14]  Philip E. Gill,et al.  Practical optimization , 1981 .

[15]  Anders Heyden,et al.  Algebraic Varieties in Multiple View Geometry , 1996, ECCV.

[16]  P. McLauchlan Gauge invariance in projective 3D reconstruction , 1999, Proceedings IEEE Workshop on Multi-View Modeling and Analysis of Visual Scenes (MVIEW'99).

[17]  Radu Horaud,et al.  Projective Structure and Motion from Two Views of a Piecewise Planar Scene , 2001, ICCV.