Optimal Estimation of Matching Constraints

We describe work in progress on a numerical library for estimating multi-image matching constraints, or more precisely the multi-camera geometry underlying them. The library will cover several variants of homographic, epipolar, and trifocal constraints, using various different feature types. It is designed to be modular and open-ended, so that (i) new feature types or error models, (ii) new constraint types or parametrizations, and (iii) new numerical resolution methods, are relatively easy to add. The ultimate goal is to provide practical code for stable, reliable, statistically optimal estimation of matching geometry under a choice of robust error models, taking full account of any nonlinear constraints involved. More immediately, the library will be used to study the relative performance of the various competing problem parametrizations, error models and numerical methods. The paper focuses on the overall design, parametrization and numerical optimization issues. The methods described extend to many other geometric estimation problems in vision, e.g. curve and surface fitting.

[1]  J. Navarro-Pedreño.  Numerical Methods for Least Squares Problems , 1996 .

[2]  Thierry Viéville,et al.  Canonic Representations for the Geometries of Multiple Projective Views , 1994, ECCV.

[3]  O. Faugeras,et al.  On determining the fundamental matrix : analysis of different methods and experimental results , 1993 .

[4]  Roger MohrLifia.  Epipole and Fundamental Matrix Estimation Using the Virtual Parallax Property , 1995 .

[5]  Peter F. Sturm,et al.  A Factorization Based Algorithm for Multi-Image Projective Structure and Motion , 1996, ECCV.

[6]  TaubinGabriel.  Estimation of Planar Curves, Surfaces, and Nonplanar Space Curves Defined by Implicit Equations with Applications to Edge and Range Image Segmentation , 1991 .

[7]  Amnon Shashua,et al.  Threading Fundamental Matrices , 1998, ECCV.

[8]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[9]  Åke Björck,et al.  Numerical methods for least square problems , 1996 .

[10]  Roger Mohr,et al.  Epipole and fundamental matrix estimation using virtual parallax , 1995, Proceedings of IEEE International Conference on Computer Vision.

[11]  B. Triggs.  A New Approach to Geometric Fitting Bill Triggs , 1997 .

[12]  O. Faugeras,et al.  Grassman–Cayley algebra for modelling systems of cameras and the algebraic equations of the manifold of trifocal tensors , 1998, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[13]  Olivier D. Faugeras,et al.  On the geometry and algebra of the point and line correspondences between N images , 1995, Proceedings of IEEE International Conference on Computer Vision.

[14]  Bill Triggs,et al.  Linear Projective Reconstruction from Matching Tensors , 1996, BMVC.

[15]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[16]  A. Heyden.  Geometry and algebra of multiple projective transformations , 1995 .

[17]  Bill Triggs,et al.  Matching constraints and the joint image , 1995, Proceedings of IEEE International Conference on Computer Vision.