Coordinate-Free Carlsson-Weinshall Duality and Relative Multi-View Geometry

We present a coordinate-free description of Carlsson-Weinshall duality between scene points and camera pinholes and use it to derive a new characterization of primal/dual multi-view geometry. In the case of three views, a particular set of reduced trilinearities provide a novel parameterization of camera geometry that, unlike existing ones, is subject only to very simple internal constraints. These trilinearities lead to new "quasi-linear" algorithms for primal and dual structure from motion. We include some preliminary experiments with real and synthetic data.

[1]  Rajiv Gupta,et al.  Stereo from uncalibrated cameras , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[3]  Bill Triggs,et al.  Matching constraints and the joint image , 1995, Proceedings of IEEE International Conference on Computer Vision.

[4]  D. Ortland,et al.  Point sets in projective spaces and theta functions , 1988 .

[5]  Richard I. Hartley,et al.  In defence of the 8-point algorithm , 1995, Proceedings of IEEE International Conference on Computer Vision.

[6]  Olivier D. Faugeras,et al.  The fundamental matrix: Theory, algorithms, and stability analysis , 2004, International Journal of Computer Vision.

[7]  Amnon Shashua,et al.  Revisiting Single-View Shape Tensors: Theory and Applications , 2002, ECCV.

[8]  Olivier D. Faugeras,et al.  On the geometry and algebra of the point and line correspondences between N images , 1995, Proceedings of IEEE International Conference on Computer Vision.

[9]  Jean Ponce,et al.  Congruences and Concurrent Lines in Multi-View Geometry , 2016, Adv. Appl. Math..

[10]  A. Coble.  Point Sets and Allied Cremona Groups (Part III) , 1915 .

[11]  Narendra Ahuja,et al.  Motion and Structure from Line Correspondences; Closed-Form Solution, Uniqueness, and Optimization , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  O. Faugeras,et al.  The Geometry of Multiple Images , 1999 .

[13]  Richard I. Hartley,et al.  Lines and Points in Three Views and the Trifocal Tensor , 1997, International Journal of Computer Vision.

[14]  Martial Hebert,et al.  The Joint Image Handbook , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[15]  Amnon Shashua,et al.  Algebraic Functions For Recognition , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[17]  O. Faugeras,et al.  Grassman–Cayley algebra for modelling systems of cameras and the algebraic equations of the manifold of trifocal tensors , 1998, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[18]  Jean Ponce,et al.  Trinocular Geometry Revisited , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[20]  Long Quan,et al.  Relative 3D Reconstruction Using Multiple Uncalibrated Images , 1995, Int. J. Robotics Res..

[21]  Pascal Monasse,et al.  A Critical Review of the Trifocal Tensor Estimation , 2017, PSIVT.