Parallax geometry of smooth surfaces in multiple views

This paper investigates the multiple view geometry of smooth surfaces and a plane, where the plane provides a planar homography mapping between the views. Innovations are made in three areas: first, new solutions are given for the computation of epipolar and trifocal geometry for this type of scene. In particular it is shown that the epipole may be determined from bitangents between the homography registered occluding contours, and a new minimal solution is given for computing the trifocal tensor: Second, algorithms are demonstrated for automatically estimating the fundamental matrix and trifocal tensor from images of such scenes. Third, a method is developed for estimating camera matrices for a sequence of images of these scenes. These three areas are combined in a "freehand scanner" application where 3D texture-mapped graphical models of smooth objects are acquired directly from a video sequence of the object and plane.

[1]  Kalle Åström,et al.  Reconstruction of 3D-curves from 2D-images using affine shape methods for curves , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Nassir Navab,et al.  Relative Affine Structure: Canonical Model for 3D From 2D Geometry and Applications , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  P. Anandan,et al.  Parallax Geometry of Pairs of Points for 3D Scene Analysis , 1996, ECCV.

[4]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[5]  Bill Triggs,et al.  Autocalibration from Planar Scenes , 1998, ECCV.

[6]  Richard I. Hartley,et al.  In defence of the 8-point algorithm , 1995, Proceedings of IEEE International Conference on Computer Vision.

[7]  Fredrik Kahl,et al.  Motion estimation in image sequences using the deformation of apparent contours , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[8]  Amnon Shashua,et al.  Trilinearity in Visual Recognition by Alignment , 1994, ECCV.

[9]  Michal Irani,et al.  Representation of scenes from collections of images , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[10]  Andrew W. Fitzgibbon,et al.  Automatic Camera Recovery for Closed or Open Image Sequences , 1998, ECCV.

[11]  Andrew Zisserman,et al.  Robust Parameterization and Computation of the Trifocal Tensor , 1996, BMVC.

[12]  Richard I. Hartley,et al.  A linear method for reconstruction from lines and points , 1995, Proceedings of IEEE International Conference on Computer Vision.

[13]  Roberto Cipolla,et al.  Motion from the frontier of curved surfaces , 1995, Proceedings of IEEE International Conference on Computer Vision.

[14]  Paul A. Beardsley,et al.  3D Model Acquisition from Extended Image Sequences , 1996, ECCV.

[15]  Andrew Zisserman,et al.  Geometric invariance in computer vision , 1992 .

[16]  John Porrill,et al.  Curve matching and stereo calibration , 1991, Image Vis. Comput..

[17]  Harpreet S. Sawhney.  Simplifying motion and structure analysis using planar parallax and image warping , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[18]  A D Marshall,et al.  Geometric Modelling for Computer Vision , 1992 .

[19]  Richard Szeliski,et al.  Rapid octree construction from image sequences , 1993 .

[20]  Jean Ponce,et al.  Automatic model construction, pose estimation, and object recognition from photographs using triangular splines , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[21]  Daphna Weinshall,et al.  From Reference Frames to Reference Planes: Multi-View Parallax Geometry and Applications , 1998, ECCV.

[22]  Roberto Cipolla,et al.  Affine Reconstruction of Curved Surfaces from Uncalibrated Views of Apparent Contours , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Ian D. Reid,et al.  Duality, Rigidity and Planar Parallax , 1998, ECCV.

[24]  Andrew Zisserman,et al.  Automated mosaicing with super-resolution zoom , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[25]  Thierry Viéville,et al.  Canonic Representations for the Geometries of Multiple Projective Views , 1994, ECCV.