3D from Line Segments in Two Poorly-Textured, Uncalibrated Images

This paper addresses the problem of camera self-calibration, bundle adjustment and 3D reconstruction from line segments in two images of poorly-textured indoor scenes. First, we generate line segment correspondences, using an extended version of our previously proposed matching scheme. The first main contribution is a new method to identify polyhedral junctions resulting from the intersections of the line segments. At the same time, the images are segmented into planar polygons. This is done using an algorithm based on a binary space partitioning (BSP) tree. The junctions are matched end points of the detected line segments and hence can be used to obtain the epipolar geometry. The essential matrix is considered for metric camera calibration. For better stability, the second main contribution consists in a bundle adjustment on the line segments and the camera parameters that reduces the number of unknowns by a maximum flow algorithm. Finally, a piecewise-planar 3D reconstruction is computed based on the segmentation of the BSP tree. The system's performance is tested on some challenging examples.

[1]  Jiri Matas,et al.  Two-view geometry estimation unaffected by a dominant plane , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[2]  Peter F. M. Nacken.  A Metric for Line Segments , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Adrian Hilton,et al.  Surface-Based Structure-from-Motion using Feature Groupings , 2000 .

[4]  Luis Montano,et al.  Structure and motion from straight line segments , 2000, Pattern Recognit..

[5]  David G. Lowe,et al.  Perceptual Organization and Visual Recognition , 2012 .

[6]  Carsten Rother,et al.  A New Approach for Vanishing Point Detection in Architectural Environments , 2000, BMVC.

[7]  Dr. Zbigniew Michalewicz,et al.  How to Solve It: Modern Heuristics , 2004 .

[8]  Richard I. Hartley,et al.  Projective reconstruction from line correspondences , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Adrien Bartoli,et al.  Constrained Structure and Motion From Multiple Uncalibrated Views of a Piecewise Planar Scene , 2003, International Journal of Computer Vision.

[10]  Zhengyou Zhang.  Estimating Motion and Structure from Correspondences of Line Segments between Two Perspective Images , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  David J. Kriegman,et al.  Structure and Motion from Line Segments in Multiple Images , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Roberto Cipolla,et al.  Automatic 3D Modelling of Architecture , 2000, BMVC.

[13]  Lance R. Williams,et al.  Segmentation of Multiple Salient Closed Contours from Real Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[15]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[16]  Arnold W. M. Smeulders,et al.  An axiomatic approach to clustering line-segments , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[17]  Andrew Zisserman,et al.  New Techniques for Automated Architectural Reconstruction from Photographs , 2002, ECCV.

[18]  David W. Jacobs,et al.  Robust and Efficient Detection of Salient Convex Groups , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  H. Opower.  Multiple view geometry in computer vision , 2002 .

[20]  ZhangZhengyou.  Estimating Motion and Structure from Correspondences of Line Segments between Two Perspective Images , 1995 .

[21]  Paulo R. S. Mendonça,et al.  A simple technique for self-calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[22]  Gérard G. Medioni,et al.  Inferring global pereeptual contours from local features , 1996, International Journal of Computer Vision.

[23]  Paul Debevec,et al.  Modeling and Rendering Architecture from Photographs , 1996, SIGGRAPH 1996.

[24]  Roberto Cipolla,et al.  Camera Calibration from Vanishing Points in Image of Architectural Scenes , 1999, BMVC.

[25]  Radu Horaud,et al.  Structure and motion from two uncalibrated views using points on planes , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[26]  Luc Van Gool,et al.  Wide-baseline stereo matching with line segments , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[27]  Andrew Zisserman,et al.  A PLANE-SWEEP STRATEGY FOR THE 3D RECONSTRUCTION OF BUILDINGS FROM MULTIPLE IMAGES , 2000 .

[28]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[29]  Josechu J. Guerrero,et al.  Automatic Computation of the Fundamental Matrix from Matched Lines , 2003, CAEPIA.