3D Reconstruction of Piecewise Planar Models from Multiple Views Utilizing Coplanar and Region Constraints

An automatic 3D reconstruction method based upon coplanar and region constraints is proposed for synthesizing piecewise 3D planar models of a real-world scene portrayed in a sequence of digital images. Significantly, the reconstruction process requires no prior knowledge about the scene and the camera parameters. The proposed modeling method comprises three steps. Firstly, the corresponding feature points and lines are extracted from a series of images of the world scene. Secondly, the extracted corresponding points and lines are filtered in accordance with region and coplanar constraints and are used to identify the possible half-planes of real-world planes. Finally, a complete 3D planar model is constructed by identifying the correct half-planes in the world scene enlarging these half-planes to their full extent, and then merging all the extended halfplanes which from part of the same world plane. The feasibility of the proposed approach is demonstrated by reconstructing 3D planar models of three real-world scenes containing objects with multiple planar facets.

[1]  Wei Zhang,et al.  Extraction, matching and pose recovery based on dominant rectangular structures , 1989, First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003..

[2]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[3]  Konrad Schindler Generalized Use of Homographies for Piecewise Planar Reconstruction , 2003, SCIA.

[4]  Wolfgang Förstner,et al.  Matching, reconstructing and grouping 3D lines from multiple views using uncertain projective geometry , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[6]  Cordelia Schmid,et al.  Automatic line matching across views , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Manolis I. A. Lourakis,et al.  Detecting Planes In An Uncalibrated Image Pair , 2002, BMVC.

[8]  Allen Y. Yang,et al.  Symmetry-based 3-D reconstruction from perspective images , 2005, Comput. Vis. Image Underst..

[9]  Jan-Michael Frahm,et al.  Real-Time Plane-Sweeping Stereo with Multiple Sweeping Directions , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Honglak Lee,et al.  Automatic Single-Image 3d Reconstructions of Indoor Manhattan World Scenes , 2007, ISRR.

[11]  Luc Van Gool,et al.  Wide-baseline stereo matching with line segments , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Konrad Schindler,et al.  Plane parameter estimation by edge set matching , 2002 .

[13]  Jan-Michael Frahm,et al.  Detailed Real-Time Urban 3D Reconstruction from Video , 2007, International Journal of Computer Vision.

[14]  Gilles Simon Automatic online walls detection for immediate use in AR tasks , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[15]  Luc Van Gool,et al.  3D Urban Scene Modeling Integrating Recognition and Reconstruction , 2008, International Journal of Computer Vision.

[16]  Vassilios Morellas,et al.  Accurate 3D ground plane estimation from a single image , 2009, 2009 IEEE International Conference on Robotics and Automation.

[17]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[18]  Stephan Heuel,et al.  Uncertain Projective Geometry: Statistical Reasoning for Polyhedral Object Reconstruction , 2004, Lecture Notes in Computer Science.

[19]  Robert T. Collins,et al.  A space-sweep approach to true multi-image matching , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Cordelia Schmid,et al.  AUTOMATIC LINE MATCHING AND 3D RECONSTRUCTION OF BUILDINGS FROM MULTIPLE VIEWS , 1999 .

[21]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Seth J. Teller,et al.  Extracting textured vertical facades from controlled close-range imagery , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[23]  H. Opower Multiple view geometry in computer vision , 2002 .