Automatic pose estimation of complex 3D building models

3D models of urban sites with geometry and facade textures are needed for many planning and visualization applications. Approximate 3D wireframe model can be derived from aerial images but detailed textures must be obtained from ground level images. Integrating such views with the 3D models is difficult as only small parts of buildings may be visible in a single view. We describe a method that uses two or three vanishing points, and three 3D to 2D line correspondences to estimate the rotational and translational parameters of the ground level cameras. The valid set of multiple combinations of 3D to 2D line pairs is chosen by a hypotheses generation and evaluation Some experimental results are presented.

[1]  Ioannis Stamos,et al.  Automatic registration of 2-D with 3-D imagery in urban environments , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[2]  Seth J. Teller,et al.  Extracting textured vertical facades from controlled close-range imagery , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[3]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[4]  Ramakant Nevatia,et al.  Detection and Modeling of Buildings from Multiple Aerial Images , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Ramakant Nevatia,et al.  Automatic Integration of Facade Textures into 3D Building Models with a Projective Geometry Based Line Clustering , 2002, Comput. Graph. Forum.

[6]  Ramakant Nevatia,et al.  Integrating ground and aerial views for urban site modeling , 2002, Object recognition supported by user interaction for service robots.

[7]  Antonio Criminisi,et al.  Creating Architectural Models from Images , 1999, Comput. Graph. Forum.

[8]  B. Caprile,et al.  Using vanishing points for camera calibration , 1990, International Journal of Computer Vision.

[9]  Jefferey A. Shufelt,et al.  Performance Evaluation and Analysis of Vanishing Point Detection Techniques , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[11]  Stéphane Christy,et al.  Iterative Pose Computation from Line Correspondences , 1999, Comput. Vis. Image Underst..

[12]  Eric Maisel,et al.  Using vanishing points for camera calibration and coarse 3D reconstruction from a single image , 2000, The Visual Computer.

[13]  Ramakant Nevatia,et al.  Modeling 3-D complex buildings with user assistance , 2000, Proceedings Fifth IEEE Workshop on Applications of Computer Vision.

[14]  Roberto Cipolla,et al.  Camera Calibration from Vanishing Points in Image of Architectural Scenes , 1999, BMVC.