Modeling of Complex environments

Creating geometrically correct and complete 3D models of complex environments remains a difficult problem. Techniques for 3D digitizing and modeling have been rapidly advancing over the past few years although most focus on single objects or specific applications such as architecture and city mapping. The ability to capture details and the degree of automation vary widely from one approach to another. One can safely say that there is no single approach that works for all types of environment and at the same time is fully automated and satisfies the requirements of every application. In this paper we show that for complex environments, those composed of several objects with various characteristics, it is essential to combine data from different sensors and information from different sources. Our approach combines models created from multiple images, single images, and range sensors. It can also use known shapes, CAD, existing maps, survey data, and GPS. 3D points in the image-based models are generated by photogrammetric bundle adjustment with or without self-calibration depending on the image and point configuration. Both automatic and interactive procedures are used depending on the availability of reliable automated process. Producing high quality and accurate models, rather than full automation, is the goal. Case studies in diverse environments are used to demonstrate that all the aforementioned features are needed for environments with a significant amount of complexity.

[1]  P. Tompkins,et al.  Secrets of the Great Pyramid , 1971 .

[2]  S. El-Hakim A hierarchical approach to stereo vision , 1989 .

[3]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[4]  Clive S. Fraser Network design considerations for non-topographic photogrammetry , 1994 .

[5]  Denis Laurendeau,et al.  Multiresolution Surface Modeling Based on Hierarchical Triangulation , 1996, Comput. Vis. Image Underst..

[6]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[7]  Stuart Robson,et al.  Multiple focus calibration of a still video camera , 1996 .

[8]  Clive S. Fraser,et al.  Digital camera self-calibration , 1997 .

[9]  Steven A. Shafer,et al.  Physics-Based Segmentation of Complex Objects Using Multiple Hypotheses of Image Formation , 1997, Comput. Vis. Image Underst..

[10]  D. Zorin Stationary Subdivision and Multiresolution Surface Representations , 1997 .

[11]  Martial Hebert,et al.  A system for semi-automatic modeling of complex environments , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[12]  Frank A. van den Heuvel,et al.  3D reconstruction from a single image using geometric constraints , 1998 .

[13]  Seth J. Teller,et al.  Toward urban model acquisition from geo-located images , 1998, Proceedings Pacific Graphics '98. Sixth Pacific Conference on Computer Graphics and Applications (Cat. No.98EX208).

[14]  Sabry F. El-Hakim,et al.  A multi-sensor approach to creating accurate virtual environments 1 Revised version of a paper prese , 1998 .

[15]  Sing Bing Kang,et al.  Survey of image-based rendering techniques , 1998, Electronic Imaging.

[16]  Zhengyou Zhang,et al.  Image-Based Geometrically-Correct Photorealistic Scene/Object Modeling (IBPhM): A Review , 1998, ACCV.

[17]  Reinhard Koch,et al.  Hand-held acquisition of 3D models with a video camera , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[18]  Marc Rioux,et al.  Digital 3D imaging system for rapid response on remote sites , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[19]  Kia Ng,et al.  Automated reconstruction of 3D models from real environments , 1999 .

[20]  Antonio Criminisi,et al.  Creating Architectural Models from Images , 1999, Comput. Graph. Forum.

[21]  Claus Brenner TOWARDS FULLY AUTOMATIC GENERATION OF CITY MODELS , 2000 .

[22]  Gerald Eckert Automatic shape reconstruction of rigid 3-D objects from multiple calibrated images , 2000, 2000 10th European Signal Processing Conference.

[23]  A. Grün,et al.  Semi-automated approaches to site recording and modeling , 2000 .

[24]  S. El-Hakim A PRACTICAL APPROACH TO CREATING PRECISE AND DETAILED 3D MODELS FROM SINGLE AND MULTIPLE VIEWS , 2000 .

[25]  D. Gennery,et al.  Calibration and Orientation of Cameras in Computer Vision , 2001 .

[26]  Horst A. Beyer,et al.  System Calibration Through Self-Calibration , 2001 .