Reconstructing and Exploring Massive Detailed Cityscapes

We present a state-of-the-art system for obtaining and exploring large scale three-dimensional models of urban landscapes. A multimodal approach to reconstruction fuses cadastral information, laser range data, and oblique imagery into building models, which are then refined by applying procedural rules for replacing textures with 3D elements, such as windows and doors, therefore enhancing the model quality and adding semantics to the model. For city scale exploration, these detailed models are uploaded to a web-based service, which automatically constructs an approximate scalable multiresolution representation. This representation can be interactively transmitted and visualized over the net to clients ranging from graphics PCs to web-enabled portable devices. The approach's characteristics and performance are illustrated using real-world city-scale data.

[1]  Pascal Gautron,et al.  Render-time procedural per-pixel geometry generation , 2011, Graphics Interface.

[2]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[3]  Ioannis Stamos,et al.  Geometry and Texture Recovery of Scenes of Large Scale , 2002, Comput. Vis. Image Underst..

[4]  Andrea Fusiello.  Image-based Rendering * , 2003 .

[5]  Nikos Paragios,et al.  Large-Scale Building Reconstruction Through Information Fusion and 3-D Priors , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Daniel G. Aliaga,et al.  Build-by-number: rearranging the real world to visualize novel architectural spaces , 2005, VIS 05. IEEE Visualization, 2005..

[7]  Leif Kobbelt,et al.  Procedural Modeling of Interconnected Structures , 2011, Comput. Graph. Forum.

[8]  Daniel G. Aliaga,et al.  Ieee Transactions on Visualization and Computer Graphics 1 Style Grammars for Interactive Visualization of Architecture , 2022 .

[9]  Daniel Cohen-Or,et al.  SmartBoxes for interactive urban reconstruction , 2010, ACM Transactions on Graphics.

[10]  Peter Wonka,et al.  Procedural Methods for Urban Modeling , 2008, IEEE Computer Graphics and Applications.

[11]  Luc Van Gool,et al.  Procedural 3D Reconstruction of Puuc Buildings in Xkipché , 2006, VAST.

[12]  Christian Früh,et al.  Data Processing Algorithms for Generating Textured 3D Building Facade Meshes from Laser Scans and Camera Images , 2005, International Journal of Computer Vision.

[13]  Michael Wimmer,et al.  Instant architecture , 2003, ACM Trans. Graph..

[14]  George Stiny,et al.  Shape Grammars and the Generative Specification of Painting and Sculpture , 1971, IFIP Congress.

[15]  Jürgen Döllner,et al.  View-dependent rendering of multiresolution texture-atlases , 2005, VIS 05. IEEE Visualization, 2005..

[16]  Luc Van Gool,et al.  Procedural modeling of buildings , 2006, ACM Trans. Graph..

[17]  Suya You,et al.  Automatic reconstruction of cities from remote sensor data , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Antje Kunze,et al.  Using Shape Grammars for Master Planning , 2008 .

[19]  Andrew W. Fitzgibbon,et al.  Automatic 3D model acquisition and generation of new images from video sequences , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[20]  Christian Früh,et al.  Automated texture mapping of 3D city models with oblique aerial imagery , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[21]  Paolo Cignoni,et al.  Interactive remote exploration of massive cityscapes , 2009, VAST'09.

[22]  Paolo Cignoni,et al.  Ray‐Casted BlockMaps for Large Urban Models Visualization , 2007, Comput. Graph. Forum.

[23]  Marilyn Bohl,et al.  Information processing , 1971 .

[24]  Luc Van Gool,et al.  Populating Ancient Pompeii with Crowds of Virtual Romans , 2007, VAST.

[25]  Harry Shum,et al.  Image-based rendering , 2006, Found. Trends Comput. Graph. Vis..

[26]  Pere-Pau Vázquez,et al.  Omni‐directional Relief Impostors , 2007, Comput. Graph. Forum.

[27]  Pere Brunet Crosa,et al.  Relief impostor selection for large scale urban rendering , 2008 .

[28]  Suya You,et al.  Photorealistic Large-Scale Urban City Model Reconstruction , 2009, IEEE Transactions on Visualization and Computer Graphics.

[29]  Antje Kunze,et al.  Using Shape Grammars for Master Planning; 3rd International Conference on Design Computing and Cognition; ; Design Computing and Cognition '08 , 2008 .

[30]  Didier BOLDO,et al.  DETECTION, SEGMENTATION AND CHARACTERISATION OF VEGETATION IN HIGH-RESOLUTION AERIAL IMAGES FOR 3D CITY MODELLING , 2007 .

[31]  Luc Van Gool,et al.  Grammar‐based Encoding of Facades , 2010, Comput. Graph. Forum.

[32]  Luc Van Gool,et al.  Image-based procedural modeling of facades , 2007, SIGGRAPH 2007.

[33]  John W. Fisher,et al.  Automatic registration of LIDAR and optical images of urban scenes , 2009, CVPR.