Towards mass-produced building models

Interest in the automatic production of 3D building models has increased over the last years. The reconstruction of buildings, particularly their facades, is a hard subproblem, given the large variety in their appearances and structures. This paper discusses building facade reconstruction algorithms that process single images and exploit expectations about facade composition. In particular, we make heavy use of the repetitions that tend to occur, e.g. in windows and balconies. But this is only an example of the kind of rules found in recent architectural shape grammars. We distinguish between cases without and with substantial perspective effects in the input image. The focus is on the latter case, where also some depth layering in the facade can be performed automatically. We give several examples of real building reconstructions.

[1]  Daniel G. Aliaga,et al.  Build-by-number: rearranging the real world to visualize novel architectural spaces , 2005, VIS 05. IEEE Visualization, 2005..

[2]  Julien Perret,et al.  The FL-system: a functional L-system for procedural geometric modeling , 2005, The Visual Computer.

[3]  Paul Debevec,et al.  Modeling and Rendering Architecture from Photographs , 1996, SIGGRAPH 1996.

[4]  Suya You,et al.  Integrating LiDAR, Aerial Image and Ground Images for Complete Urban Building Modeling , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[5]  Luc Van Gool,et al.  Procedural modeling of buildings , 2006, ACM Trans. Graph..

[6]  Roberto Cipolla,et al.  Modelling and Interpretation of Architecture from Several Images , 2004, International Journal of Computer Vision.

[7]  Konrad Schindler,et al.  A model-based method for building reconstruction , 2003, First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003..

[8]  Frank Dellaert,et al.  A Probabilistic Approach to the Semantic Interpretation of Building Facades , 2004 .

[9]  William Ribarsky,et al.  From Urban Terrain Models to Visible Cities , 2002, IEEE Computer Graphics and Applications.

[10]  Alexei A. Efros,et al.  Discovering Texture Regularity as a Higher-Order Correspondence Problem , 2006, ECCV.

[11]  Radomír Mech,et al.  Visual models of plants interacting with their environment , 1996, SIGGRAPH.

[12]  Michael Wimmer,et al.  Instant architecture , 2003, ACM Trans. Graph..

[13]  S. Teller,et al.  RECOVERING FACADE TEXTURE AND MICROSTRUCTURE FROM REAL-WORLD IMAGES , 2002 .

[14]  Andrew Zisserman,et al.  Metric rectification for perspective images of planes , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[15]  Nora Ripperda.  EXTRACTION OF FAÇADES USING RJMCMC AND CONSTRAINT EQUATIONS , 2006 .

[16]  Ramakant Nevatia,et al.  Interactive 3D building modeling using a hierarchical representation , 2003, First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003..

[17]  Przemyslaw Prusinkiewicz,et al.  The Algorithmic Beauty of Plants , 1990, The Virtual Laboratory.

[18]  Roberto Cipolla,et al.  Combining single view recognition and multiple view stereo for architectural scenes , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[19]  Christian Früh,et al.  Constructing 3D City Models by Merging Aerial and Ground Views , 2003, IEEE Computer Graphics and Applications.

[20]  Sven Havemann,et al.  Generative mesh modeling , 2005 .

[21]  Ramakant Nevatia,et al.  Automatic Integration of Facade Textures into 3D Building Models with a Projective Geometry Based Line Clustering , 2002, Comput. Graph. Forum.

[22]  Mark James,et al.  Synthetic topiary , 1994, SIGGRAPH.

[23]  George Stiny,et al.  Spatial Relations and Grammars , 1982 .

[24]  George Stiny,et al.  Pictorial and Formal Aspects of Shape and Shape Grammars , 1975 .

[25]  Helmut Mayer,et al.  BUILDING FACADE INTERPRETATION FROM IMAGE SEQUENCES , 2005 .

[26]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[27]  Steven J. Gortler,et al.  Feature-based cellular texturing for architectural models , 2001, SIGGRAPH.

[28]  U Flemming,et al.  More Than the Sum of Parts: The Grammar of Queen Anne Houses , 1987 .

[29]  Ramakant Nevatia,et al.  Extraction and integration of window in a 3D building model from ground view images , 2004, CVPR 2004.

[30]  Pascal Müller,et al.  Procedural modeling of cities , 2001, SIGGRAPH.

[31]  Joachim Bauer,et al.  Virtual Habitat: Models of the Urban Outdoors , 2001 .

[32]  H. Koning,et al.  The Language of the Prairie: Frank Lloyd Wright's Prairie Houses , 1981 .

[33]  Brendan Lane,et al.  The use of positional information in the modeling of plants , 2001, SIGGRAPH.

[34]  Lu Wang,et al.  Large-Scale Urban Modeling by Combining Ground Level Panoramic and Aerial Imagery , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[35]  Ramakant Nevatia,et al.  Extraction and integration of window in a 3D building model from ground view images , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[36]  Luc Van Gool,et al.  Image-based procedural modeling of facades , 2007, SIGGRAPH 2007.

[37]  William J. Mitchell,et al.  The Palladian Grammar , 1978 .

[38]  R. Reulke,et al.  Remote Sensing and Spatial Information Sciences , 2005 .

[39]  Christian Früh,et al.  3D model generation for cities using aerial photographs and ground level laser scans , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[40]  Robin Liggett,et al.  Virtual Modeling of Urban Environments , 1996, Presence: Teleoperators & Virtual Environments.