Facade Structure Parameterization Based on Similarity Detection from Single Image

In this paper, we reverse engineer facade design from single rectified image of existing building facade by the use of similarity and hierarchy features of man-made objects. The inferred design is encoded into parametric grammar rules, named as ArchSys, which draw a compact and semantically meaningful characterization of the building structure and can be considered to support the design of other architectures. Combining with Gradient-based Mutual Information measure, we propose a rough-fine template-based similarity detection method to extract the structure patterns in a hierarchical way, which reduces computation time while increases robustness of the whole system. Our approach can be applied to various architectural typologies to detect not only symmetrical features but also similar patterns in one facade image. A feedback loop is built to refine the facade structure analysis and rule sets' parameters. Experimental results illustrate that our method is of robustness and general applications.

[1]  Christopher Rasmussen,et al.  Analysis of Building Textures for Reconstructing Partially Occluded Facades , 2008, ECCV.

[2]  George Stiny,et al.  Shape Grammars and the Generative Specification of Painting and Sculpture , 1971, IFIP Congress.

[3]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[4]  Mads Nielsen,et al.  Computer Vision — ECCV 2002 , 2002, Lecture Notes in Computer Science.

[5]  Carlo Tomasi,et al.  Image Similarity Using Mutual Information of Regions , 2004, ECCV.

[6]  Ramakant Nevatia,et al.  Extraction and integration of window in a 3D building model from ground view images , 2004, CVPR 2004.

[7]  Andrew Zisserman,et al.  New Techniques for Automated Architectural Reconstruction from Photographs , 2002, ECCV.

[8]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Roberto Cipolla,et al.  Combining single view recognition and multiple view stereo for architectural scenes , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[10]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[11]  Daniel G. Aliaga,et al.  Build-by-number: rearranging the real world to visualize novel architectural spaces , 2005, VIS 05. IEEE Visualization, 2005..

[12]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[13]  I. Reid,et al.  Single view metrology , 1999, ICCV 1999.

[14]  Josiane Zerubia,et al.  An Automatic Building Reconstruction Method : A Structural Approach using High Resolution Satellite Images , 2006, 2006 International Conference on Image Processing.

[15]  Ramakant Nevatia,et al.  Automatic description of complex buildings from multiple images , 2004, Comput. Vis. Image Underst..

[16]  Max A. Viergever,et al.  Image registration by maximization of combined mutual information and gradient information , 2000, IEEE Transactions on Medical Imaging.

[17]  Jinye Peng,et al.  Images similarity detection based on directional gradient angular histogram , 2002, Object recognition supported by user interaction for service robots.

[18]  Luc Van Gool,et al.  Procedural modeling of buildings , 2006, SIGGRAPH 2006.

[19]  Frank Dellaert,et al.  A Probabilistic Approach to the Semantic Interpretation of Building Facades , 2004 .

[20]  Song-Chun Zhu,et al.  Automatic Single View Building Reconstruction by Integrating Segmentation , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[21]  Michael Wimmer,et al.  Interactive visual editing of grammars for procedural architecture , 2008, SIGGRAPH 2008.

[22]  Luc Van Gool,et al.  Image-based procedural modeling of facades , 2007, SIGGRAPH 2007.

[23]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[24]  Julien Perret,et al.  The FL-system: a functional L-system for procedural geometric modeling , 2005, The Visual Computer.

[25]  Andrew J. Davison,et al.  Active Matching , 2008, ECCV.

[26]  Michael Wimmer,et al.  Instant architecture , 2003, ACM Trans. Graph..