Example-Based Facade Texture Synthesis

There is an increased interest in the efficient creation of city models, be it virtual or as-built. We present a method for synthesizing complex, photo-realistic facade images, from a single example. After parsing the example image into its semantic components, a tiling for it is generated. Novel tilings can then be created, yielding facade textures with different dimensions or with occluded parts in painted. A genetic algorithm guides the novel facades as well as in painted parts to be consistent with the example, both in terms of their overall structure and their detailed textures. Promising results for multiple standard datasets - in particular for the different building styles they contain - demonstrate the potential of the method.

[1]  Harry Shum,et al.  Image completion with structure propagation , 2005, ACM Trans. Graph..

[2]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[3]  Daniel Cohen-Or,et al.  Layered analysis of irregular facades via symmetry maximization , 2013, ACM Trans. Graph..

[4]  Gang Pan,et al.  Structure-Aware Image Completion with Texture Propagation , 2011, 2011 Sixth International Conference on Image and Graphics.

[5]  Daniel G. Aliaga,et al.  A Survey of Urban Reconstruction , 2013, Comput. Graph. Forum.

[6]  Hayko Riemenschneider,et al.  Irregular lattices for complex shape grammar facade parsing , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[8]  Iasonas Kokkinos,et al.  Shape grammar parsing via Reinforcement Learning , 2011, CVPR 2011.

[9]  Daniel Cohen-Or,et al.  Structure-preserving retargeting of irregular 3D architecture , 2011, ACM Trans. Graph..

[10]  Oliver Deussen,et al.  Wang Tiles for image and texture generation , 2003, ACM Trans. Graph..

[11]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[12]  Fan Bao,et al.  Procedural Facade Variations from a Single Layout , 2012 .

[13]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[14]  Yanxi Liu,et al.  Near-regular texture analysis and manipulation , 2004, SIGGRAPH 2004.

[15]  Irfan Essa,et al.  Texture optimization for example-based synthesis , 2005, SIGGRAPH 2005.

[16]  Luc Van Gool,et al.  Learning Domain Knowledge for Façade Labelling , 2012, ECCV.

[17]  Christopher Rasmussen,et al.  Analysis of Building Textures for Reconstructing Partially Occluded Facades , 2008, ECCV.

[18]  Yong-Liang Yang,et al.  Interactive Facades Analysis and Synthesis of Semi‐Regular Facades , 2013, Comput. Graph. Forum.

[19]  Pat Hanrahan,et al.  Synthesis of tiled patterns using factor graphs , 2013, ACM Trans. Graph..

[20]  Luc Van Gool,et al.  Procedural modeling of buildings , 2006, ACM Trans. Graph..

[21]  Ariel Shamir,et al.  Seam Carving for Content-Aware Image Resizing , 2007, ACM Trans. Graph..

[22]  Daniel Cohen-Or,et al.  Fragment-based image completion , 2003, ACM Trans. Graph..

[23]  Sylvain Lefebvre,et al.  By-example synthesis of architectural textures , 2010, ACM Trans. Graph..

[24]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.