Building Placements In Urban Modeling Using Conditional Generative Latent Optimization

Generating realistic urban environments by scattering or placing buildings on maps is a challenging problem. Unlike the existing procedural methods, we employ a data-driven approach to this problem. We combine two recent advances in machine learning techniques, Generative Latent optimization (GLO) together with adversarial training, to learn a model that can easily generate and place buildings on a given map. Such a model enables its users, particularly artists, to easily generate areas with specific styles, e.g. residential or commercial, just by providing examples. In contrast, traditional procedural methods require lengthy manual tuning of hyper-parameters. Using a more flexible method like ours allows artists to iterate over their designs of urban layouts much faster. Finally, our experiments on real-world data show that our method outperforms state-of-the-art methods in visual quality and can better match the underlying distribution of the building placements.

[1]  Haibin Ling,et al.  Diffusion Distance for Histogram Comparison , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[2]  Michael Weinmann,et al.  StreetGAN: towards road network synthesis with generative adversarial networks , 2017 .

[3]  Alexandros G. Dimakis,et al.  Compressed Sensing using Generative Models , 2017, ICML.

[4]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[5]  Rafael Bidarra,et al.  A Survey on Procedural Modelling for Virtual Worlds , 2014, Comput. Graph. Forum.

[6]  David Lopez-Paz,et al.  Optimizing the Latent Space of Generative Networks , 2017, ICML.

[7]  Daniel G. Aliaga,et al.  Procedural Generation of Parcels in Urban Modeling , 2012, Comput. Graph. Forum.

[8]  Niloy J. Mitra,et al.  Learning Semantic Deformation Flows with 3D Convolutional Networks , 2016, ECCV.

[9]  George Kelly kellygp Citygen : An Interactive System for Procedural City Generation , 2007 .

[10]  Daniel G. Aliaga,et al.  Interactive example-based urban layout synthesis , 2008, SIGGRAPH 2008.

[11]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[12]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[13]  Eugene Zhang,et al.  Interactive procedural street modeling , 2008, ACM Trans. Graph..

[14]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[15]  Daniel Cohen-Or,et al.  Structure-aware shape processing , 2013, Eurographics.

[16]  Yuichi Yoshida,et al.  Spectral Normalization for Generative Adversarial Networks , 2018, ICLR.

[17]  Daniel G. Aliaga,et al.  Modelling the Appearance and Behaviour of Urban Spaces , 2010, Comput. Graph. Forum.

[18]  Kiyoshi Tanaka,et al.  ArtGAN: Artwork synthesis with conditional categorical GANs , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[19]  Chuan Li,et al.  Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks , 2016, ECCV.