Procedural Modeling Using Autoencoder Networks

Procedural modeling systems allow users to create high quality content through parametric, conditional or stochastic rule sets. While such approaches create an abstraction layer by freeing the user from direct geometry editing, the nonlinear nature and the high number of parameters associated with such design spaces result in arduous modeling experiences for non-expert users. We propose a method to enable intuitive exploration of such high dimensional procedural modeling spaces within a lower dimensional space learned through autoencoder network training. Our method automatically generates a representative training dataset from the procedural modeling rule set based on shape similarity features. We then leverage the samples in this dataset to train an autoencoder neural network, while also structuring the learned lower dimensional space for continuous exploration with respect to shape features. We demonstrate the efficacy our method with user studies where designers create content with more than 10-fold faster speeds using our system compared to the classic procedural modeling interface.

[1]  Radomír Mech,et al.  Metropolis procedural modeling , 2011, TOGS.

[2]  J. Ian Munro,et al.  Efficient Generation of Uniform Samples from Phylogenetic Trees , 2003, WABI.

[3]  Antonio Criminisi,et al.  TextonBoost for Image Understanding: Multi-Class Object Recognition and Segmentation by Jointly Modeling Texture, Layout, and Context , 2007, International Journal of Computer Vision.

[4]  Rui Ma,et al.  Topology-varying 3D shape creation via structural blending , 2014, ACM Trans. Graph..

[5]  A. Lindenmayer Mathematical models for cellular interactions in development. I. Filaments with one-sided inputs. , 1968, Journal of theoretical biology.

[6]  Yann LeCun,et al.  Pedestrian Detection with Unsupervised Multi-stage Feature Learning , 2012, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Levent Burak Kara,et al.  Semantic shape editing using deformation handles , 2015, ACM Trans. Graph..

[8]  Daniel Cohen-Or,et al.  Image Appearance Exploration by Model‐Based Navigation , 2009, Comput. Graph. Forum.

[9]  Tony DeRose,et al.  A multisided generalization of Bézier surfaces , 1989, TOGS.

[10]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[11]  Stephen J. Willson,et al.  Building Phylogenetic Trees from Quartets by Using Local Inconsistency Measures , 1999 .

[12]  G. Miller,et al.  The Deco Framework for Interactive Procedural Modeling , 2013 .

[13]  Geoffrey E. Hinton,et al.  Phone Recognition with the Mean-Covariance Restricted Boltzmann Machine , 2010, NIPS.

[14]  Radomír Mech,et al.  Visual models of plants interacting with their environment , 1996, SIGGRAPH.

[15]  Przemyslaw Prusinkiewicz,et al.  Graphical applications of L-systems , 1986 .

[16]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[17]  Peter Wonka,et al.  Procedural Design of Exterior Lighting for Buildings with Complex Constraints , 2014, ACM Trans. Graph..

[18]  T. Germer,et al.  Procedural Arrangement of Furniture for Real‐Time Walkthroughs , 2009, Comput. Graph. Forum.

[19]  Hans-Peter Seidel,et al.  Exploring Shape Variations by 3D‐Model Decomposition and Part‐based Recombination , 2012, Comput. Graph. Forum.

[20]  Siddhartha Chaudhuri,et al.  Attribit: content creation with semantic attributes , 2013, UIST.

[21]  Rafael Bidarra,et al.  A Survey on Procedural Modelling for Virtual Worlds , 2014, Comput. Graph. Forum.

[22]  Aristid Lindenmayer,et al.  Mathematical Models for Cellular Interactions in Development , 1968 .

[23]  Takeo Igarashi,et al.  Guided exploration of physically valid shapes for furniture design , 2015, Commun. ACM.

[24]  Siddhartha Chaudhuri,et al.  A probabilistic model for component-based shape synthesis , 2012, ACM Trans. Graph..

[25]  Vladlen Koltun,et al.  Computer-generated residential building layouts , 2010, SIGGRAPH 2010.

[26]  Karan Singh,et al.  Sketch-based path design , 2009, Graphics Interface.

[27]  Jason Weber,et al.  Creation and rendering of realistic trees , 1995, SIGGRAPH.

[28]  Satish Rao,et al.  Quartets MaxCut: A Divide and Conquer Quartets Algorithm , 2010, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[29]  Juhan Nam,et al.  Multimodal Deep Learning , 2011, ICML.

[30]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[31]  Niloy J. Mitra,et al.  ShapeSynth: Parameterizing model collections for coupled shape exploration and synthesis , 2014, Comput. Graph. Forum.

[32]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[33]  Thomas Brox,et al.  Learning to generate chairs with convolutional neural networks , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Daniel Cohen-Or,et al.  Fit and diverse , 2012, ACM Trans. Graph..

[35]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[36]  Mark James,et al.  Synthetic topiary , 1994, SIGGRAPH.

[37]  Shi-Min Hu,et al.  Qualitative organization of collections of shapes via quartet analysis , 2013, ACM Trans. Graph..

[38]  Marc'Aurelio Ranzato,et al.  Unsupervised Learning of Invariant Feature Hierarchies with Applications to Object Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Michael Wimmer,et al.  Instant architecture , 2003, ACM Trans. Graph..

[40]  Ming Ouhyoung,et al.  On Visual Similarity Based 3D Model Retrieval , 2003, Comput. Graph. Forum.

[41]  Stefan Lienhard,et al.  Thumbnail galleries for procedural models , 2014, Comput. Graph. Forum.

[42]  Kazi Zakia Sultana,et al.  New Constraints on Generation of Uniform Random Samples from Evolutionary Trees , 2006, 2006 Canadian Conference on Electrical and Computer Engineering.

[43]  George Stiny,et al.  Shape Grammars and the Generative Specification of Painting and Sculpture , 1971, IFIP Congress.

[44]  Pascal Müller,et al.  Procedural modeling of cities , 2001, SIGGRAPH.

[45]  Radomír Mech,et al.  Inverse Procedural Modelling of Trees , 2014, Comput. Graph. Forum.

[46]  Oliver Deussen,et al.  Interactive Modeling of Plants , 1999, IEEE Computer Graphics and Applications.

[47]  Przemyslaw Prusinkiewicz,et al.  The Algorithmic Beauty of Plants , 1990, The Virtual Laboratory.

[48]  Pat Hanrahan,et al.  Exploratory modeling with collaborative design spaces , 2009, ACM Trans. Graph..

[49]  Takeo Igarashi,et al.  Crowd-powered parameter analysis for visual design exploration , 2014, UIST.

[50]  Paul A. Beardsley,et al.  Design galleries: a general approach to setting parameters for computer graphics and animation , 1997, SIGGRAPH.

[51]  Jitendra Malik,et al.  Shape Context: A New Descriptor for Shape Matching and Object Recognition , 2000, NIPS.

[52]  Luc Van Gool,et al.  Procedural modeling of buildings , 2006, ACM Trans. Graph..

[53]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[54]  Daniel G. Aliaga,et al.  Inverse design of urban procedural models , 2012, ACM Trans. Graph..

[55]  Chris White,et al.  King Kong: the building of 1933 New York City , 2006, SIGGRAPH '06.