Interactive design of probability density functions for shape grammars

A shape grammar defines a procedural shape space containing a variety of models of the same class, e.g. buildings, trees, furniture, airplanes, bikes, etc. We present a framework that enables a user to interactively design a probability density function (pdf) over such a shape space and to sample models according to the designed pdf. First, we propose a user interface that enables a user to quickly provide preference scores for selected shapes and suggest sampling strategies to decide which models to present to the user to evaluate. Second, we propose a novel kernel function to encode the similarity between two procedural models. Third, we propose a framework to interpolate user preference scores by combining multiple techniques: function factorization, Gaussian process regression, autorelevance detection, and l1 regularization. Fourth, we modify the original grammars to generate models with a pdf proportional to the user preference scores. Finally, we provide evaluations of our user interface and framework parameters and a comparison to other exploratory modeling techniques using modeling tasks in five example shape spaces: furniture, low-rise buildings, skyscrapers, airplanes, and vegetation.

[1]  Takeo Igarashi,et al.  Crowd-powered parameter analysis for visual design exploration , 2014, UIST.

[2]  Dong-Ming Yan,et al.  Generating and exploring good building layouts , 2013, ACM Trans. Graph..

[3]  George Stiny,et al.  Spatial Relations and Grammars , 1982 .

[4]  George Stiny,et al.  Pictorial and Formal Aspects of Shape and Shape Grammars , 1975 .

[5]  Nikos Paragios,et al.  Random Exploration of the Procedural Space for Single-View 3D Modeling of Buildings , 2011, International Journal of Computer Vision.

[6]  Stefan Lienhard,et al.  Thumbnail galleries for procedural models , 2014, Comput. Graph. Forum.

[7]  Luc Van Gool,et al.  Bayesian Grammar Learning for Inverse Procedural Modeling , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Siddhartha Chaudhuri,et al.  Attribit: content creation with semantic attributes , 2013, UIST.

[9]  Mark Johnson,et al.  PCFG Models of Linguistic Tree Representations , 1998, CL.

[10]  Takeo Igarashi,et al.  Guided exploration of physically valid shapes for furniture design , 2015, Commun. ACM.

[11]  Pascal Müller,et al.  Procedural modeling of cities , 2001, SIGGRAPH.

[12]  Bailin Deng,et al.  Exploring Local Modifications for Constrained Meshes , 2013, Comput. Graph. Forum.

[13]  Fabio Pellacini,et al.  Toward evaluating material design interface paradigms for novice users , 2010, ACM Trans. Graph..

[14]  Siddhartha Chaudhuri,et al.  A probabilistic model for component-based shape synthesis , 2012, ACM Trans. Graph..

[15]  Luc Van Gool,et al.  Image-based procedural modeling of facades , 2007, ACM Trans. Graph..

[16]  Luc Van Gool,et al.  Procedural modeling of buildings , 2006, SIGGRAPH 2006.

[17]  Radomír Mech,et al.  Learning design patterns with bayesian grammar induction , 2012, UIST.

[18]  Michael Wimmer,et al.  Instant architecture , 2003, ACM Trans. Graph..

[19]  H. Seidel,et al.  A connection between partial symmetry and inverse procedural modeling , 2010, SIGGRAPH 2010.

[20]  Michael Wimmer,et al.  Interactive visual editing of grammars for procedural architecture , 2008, SIGGRAPH 2008.

[21]  Niloy J. Mitra,et al.  ShapeSynth: Parameterizing model collections for coupled shape exploration and synthesis , 2014, Comput. Graph. Forum.

[22]  Rafael Bidarra,et al.  A Survey on Procedural Modelling for Virtual Worlds , 2014, Comput. Graph. Forum.

[23]  Daniel Cohen-Or,et al.  Eurographics Symposium on Geometry Processing 2013 Dynamic Maps for Exploring and Browsing Shapes , 2022 .

[24]  Radomír Mech,et al.  Guided Procedural Modeling , 2011, Comput. Graph. Forum.

[25]  Ali Farhadi,et al.  Describing objects by their attributes , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Maneesh Agrawala,et al.  Interactive furniture layout using interior design guidelines , 2011, SIGGRAPH 2011.

[27]  John C. Platt,et al.  Learning a Gaussian Process Prior for Automatically Generating Music Playlists , 2001, NIPS.

[28]  Radomír Mech,et al.  Visual models of plants interacting with their environment , 1996, SIGGRAPH.

[29]  Daniel G. Aliaga,et al.  Inverse Procedural Modeling by Automatic Generation of L‐systems , 2010, Comput. Graph. Forum.

[30]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[31]  WonkaPeter,et al.  Interactive design of probability density functions for shape grammars , 2015 .

[32]  Aaron Hertzmann,et al.  Exploratory font selection using crowdsourced attributes , 2014, ACM Trans. Graph..

[33]  Radomír Mech,et al.  Metropolis procedural modeling , 2011, TOGS.

[34]  Nando de Freitas,et al.  A Bayesian interactive optimization approach to procedural animation design , 2010, SCA '10.

[35]  Christopher K. I. Williams,et al.  Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning) , 2005 .

[36]  Daniel Cohen-Or,et al.  Fit and diverse , 2012, ACM Trans. Graph..

[37]  Takeo Igarashi,et al.  Guided exploration of physically valid shapes for furniture design , 2012, ACM Trans. Graph..

[38]  Paul A. Beardsley,et al.  Design galleries: a general approach to setting parameters for computer graphics and animation , 1997, SIGGRAPH.

[39]  Mark James,et al.  Synthetic topiary , 1994, SIGGRAPH.

[40]  Ronen I. Brafman,et al.  Designing with interactive example galleries , 2010, CHI.

[41]  Fabio Pellacini,et al.  Toward evaluating lighting design interface paradigms for novice users , 2009, SIGGRAPH 2009.

[42]  Lucas Kovar,et al.  Simplicial families of drawings , 2001, UIST '01.

[43]  Daniel Cohen-Or,et al.  Image Appearance Exploration by Model‐Based Navigation , 2009, Comput. Graph. Forum.

[44]  Dong-Ming Yan,et al.  Inverse procedural modeling of facade layouts , 2013, ACM Trans. Graph..

[45]  Helmut Pottmann,et al.  Shape space exploration of constrained meshes , 2011, ACM Trans. Graph..

[46]  Pat Hanrahan,et al.  Exploratory modeling with collaborative design spaces , 2009, SIGGRAPH 2009.

[47]  William J. Mitchell,et al.  The Palladian Grammar , 1978 .

[48]  Przemyslaw Prusinkiewicz,et al.  The Algorithmic Beauty of Plants , 1990, The Virtual Laboratory.

[49]  Przemyslaw Prusinkiewicz,et al.  Graphical applications of L-systems , 1986 .