A Survey on Procedural Modeling for Virtual Worlds

Procedural modeling deals with (semi-)automatic content generation by means of a program or procedure. Among other advantages, its data compression and the potential to generate a large variety of detailed content with reduced human intervention, have made procedural modeling attractive for creating virtual environments increasingly used in movies, games, and simulations. We survey procedural methods that are useful to generate features of virtual worlds, including terrains, vegetation, rivers, roads, buildings, and entire cities. In this survey, we focus particularly on the degree of intuitive control and of interactivity offered by each procedural method, because these properties are instrumental for their typical users: designers and artists. We identify the most promising research results that have been recently achieved, but we also realize that there is far from widespread acceptance of procedural methods among non-technical, creative professionals. We conclude by discussing some of the most important challenges of procedural modeling.

[1]  Rafael Bidarra,et al.  Generating Consistent Buildings: A Semantic Approach for Integrating Procedural Techniques , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[2]  P. Prusinkiewicz,et al.  A Fractal Model of Mountains with Rivers , 2000 .

[3]  Daniel G. Aliaga,et al.  Inverse design of urban procedural models , 2012, ACM Trans. Graph..

[4]  Takeo Igarashi,et al.  Seamless Integration of Initial Sketching and Subsequent Detail Editing in Flower Modeling , 2006, Comput. Graph. Forum.

[5]  Markus H. Gross,et al.  Interactive Geometric Simulation of 4D Cities , 2009, Comput. Graph. Forum.

[6]  Vladlen Koltun,et al.  Computer-generated residential building layouts , 2010, ACM Trans. Graph..

[7]  Bedrich Benes,et al.  Interactive terrain modeling using hydraulic erosion , 2008, SCA '08.

[8]  Radomír Mech,et al.  Plastic trees , 2012, ACM Trans. Graph..

[9]  Wolfgang Straßer,et al.  Terrain sketching , 2009, I3D '09.

[10]  James M. Rehg,et al.  Terrain Synthesis from Digital Elevation Models , 2007, IEEE Transactions on Visualization and Computer Graphics.

[11]  Przemyslaw Prusinkiewicz,et al.  Simulation modeling of plants and plant ecosystems , 2000, CACM.

[12]  James Arvo,et al.  Modeling Plants with Environment-Sensitive Automata , 1988 .

[13]  Jan Bender,et al.  SEMANTIC REPRESENTATION OF COMPLEX BUILDING STRUCTURES , 2008 .

[14]  Gregory M. Nielson,et al.  Terrain simulation using a model of stream erosion , 1988, SIGGRAPH.

[15]  Bedrich Benes,et al.  Terrain generation using procedural models based on hydrology , 2013, ACM Trans. Graph..

[16]  Oliver Deussen,et al.  Modeling and Visualization of symmetric and asymmetric plant competition , 2005, NPH.

[17]  Bedrich Benes,et al.  Interactive Modeling of Virtual Ecosystems , 2009, NPH.

[18]  Daniel G. Aliaga,et al.  Urban ecosystem design , 2011, SI3D.

[19]  Farès Belhadj,et al.  Terrain modeling: a constrained fractal model , 2007, AFRIGRAPH '07.

[20]  Johan Hammes Modeling of Ecosystems as a Data Source for Real-Time Terrain Rendering , 2001, Digital Earth Moving.

[21]  Xiaobo Yu,et al.  Template-based generation of road networks for virtual city modeling , 2002, VRST '02.

[22]  H. Seidel,et al.  A connection between partial symmetry and inverse procedural modeling , 2010, SIGGRAPH 2010.

[23]  Benjamin Watson,et al.  Procedural modeling of urban land use , 2006, SIGGRAPH '06.

[24]  Daniel G. Aliaga,et al.  Interactive design of urban spaces using geometrical and behavioral modeling , 2009, SIGGRAPH 2009.

[25]  Rafael Bidarra,et al.  Integrating procedural generation and manual editing of virtual worlds , 2010, PCGames@FDG.

[26]  Jason Weber,et al.  Creation and rendering of realistic trees , 1995, SIGGRAPH.

[27]  Daniel G. Aliaga,et al.  Inverse Procedural Modeling by Automatic Generation of L‐systems , 2010, Comput. Graph. Forum.

[28]  George Stiny,et al.  Shape Grammars and the Generative Specification of Painting and Sculpture , 1971, IFIP Congress.

[29]  Alvy Ray Smith,et al.  Plants, fractals, and formal languages , 1984, SIGGRAPH.

[30]  Bruno Galerne,et al.  Gabor noise by example , 2012, ACM Trans. Graph..

[31]  Daniel Cohen-Or,et al.  Layered analysis of irregular facades via symmetry maximization , 2013, ACM Trans. Graph..

[32]  P. Prusinkiewicz,et al.  Modeling and visualization of leaf venation patterns , 2005, SIGGRAPH 2005.

[33]  Manuel N. Gamito Procedural Landscapes with Overhangs , 2001 .

[34]  Donald S. Fussell,et al.  Computer rendering of stochastic models , 1998 .

[35]  Yong Liu,et al.  Semantic modeling project: building vernacular house of southeast China , 2004, VRCAI.

[36]  Samir Akkouche,et al.  Feature based terrain generation using diffusion equation , 2010, Comput. Graph. Forum.

[37]  Greg Turk,et al.  Animating Corrosion and Erosion , 2007, NPH.

[38]  Bedrich Benes,et al.  Virtual climbing plants competing for space , 2002, Proceedings of Computer Animation 2002 (CA 2002).

[39]  Radomír Mech,et al.  Self-organizing tree models for image synthesis , 2009, ACM Trans. Graph..

[40]  Leif Kobbelt,et al.  Procedural Modeling of Interconnected Structures , 2011, Comput. Graph. Forum.

[41]  Jess Martin,et al.  Procedural House Generation : A method for dynamically generating floor plans , 2006 .

[42]  Rafael Bidarra,et al.  Rule-based layout solving and its application to procedural interior generation , 2009 .

[43]  Hugh McCabe,et al.  A Survey of Procedural Techniques for City Generation , 2006 .

[44]  Benoit B. Mandelbrot,et al.  Fractal Geometry of Nature , 1984 .

[45]  Przemyslaw Prusinkiewicz,et al.  Graphical applications of L-systems , 1986 .

[46]  Stefan Greuter,et al.  Real-time procedural generation of `pseudo infinite' cities , 2003, GRAPHITE '03.

[47]  Szymon Chojnacki Scoring functions for automatic arrangement of business interiors , 2012, SIGGRAPH 2012.

[48]  Luc Van Gool,et al.  Image-based procedural modeling of facades , 2007, SIGGRAPH 2007.

[49]  Eugene Zhang,et al.  Interactive procedural street modeling , 2008, ACM Trans. Graph..

[50]  D. Kwon ArchiDNA : A Generative System for Shape Configuration , 2003 .

[51]  Daniel G. Aliaga,et al.  Interactive example-based urban layout synthesis , 2008, ACM Trans. Graph..

[52]  Rafael Bidarra,et al.  A declarative approach to procedural modeling of virtual worlds , 2011, Comput. Graph..

[53]  Rafael Bidarra,et al.  Interactive GPU-based procedural heightfield brushes , 2009, FDG.

[54]  Bedrich Benes,et al.  Large-Scale Physics-Based Terrain Editing Using Adaptive Tiles on the GPU , 2011, IEEE Computer Graphics and Applications.

[55]  Rafael Bidarra,et al.  A Semantic Scene Description Language for Procedural Layout Solving Problems , 2010, AIIDE.

[56]  Leif Kobbelt,et al.  Interactive modeling by procedural high-level primitives , 2012, Comput. Graph..

[57]  Eric Galin,et al.  Procedural Generation of Roads , 2010, Comput. Graph. Forum.

[58]  Chi-Keung Tang,et al.  Make it home: automatic optimization of furniture arrangement , 2011, ACM Trans. Graph..

[59]  Bedrich Benes,et al.  Hydraulic Erosion Using Smoothed Particle Hydrodynamics , 2009, Comput. Graph. Forum.

[60]  Prosenjit Bose,et al.  Persistent realtime building interior generation , 2006, Sandbox '06.

[61]  Fabrice Neyret,et al.  Real‐Time Rendering and Editing of Vector‐based Terrains , 2008, Comput. Graph. Forum.

[62]  Kyung-Joong Kim,et al.  3D game model and texture generation using interactive genetic algorithm , 2012, WASA '12.

[63]  Marie-Paule Cani,et al.  Procedural generation of villages on arbitrary terrains , 2012, The Visual Computer.

[64]  Przemyslaw Prusinkiewicz,et al.  Development models of herbaceous plants for computer imagery purposes , 1988, SIGGRAPH.

[65]  Michael Wimmer,et al.  Instant architecture , 2003, ACM Trans. Graph..

[66]  Eric Galin,et al.  Arches: a Framework for Modeling Complex Terrains , 2009, Comput. Graph. Forum.

[67]  F. K. Musgrave Methods for realistic landscape imaging , 1993 .

[68]  V. K. Prasad Digital Terrain Modeling: Principles and Methodology , 2009 .

[69]  Ryan L. Saunders Terrainosaurus: realistic terrain synthesis using genetic algorithms , 2007 .

[70]  Takeo Igarashi,et al.  The Sketch L-System: Global Control of Tree Modeling Using Free-Form Strokes , 2006, Smart Graphics.

[71]  Radomír Mech,et al.  Realistic modeling and rendering of plant ecosystems , 1998, SIGGRAPH.

[72]  A. Lindenmayer Mathematical models for cellular interactions in development. I. Filaments with one-sided inputs. , 1968, Journal of theoretical biology.

[73]  W. Stuerzlinger,et al.  An Algorithm for Automated Fractal Terrain Deformation , 2005 .

[74]  Radomír Mech,et al.  Guided Procedural Modeling , 2011, Comput. Graph. Forum.

[75]  Alexei Sourin,et al.  Physically based hydraulic erosion simulation on graphics processing unit , 2007, GRAPHITE '07.

[76]  Philippe Charman,et al.  Solving Space Planning Problems Using Constraint Technology , 1993 .

[77]  H. Koning,et al.  The Language of the Prairie: Frank Lloyd Wright's Prairie Houses , 1981 .

[78]  Pascal Müller,et al.  Procedural modeling of cities , 2001, SIGGRAPH.

[79]  Pedro Brandão Silva,et al.  Node-Based Shape Grammar Representation and Editing , 2013 .

[80]  George Kelly kellygp Citygen : An Interactive System for Procedural City Generation , 2007 .

[81]  Rafael Bidarra,et al.  Interactive Creation of Virtual Worlds Using Procedural Sketching , 2010, Eurographics.

[82]  Bedrich Benes,et al.  Layered data representation for visual simulation of terrain erosion , 2001, Proceedings Spring Conference on Computer Graphics.

[83]  Ned Greene,et al.  Voxel space automata: modeling with stochastic growth processes in voxel space , 1989, SIGGRAPH.

[84]  Gülen Çaǧdaş,et al.  A shape grammar model for designing row-houses , 1996 .

[85]  Ian Parberry,et al.  Controlled Procedural Terrain Generation Using Software Agents , 2010, IEEE Transactions on Computational Intelligence and AI in Games.

[86]  Qing Zhu,et al.  Digital terrain modeling - principles and methodology , 2004 .

[87]  Karan Singh,et al.  Sketch-based path design , 2009, Graphics Interface.

[88]  Daniel G. Aliaga,et al.  Procedural Generation of Parcels in Urban Modeling , 2012, Comput. Graph. Forum.

[89]  Bedrich Benes,et al.  Hydraulic erosion , 2006, Comput. Animat. Virtual Worlds.

[90]  Jianxiong Xiao,et al.  Image-based façade modeling , 2008, ACM Trans. Graph..

[91]  Hao Zhang,et al.  Automatic reconstruction of tree skeletal structures from point clouds , 2010, SIGGRAPH 2010.

[92]  Gavin S. P. Miller,et al.  The definition and rendering of terrain maps , 1986, SIGGRAPH.

[93]  Farès Belhadj,et al.  Modeling landscapes with ridges and rivers: bottom up approach , 2005, GRAPHITE '05.

[94]  Shaun Bangay,et al.  Duplicating road patterns in south african informal settlements using procedural techniques , 2006, AFRIGRAPH '06.

[95]  Michael Wimmer,et al.  Interactive visual editing of grammars for procedural architecture , 2008, SIGGRAPH 2008.

[96]  Michael Wimmer,et al.  Interactive Modeling of City Layouts using Layers of Procedural Content , 2011, Comput. Graph. Forum.

[97]  Ken Perlin,et al.  [Computer Graphics]: Three-Dimensional Graphics and Realism , 2022 .

[98]  Peter Wonka,et al.  Procedural Urban Modeling in Practice , 2008, IEEE Computer Graphics and Applications.

[99]  Philip Amburn,et al.  Managing geometric complexity with enhanced procedural models , 1986, SIGGRAPH.

[100]  Adam Runions,et al.  Modeling Trees with a Space Colonization Algorithm , 2007, NPH.

[101]  강태원,et al.  [서평]「Chaos and Fractals : New Frontiers of Science」 , 1998 .

[102]  Rafael Bidarra,et al.  Procedural City Layout Generation Based on Urban Land Use Models , 2009, Eurographics.

[103]  Przemyslaw Prusinkiewicz,et al.  Animation of plant development , 1993, SIGGRAPH.

[104]  Maneesh Agrawala,et al.  Interactive furniture layout using interior design guidelines , 2011, SIGGRAPH 2011.

[105]  Andrew Rau-Chaplin,et al.  The LaHave House Project: Towards an Automated Architectural Design Service , 2008 .

[106]  Gustavo Patow User-Friendly Graph Editing for Procedural Modeling of Buildings , 2012, IEEE Computer Graphics and Applications.

[107]  Real-Time Terrain Modeling Using CPU-GPU Coupled Computation , 2011, SIBGRAPI.

[108]  Oliver Deussen,et al.  Interactive Modeling of Plants , 1999, IEEE Computer Graphics and Applications.

[109]  Luc Van Gool,et al.  Procedural modeling of buildings , 2006, ACM Trans. Graph..

[110]  Rafael Bidarra,et al.  Integrating semantics and procedural generation: key enabling factors for declarative modeling of virtual worlds , 2010 .

[111]  Willem F. Bronsvoort,et al.  Procedural Natural Systems for Game Level Design , 2010, 2010 Brazilian Symposium on Games and Digital Entertainment.

[112]  Matthew de Villiers A Sketching Interface for Procedural City Generation , 2006 .

[113]  K. Raiyan Kamal,et al.  Parametrically controlled terrain generation , 2007, GRAPHITE '07.

[114]  Uri Wilensky,et al.  Procedural City Modeling , 2003 .

[115]  Daniel G. Aliaga,et al.  Ieee Transactions on Visualization and Computer Graphics 1 Style Grammars for Interactive Visualization of Architecture , 2022 .

[116]  Radomír Mech,et al.  Metropolis procedural modeling , 2011, TOGS.

[117]  Steven Longay,et al.  TreeSketch: interactive procedural modeling of trees on a tablet , 2012, SBIM '12.

[118]  Bedrich Benes,et al.  Authoring Hierarchical Road Networks , 2011, Comput. Graph. Forum.

[119]  F. Kenton Musgrave,et al.  The synthesis and rendering of eroded fractal terrains , 1989, SIGGRAPH.

[120]  Georges Voronoi Nouvelles applications des paramètres continus à la théorie des formes quadratiques. Premier mémoire. Sur quelques propriétés des formes quadratiques positives parfaites. , 1908 .

[121]  Ares Lagae,et al.  State of the Art in Procedural Noise Functions , 2010, Eurographics.

[122]  Radomír Mech,et al.  Visual models of plants interacting with their environment , 1996, SIGGRAPH.

[123]  H. Honda Description of the form of trees by the parameters of the tree-like body: effects of the branching angle and the branch length on the sample of the tree-like body. , 1971, Journal of theoretical biology.

[124]  Dieter Finkenzeller Detailed Building Facades , 2008, IEEE Computer Graphics and Applications.

[125]  Fan Bao,et al.  Procedural Facade Variations from a Single Layout , 2012 .