Editable Parametric Dense Foliage from 3D Capture

We present an algorithm to compute parametric models of dense foliage. The guiding principles of our work are automatic reconstruction and compact artist friendly representation. We use Bezier patches to model leaf surface, which we compute from images and point clouds of dense foliage. We present an algorithm to segment individual leaves from colour and depth data. We then reconstruct the Bezier representation from segmented leaf points clouds using non-linear optimisation. Unlike previous work, we do not require laboratory scanned exemplars or user intervention. We also demonstrate intuitive manipulators to edit the reconstructed parametric models. We believe our work is a step towards making captured data more accessible to artists for foliage modelling.

[1]  P. Prusinkiewicz,et al.  Modeling and visualization of leaf venation patterns , 2005, SIGGRAPH 2005.

[2]  Eric Galin,et al.  Generating vast varieties of realistic leaves with parametric 2Gmap L-systems , 2008, The Visual Computer.

[3]  Andrew Owens,et al.  Modeling dense inflorescences , 2016, ACM Trans. Graph..

[4]  Przemyslaw Prusinkiewicz,et al.  The Algorithmic Beauty of Plants , 1990, The Virtual Laboratory.

[5]  Hua Huang,et al.  RepSnapping: Efficient Image Cutout for Repeated Scene Elements , 2011, Comput. Graph. Forum.

[6]  Takeo Igarashi,et al.  Interactive Design of Botanical Trees using Freehand Sketches and Example‐based Editing , 2005, Comput. Graph. Forum.

[7]  Piyush Kumar,et al.  Minimum-Volume Enclosing Ellipsoids and Core Sets , 2005 .

[8]  Matthias Nießner,et al.  SemanticPaint , 2015, ACM Trans. Graph..

[9]  Jian Sun,et al.  Lazy snapping , 2004, SIGGRAPH 2004.

[10]  Chunjiang Zhao,et al.  A framework for plant leaf modeling and shading , 2013, Math. Comput. Model..

[11]  Sylvain Lefebvre,et al.  Ieee Transactions on Visualization and Computer Graphics Relighting Photographs of Tree Canopies , 2022 .

[12]  Oliver Deussen,et al.  Capturing and animating the morphogenesis of polygonal tree models , 2012, ACM Trans. Graph..

[13]  Long Quan,et al.  Image-based tree modeling , 2007, SIGGRAPH 2007.

[14]  Daryl M. Kempthorne,et al.  A Comparison of Techniques for the Reconstruction of Leaf Surfaces from Scanned Data , 2014, SIAM J. Sci. Comput..

[15]  W. John Kress,et al.  Leafsnap: A Computer Vision System for Automatic Plant Species Identification , 2012, ECCV.

[16]  Li Li,et al.  Geometric modeling of broad-leaf plants leaf based on BB-spline , 2013, Math. Comput. Model..

[17]  Leonid Khachiyan,et al.  Rounding of Polytopes in the Real Number Model of Computation , 1996, Math. Oper. Res..

[18]  Shi-Min Hu,et al.  RepFinder: finding approximately repeated scene elements for image editing , 2010, ACM Trans. Graph..

[19]  Chang-Hun Kim,et al.  Simulation of Morphology Changes in Drying Leaves , 2013, Comput. Graph. Forum.

[20]  Mario Costa Sousa,et al.  Modeling plant structures using concept sketches , 2006, NPAR.

[21]  Bedrich Benes,et al.  Interactive Modeling of Virtual Ecosystems , 2009, NPH.

[22]  Minglun Gong,et al.  Full 3D Plant Reconstruction via Intrusive Acquisition , 2016, Comput. Graph. Forum.

[23]  Jinmo Kim,et al.  Procedural modeling and visualization of multiple leaves , 2016, Multimedia Systems.

[24]  J. Hanan,et al.  Application of Surface Fitting Techniques for the Representation of Leaf Surfaces , 2005 .

[25]  Nelson L. Max,et al.  Structured Light-Based 3D Reconstruction System for Plants , 2015, Sensors.

[26]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Paul A. Beardsley,et al.  Image-based reconstruction and synthesis of dense foliage , 2013, ACM Trans. Graph..

[28]  Xuejin Chen,et al.  Sketch-based tree modeling using Markov random field , 2008, SIGGRAPH 2008.

[29]  Radomír Mech,et al.  Metropolis procedural modeling , 2011, TOGS.

[30]  Przemyslaw Prusinkiewicz,et al.  Modeling lobed leaves , 2003, Proceedings Computer Graphics International 2003.

[31]  George Drettakis,et al.  Depth synthesis and local warps for plausible image-based navigation , 2013, TOGS.

[32]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Radomír Mech,et al.  Inverse Procedural Modelling of Trees , 2014, Comput. Graph. Forum.

[34]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Oliver Deussen,et al.  Interactive Modeling of Plants , 1999, IEEE Computer Graphics and Applications.

[36]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Daniel Cohen-Or,et al.  Texture-lobes for tree modelling , 2011, SIGGRAPH 2011.

[38]  Long Quan,et al.  Image-based plant modeling , 2006, SIGGRAPH 2006.

[39]  Minglun Gong,et al.  4D Reconstruction of Blooming Flowers , 2017, Comput. Graph. Forum.

[40]  Radomír Mech,et al.  Plastic trees , 2012, ACM Trans. Graph..

[41]  Takeo Igarashi,et al.  Floral diagrams and inflorescences: interactive flower modeling using botanical structural constraints , 2005, SIGGRAPH 2005.

[42]  Hao Zhang,et al.  Automatic reconstruction of tree skeletal structures from point clouds , 2010, SIGGRAPH 2010.

[43]  George Drettakis,et al.  Volumetric reconstruction and interactive rendering of trees from photographs , 2004, SIGGRAPH 2004.

[44]  Gladimir V. G. Baranoski,et al.  Interactive venation‐based leaf shape modeling , 2005, Comput. Animat. Virtual Worlds.

[45]  Oliver Deussen,et al.  Digital Design of Nature - Computer Generated Plants and Organics , 2010, X.media.publishing.

[46]  A. Lindenmayer.  Mathematical models for cellular interactions in development. I. Filaments with one-sided inputs. , 1968, Journal of theoretical biology.

[47]  Hui Xu,et al.  Knowledge and heuristic-based modeling of laser-scanned trees , 2007, TOGS.

[48]  Mark James,et al.  Synthetic topiary , 1994, SIGGRAPH.

[49]  David Filliat,et al.  Color and Depth-Based Superpixels for Background and Object Segmentation , 2012 .

[50]  Daniel Cohen-Or,et al.  Flower reconstruction from a single photo , 2014, Comput. Graph. Forum.

[51]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[52]  H. Sinoquet,et al.  A double-digitising method for building 3D virtual trees with non-planar leaves: application to the morphology and light-capture properties of young beech trees (Fagus sylvatica). , 2008, Functional plant biology : FPB.

[53]  Takeo Igarashi,et al.  Flower modeling via X-ray computed tomography , 2014, ACM Trans. Graph..

[54]  Philip J. Willis,et al.  Modeling and generating moving trees from video , 2011, SA '11.

[55]  Aristid Lindenmayer,et al.  Mathematical Models for Cellular Interactions in Development , 1968 .