Geometry Reconstruction of Plants

Synthetic modelling and reconstruction of the geometry of real plants have been a center of attention of research for decades. Due to the complex architecture and growth pattern of plants, accurate modelling of the plant geometry is an extremely challenging task. Although realistic modelling of plants are widely studied in the context of computer graphics research, it also has profound impact on the biological study of plants. In order to perform various types of simulation studies under different environmental conditions and in understanding the physiology of plants in more details, synthetic models can be an extremely useful tool. Synthetic modelling approaches can be broadly categorized into three types. The first type is the rule based procedural modeling approach, which does not account the real data into consideration. The second type of approach (also known as data driven modelling) performs modelling based on the real data obtained from 3D acquisition procedures. The third type of approach is interactive, which is based on user assistance. In this chapter, we focus on the modelling of the second category and revisit the recent state-of-the-art techniques performing reconstruction of plant geometry from real data. The algorithms can be classified into different interlinked categories, which constitute the general pipeline of geometry reconstruction in data driven modelling framework. In the context of biological relevance of different types of techniques, we discuss about the strengths and limitations of the approaches and the need of prior botanical knowledge to reconstruct the plant geometry in biologically feasible manner. Finally, we explore the quantitative assessment techniques which can be used to measure the quality of the reconstruction result with respect to the actual data.

[1]  Daniel Cohen-Or,et al.  Morfit: interactive surface reconstruction from incomplete point clouds with curve-driven topology and geometry control , 2014, ACM Trans. Graph..

[2]  Long Quan,et al.  Data-Driven Synthetic Modeling of Trees , 2014, IEEE Transactions on Visualization and Computer Graphics.

[3]  Chakkrit Preuksakarn,et al.  Reconstructing plant architecture from 3D laser scanner data. (Acquisition et validation de modèles architecturaux virtuels de plantes) , 2012 .

[4]  Dong-Ming Yan,et al.  Realistic Procedural Plant Modeling from Multiple View Images , 2020, IEEE Transactions on Visualization and Computer Graphics.

[5]  Przemyslaw Prusinkiewicz,et al.  Design and Implementation of the L+C Modeling Language , 2003, RULE@RDP.

[6]  Daniel Cohen-Or,et al.  Analyzing growing plants from 4D point cloud data , 2013, ACM Trans. Graph..

[7]  Valerio Pascucci,et al.  Robust on-line computation of Reeb graphs: simplicity and speed , 2007, ACM Trans. Graph..

[8]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[9]  Minglun Gong,et al.  Full 3D Plant Reconstruction via Intrusive Acquisition , 2016, Comput. Graph. Forum.

[10]  Christophe Godin,et al.  A Method for Describing Plant Architecture which Integrates Topology and Geometry , 1999 .

[11]  Malia A. Gehan,et al.  Lights, camera, action: high-throughput plant phenotyping is ready for a close-up. , 2015, Current opinion in plant biology.

[12]  Alexander Bucksch,et al.  SkelTre - Fast Skeletonisation for Imperfect Point Cloud Data of Botanic Trees , 2009, 3DOR@Eurographics.

[13]  Adam Runions,et al.  Modeling Trees with a Space Colonization Algorithm , 2007, NPH.

[14]  Christophe Godin,et al.  Functional-structural plant modelling. , 2005, The New phytologist.

[15]  Hui Huang,et al.  Tree Modeling with Real Tree-Parts Examples , 2016, IEEE Transactions on Visualization and Computer Graphics.

[16]  Jianwei Guo,et al.  Tree Growth Modelling Constrained by Growth Equations , 2018, Comput. Graph. Forum.

[17]  Radomír Mech,et al.  Self-organizing tree models for image synthesis , 2009, ACM Trans. Graph..

[18]  Dong-Ming Yan,et al.  Efficient and robust reconstruction of botanical branching structure from laser scanned points , 2009, 2009 11th IEEE International Conference on Computer-Aided Design and Computer Graphics.

[19]  Przemyslaw Prusinkiewicz,et al.  L-Py: An L-System Simulation Framework for Modeling Plant Architecture Development Based on a Dynamic Language , 2012, Front. Plant Sci..

[20]  Andrea Tagliasacchi,et al.  3D Skeletons: A State‐of‐the‐Art Report , 2016, Comput. Graph. Forum.

[21]  Daniel Cohen-Or,et al.  Curve skeleton extraction from incomplete point cloud , 2009, ACM Trans. Graph..

[22]  Julie Dorsey,et al.  Reconstructing 3D Tree Models from Instrumented Photographs , 2001, IEEE Computer Graphics and Applications.

[23]  Hui Xu,et al.  Knowledge and heuristic-based modeling of laser-scanned trees , 2007, TOGS.

[24]  Minglun Gong,et al.  4D Reconstruction of Blooming Flowers , 2017, Comput. Graph. Forum.

[25]  Xinyu Guo,et al.  An Accurate Skeleton Extraction Approach From 3D Point Clouds of Maize Plants , 2019, Front. Plant Sci..

[26]  Rajnikant V. Patel,et al.  Machine Vision System for 3D Plant Phenotyping , 2017, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[27]  Daniel Cohen-Or,et al.  L1-medial skeleton of point cloud , 2013, ACM Trans. Graph..

[28]  Deborah Silver,et al.  Curve-Skeleton Properties, Applications, and Algorithms , 2007, IEEE Trans. Vis. Comput. Graph..

[29]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[30]  Matt Olson,et al.  Automatic reconstruction of tree skeletal structures from point clouds , 2010, ACM Trans. Graph..

[31]  Daniel Cohen-Or,et al.  Flower reconstruction from a single photo , 2014, Comput. Graph. Forum.

[32]  William A. Barrett,et al.  Intelligent scissors for image composition , 1995, SIGGRAPH.

[33]  George Drettakis,et al.  Volumetric reconstruction and interactive rendering of trees from photographs , 2004, ACM Trans. Graph..

[34]  Przemyslaw Prusinkiewicz,et al.  The Algorithmic Beauty of Plants , 1990, The Virtual Laboratory.

[35]  Oliver Deussen,et al.  Approximate image-based tree-modeling using particle flows , 2007, ACM Trans. Graph..

[36]  Christophe Godin,et al.  A distance measure between plant architectures , 2000 .

[37]  Junjie Cao,et al.  Point Cloud Skeletons via Laplacian Based Contraction , 2010, 2010 Shape Modeling International Conference.

[38]  Brendan Lane,et al.  The use of positional information in the modeling of plants , 2001, SIGGRAPH.

[39]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[40]  Tong-Yee Lee,et al.  Skeleton extraction by mesh contraction , 2008, SIGGRAPH 2008.

[41]  Bedrich Benes,et al.  Inverse Procedural Modeling of Trees , 2014 .

[42]  Christophe Godin,et al.  Quantitative assessment of automatic reconstructions of branching systems obtained from laser scanning. , 2013, Annals of botany.