Full 3D Plant Reconstruction via Intrusive Acquisition

Digitally capturing vegetation using off‐the‐shelf scanners is a challenging problem. Plants typically exhibit large self‐occlusions and thin structures which cannot be properly scanned. Furthermore, plants are essentially dynamic, deforming over the time, which yield additional difficulties in the scanning process. In this paper, we present a novel technique for acquiring and modelling of plants and foliage. At the core of our method is an intrusive acquisition approach, which disassembles the plant into disjoint parts that can be accurately scanned and reconstructed offline. We use the reconstructed part meshes as 3D proxies for the reconstruction of the complete plant and devise a global‐to‐local non‐rigid registration technique that preserves specific plant characteristics. Our method is tested on plants of various styles, appearances and characteristics. Results show successful reconstructions with high accuracy with respect to the acquired data.

[1]  Tamal K. Dey,et al.  Provable surface reconstruction from noisy samples , 2004, SCG '04.

[2]  Alexander Bucksch,et al.  CAMPINO : A skeletonization method for point cloud processing , 2008 .

[3]  Olga Sorkine-Hornung,et al.  Bounded biharmonic weights for real-time deformation , 2011, Commun. ACM.

[4]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[5]  Takeo Igarashi,et al.  Interactive design of botanical trees using freehand sketches and example-based editing , 2004, SIGGRAPH Courses.

[6]  Philip Lewis,et al.  Fast Automatic Precision Tree Models from Terrestrial Laser Scanner Data , 2013, Remote. Sens..

[7]  Alexander Bucksch,et al.  SkelTre - Fast Skeletonisation for Imperfect Point Cloud Data of Botanic Trees , 2009, 3DOR@Eurographics.

[8]  Julie Dorsey,et al.  Reconstructing 3D Tree Models from Instrumented Photographs , 2001, IEEE Computer Graphics and Applications.

[9]  Daniel Cohen-Or,et al.  Texture-lobes for tree modelling , 2011, ACM Trans. Graph..

[10]  Helmut Pottmann,et al.  Fitting B-spline curves to point clouds by curvature-based squared distance minimization , 2006, TOGS.

[11]  Matt Olson,et al.  Automatic reconstruction of tree skeletal structures from point clouds , 2010, ACM Trans. Graph..

[12]  Daniel Cohen-Or,et al.  Flower reconstruction from a single photo , 2014, Comput. Graph. Forum.

[13]  Paul A. Beardsley,et al.  Image-based reconstruction and synthesis of dense foliage , 2013, ACM Trans. Graph..

[14]  Paolo Cignoni,et al.  Marching intersections: an efficient resampling algorithm for surface management , 2001, Proceedings International Conference on Shape Modeling and Applications.

[15]  Michael M. Kazhdan,et al.  Screened poisson surface reconstruction , 2013, TOGS.

[16]  Daniel Cohen-Or,et al.  Consolidation of unorganized point clouds for surface reconstruction , 2009, ACM Trans. Graph..

[17]  Christophe Godin,et al.  Structure from silhouettes: a new paradigm for fast sketch‐based design of trees , 2009, Comput. Graph. Forum.

[18]  Takeo Igarashi,et al.  Seamless Integration of Initial Sketching and Subsequent Detail Editing in Flower Modeling , 2006, Comput. Graph. Forum.

[19]  Richard A. Fournier,et al.  The structural and radiative consistency of three-dimensional tree reconstructions from terrestrial lidar , 2009 .

[20]  Long Quan,et al.  Image-based tree modeling , 2007, ACM Trans. Graph..

[21]  Radomír Mech,et al.  Self-organizing tree models for image synthesis , 2009, ACM Trans. Graph..

[22]  George Drettakis,et al.  Volumetric reconstruction and interactive rendering of trees from photographs , 2004, ACM Trans. Graph..

[23]  Takeo Igarashi,et al.  Flower modeling via X-ray computed tomography , 2014, ACM Trans. Graph..

[24]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[25]  Daniel Cohen-Or,et al.  L1-medial skeleton of point cloud , 2013, ACM Trans. Graph..

[26]  Takeo Igarashi,et al.  Surface-based growth simulation for opening flowers , 2008, Graphics Interface.

[27]  Oliver Deussen,et al.  Approximate image-based tree-modeling using particle flows , 2007, ACM Trans. Graph..

[28]  Jernej Barbic,et al.  Real-Time subspace integration for St. Venant-Kirchhoff deformable models , 2005, ACM Trans. Graph..

[29]  Daniel Cohen-Or,et al.  Analyzing growing plants from 4D point cloud data , 2013, ACM Trans. Graph..

[30]  Long Quan,et al.  Image-based plant modeling , 2006, ACM Trans. Graph..

[31]  Mark James,et al.  Synthetic topiary , 1994, SIGGRAPH.

[32]  B. Neubert,et al.  Approximate image-based tree-modeling using particle flows , 2007, SIGGRAPH 2007.

[33]  Hui Huang,et al.  Proactive 3D scanning of inaccessible parts , 2014, ACM Trans. Graph..

[34]  Gabriel Taubin,et al.  The ball-pivoting algorithm for surface reconstruction , 1999, IEEE Transactions on Visualization and Computer Graphics.

[35]  Xuejin Chen,et al.  Sketch-based tree modeling using Markov random field , 2008, ACM Trans. Graph..

[36]  Steven Longay,et al.  TreeSketch: interactive procedural modeling of trees on a tablet , 2012, SBIM '12.

[37]  Radomír Mech,et al.  Plastic trees , 2012, ACM Trans. Graph..

[38]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[39]  Przemyslaw Prusinkiewicz,et al.  The Algorithmic Beauty of Plants-The Virtual Laboratory , 1990 .

[40]  Takeo Igarashi,et al.  Floral diagrams and inflorescences: interactive flower modeling using botanical structural constraints , 2007, ACM Trans. Graph..

[41]  Hui Xu,et al.  Knowledge and heuristic-based modeling of laser-scanned trees , 2007, TOGS.

[42]  Daniel Cohen-Or,et al.  Morfit: interactive surface reconstruction from incomplete point clouds with curve-driven topology and geometry control , 2014, ACM Trans. Graph..

[43]  Tamal K. Dey,et al.  Provable surface reconstruction from noisy samples , 2006, Comput. Geom..