4D Reconstruction of Blooming Flowers

Flower blooming is a beautiful phenomenon in nature as flowers open in an intricate and complex manner whereas petals bend, stretch and twist under various deformations. Flower petals are typically thin structures arranged in tight configurations with heavy self‐occlusions. Thus, capturing and reconstructing spatially and temporally coherent sequences of blooming flowers is highly challenging. Early in the process only exterior petals are visible and thus interior parts will be completely missing in the captured data. Utilizing commercially available 3D scanners, we capture the visible parts of blooming flowers into a sequence of 3D point clouds. We reconstruct the flower geometry and deformation over time using a template‐based dynamic tracking algorithm. To track and model interior petals hidden in early stages of the blooming process, we employ an adaptively constrained optimization. Flower characteristics are exploited to track petals both forward and backward in time. Our methods allow us to faithfully reconstruct the flower blooming process of different species. In addition, we provide comparisons with state‐of‐the‐art physical simulation‐based approaches and evaluate our approach by using photos of captured real flowers.

[1]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Daniel Cohen-Or,et al.  Flower reconstruction from a single photo , 2014, Comput. Graph. Forum.

[4]  G. Malandain,et al.  Imaging plant growth in 4D: robust tissue reconstruction and lineaging at cell resolution , 2010, Nature Methods.

[5]  Oliver Deussen,et al.  Digital Design of Nature - Computer Generated Plants and Organics , 2010, X.media.publishing.

[6]  Olga Sorkine-Hornung,et al.  Fast automatic skinning transformations , 2012, ACM Trans. Graph..

[7]  Bin Wang,et al.  Deformation capture and modeling of soft objects , 2015, ACM Trans. Graph..

[8]  Daniel Cohen-Or,et al.  Consolidation of unorganized point clouds for surface reconstruction , 2009, ACM Trans. Graph..

[9]  Marc Alexa,et al.  As-rigid-as-possible surface modeling , 2007, Symposium on Geometry Processing.

[10]  Minglun Gong,et al.  Full 3D Plant Reconstruction via Intrusive Acquisition , 2016, Comput. Graph. Forum.

[11]  Antonis A. Argyros,et al.  Scalable 3D Tracking of Multiple Interacting Objects , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  P. Prusinkiewicz,et al.  Computational models of plant development and form. , 2012, The New phytologist.

[13]  Dieter Fox,et al.  DART: Dense Articulated Real-Time Tracking , 2014, Robotics: Science and Systems.

[14]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[15]  Derek Bradley,et al.  Recent Advances in Facial Appearance Capture , 2015, Comput. Graph. Forum.

[16]  Bo Wu,et al.  Skeleton-guided 3D shape distance field metamorphosis , 2016, Graph. Model..

[17]  Daniel Cohen-Or,et al.  L1-medial skeleton of point cloud , 2013, ACM Trans. Graph..

[18]  Oliver Deussen,et al.  Interactive Modeling of Plants , 1999, IEEE Computer Graphics and Applications.

[19]  Bo Fu,et al.  Data-Driven Flower Petal Modeling with Botany Priors , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  J. Bangham,et al.  Quantitative Control of Organ Shape by Combinatorial Gene Activity , 2010, PLoS biology.

[21]  Radomír Mech,et al.  Plastic trees , 2012, ACM Trans. Graph..

[22]  C. Karen Liu,et al.  Leveraging depth cameras and wearable pressure sensors for full-body kinematics and dynamics capture , 2014, ACM Trans. Graph..

[23]  Przemyslaw Prusinkiewicz,et al.  Animation of plant development , 1993, SIGGRAPH.

[24]  P. Prusinkiewicz,et al.  The genetics of geometry. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Daniel Cohen-Or,et al.  Analyzing growing plants from 4D point cloud data , 2013, ACM Trans. Graph..

[26]  J. Bangham,et al.  Growth dynamics underlying petal shape and asymmetry , 2003, Nature.

[27]  Przemyslaw Prusinkiewicz,et al.  The Algorithmic Beauty of Plants , 1990, The Virtual Laboratory.

[28]  Olga Sorkine-Hornung,et al.  Bounded biharmonic weights for real-time deformation , 2011, Commun. ACM.

[29]  Chang-Hun Kim,et al.  Simulation of Morphology Changes in Drying Leaves , 2013, Comput. Graph. Forum.

[30]  Chen Qian,et al.  Realtime and Robust Hand Tracking from Depth , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Daniel Cohen-Or,et al.  Edge-aware point set resampling , 2013, ACM Trans. Graph..

[32]  Oliver Deussen,et al.  Capturing and animating the morphogenesis of polygonal tree models , 2012, ACM Trans. Graph..

[33]  Pieter Abbeel,et al.  Tracking deformable objects with point clouds , 2013, 2013 IEEE International Conference on Robotics and Automation.

[34]  J. R. Kennaway,et al.  Genetic Control of Organ Shape and Tissue Polarity , 2010, PLoS biology.

[35]  L. Mahadevan,et al.  The shape of a long leaf , 2009, Proceedings of the National Academy of Sciences.

[36]  Daniel Cohen-Or,et al.  Morfit: interactive surface reconstruction from incomplete point clouds with curve-driven topology and geometry control , 2014, ACM Trans. Graph..

[37]  Takeo Igarashi,et al.  Flower modeling via X-ray computed tomography , 2014, ACM Trans. Graph..

[38]  Philip J. Willis,et al.  Modeling and generating moving trees from video , 2011, SA '11.

[39]  Haiyi Liang,et al.  Growth, geometry, and mechanics of a blooming lily , 2011, Proceedings of the National Academy of Sciences.

[40]  Min Liu,et al.  Boundary‐dominant flower blooming simulation , 2015, Comput. Animat. Virtual Worlds.

[41]  Takeo Igarashi,et al.  Surface-based growth simulation for opening flowers , 2008, Graphics Interface.

[42]  Takeo Igarashi,et al.  Floral diagrams and inflorescences: interactive flower modeling using botanical structural constraints , 2007, ACM Trans. Graph..

[43]  Hui Huang,et al.  Space‐Time Co‐Segmentation of Articulated Point Cloud Sequences , 2016, Comput. Graph. Forum.

[44]  Mark Pauly,et al.  Projective dynamics , 2014, ACM Trans. Graph..

[45]  Mark Pauly,et al.  Shape‐Up: Shaping Discrete Geometry with Projections , 2012, Comput. Graph. Forum.

[46]  Andrea Tagliasacchi,et al.  Robust Articulated-ICP for Real-Time Hand Tracking , 2015 .

[47]  Hao Li,et al.  Tracking surfaces with evolving topology , 2012, ACM Trans. Graph..

[48]  Xi Chen,et al.  Modeling and simulation of curled dry leaves , 2011 .

[49]  Stefan Gumhold,et al.  Feature Extraction From Point Clouds , 2001, IMR.

[50]  Hui Huang,et al.  Tree Modeling with Real Tree-Parts Examples , 2016, IEEE Transactions on Visualization and Computer Graphics.