Image-based plant modeling

In this paper, we propose a semi-automatic technique for modeling plants directly from images. Our image-based approach has the distinct advantage that the resulting model inherits the realistic shape and complexity of a real plant. We designed our modeling system to be interactive, automating the process of shape recovery while relying on the user to provide simple hints on segmentation. Segmentation is performed in both image and 3D spaces, allowing the user to easily visualize its effect immediately. Using the segmented image and 3D data, the geometry of each leaf is then automatically recovered from the multiple views by fitting a deformable leaf model. Our system also allows the user to easily reconstruct branches in a similar manner. We show realistic reconstructions of a variety of plants, and demonstrate examples of plant editing.

[1]  Marc Jaeger,et al.  Plant models faithful to botanical structure and development , 1988, SIGGRAPH.

[2]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Mark James,et al.  Synthetic topiary , 1994, SIGGRAPH.

[4]  Jason Weber,et al.  Creation and rendering of realistic trees , 1995, SIGGRAPH.

[5]  Radomír Mech,et al.  Visual models of plants interacting with their environment , 1996, SIGGRAPH.

[6]  Tatsumi Sakaguchi,et al.  Botanical tree structure modeling based on real image set , 1998, SIGGRAPH '98.

[7]  Jun Ohya,et al.  Modeling and animation of botanical trees for interactive virtual environments , 1999, VRST '99.

[8]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Hansrudi Noser,et al.  Physics-Enhanced L-Systems , 2001, WSCG.

[10]  Julie Dorsey,et al.  Reconstructing 3D Tree Models from Instrumented Photographs , 2001, IEEE Computer Graphics and Applications.

[11]  Brendan Lane,et al.  The use of positional information in the modeling of plants , 2001, SIGGRAPH.

[12]  Olivier D. Faugeras,et al.  The geometry of multiple images - the laws that govern the formation of multiple images of a scene and some of their applications , 2001 .

[13]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Feng Han,et al.  Bayesian reconstruction of 3D shapes and scenes from a single image , 2003, First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003..

[15]  Philippe Bekaert,et al.  A Simple but Effective Algorithm to Model the Competition of Virtual Plants for Light and Space , 2003, WSCG.

[16]  Jian Sun,et al.  Lazy snapping , 2004, SIGGRAPH 2004.

[17]  George Drettakis,et al.  Volumetric reconstruction and interactive rendering of trees from photographs , 2004, SIGGRAPH 2004.

[18]  Long Quan,et al.  A quasi-dense approach to surface reconstruction from uncalibrated images , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Takeo Igarashi,et al.  Floral diagrams and inflorescences: interactive flower modeling using botanical structural constraints , 2005, SIGGRAPH 2005.

[20]  Baining Guo,et al.  Real-time rendering of plant leaves , 2005, SIGGRAPH 2005.