Sketch-based tree modeling using Markov random field

In this paper, we describe a new system for converting a user's freehand sketch of a tree into a full 3D model that is both complex and realistic-looking. Our system does this by probabilistic optimization based on parameters obtained from a database of tree models. The best matching model is selected by comparing its 2D projections with the sketch. Branch interaction is modeled by a Markov random field, subject to the constraint of 3D projection to sketch. Our system then uses the notion of self-similarity to add new branches before finally populating all branches with leaves of the user's choice. We show a variety of natural-looking tree models generated from freehand sketches with only a few strokes.

[1]  Oliver Deussen,et al.  Interactive Modeling of Plants , 1999, IEEE Computer Graphics and Applications.

[2]  Radomír Mech,et al.  Visual models of plants interacting with their environment , 1996, SIGGRAPH.

[3]  Julie Dorsey,et al.  Reconstructing 3D Tree Models from Instrumented Photographs , 2001, IEEE Computer Graphics and Applications.

[4]  Marc Jaeger,et al.  Plant models faithful to botanical structure and development , 1988, SIGGRAPH.

[5]  Yehezkel Lamdan,et al.  Object recognition by affine invariant matching , 2011, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[7]  Long Quan,et al.  Image-based tree modeling , 2007, ACM Trans. Graph..

[8]  Takeo Igarashi,et al.  Interactive design of botanical trees using freehand sketches and example-based editing , 2004, SIGGRAPH Courses.

[9]  Przemyslaw Prusinkiewicz,et al.  L-systems: from the Theory to Visual Models of Plants , 2001 .

[10]  George Drettakis,et al.  Volumetric reconstruction and interactive rendering of trees from photographs , 2004, ACM Trans. Graph..

[11]  Przemyslaw Prusinkiewicz,et al.  Integrating biomechanics into developmental plant models expressed using L-systems 1 , 2000 .

[12]  Oliver Deussen,et al.  Approximate image-based tree-modeling using particle flows , 2007, ACM Trans. Graph..

[13]  Takeo Igarashi,et al.  The Sketch L-System: Global Control of Tree Modeling Using Free-Form Strokes , 2006, Smart Graphics.

[14]  Brendan Lane,et al.  The use of positional information in the modeling of plants , 2001, SIGGRAPH.

[15]  Peter Oppenheimer,et al.  Real time design and animation of fractal plants and trees , 1986, SIGGRAPH.

[16]  M. Holton,et al.  Strands, Gravity and Botanical Tree Imagery , 1994, Comput. Graph. Forum.

[17]  Jason Weber,et al.  Creation and rendering of realistic trees , 1995, SIGGRAPH.