Life-Sketch - A Framework for Sketch-Based Modelling and Animation of 3D Objects

The design and animation of digital 3D models is an essential task for many applications in science, engineering, education, medicine and arts. In many instances only an approximate representation is required and a simple and intuitive modelling and animation process, suitable for untrained users, is more important than realism and extensive features. Sketch-based modelling has been shown to be a suitable interface because the underlying pen-and-paper metaphor is intuitive and effective. In this paper we present LifeSketch, a framework for sketched-based modelling and animation. Three-dimensional models are created with a variation of the popular "Teddy" algorithm. The models are analysed and skeletons with joints are extracted fully automatically. The surface mesh is bound to the curved skeletons using skinning techniques and the resulting model can be animated using skeletal animation methods. The results of our evaluation and user study suggest that modelling and animation tasks are considerable more efficient than with traditional tools. The learning curve is very flat and a half page document was sufficient to familiarise users with the tools functionality. Users were satisfied with the automatically extracted joints, but some users struggled selecting the appropriate rotation axes and angles for animating the resulting 3D objects. A more intuitive, preferable automatic or sketch-based approach for animations is needed. Overall users were satisfied with the modelling capabilities of the tool, found most of its functionality natural and intuitive, and they enjoyed using it.

[1]  Vincent Lepetit,et al.  Monocular Model-Based 3D Tracking of Rigid Objects: A Survey , 2005, Found. Trends Comput. Graph. Vis..

[2]  Xin Xie,et al.  Efficient contour line labelling for terrain modelling , 2010, ACSC.

[3]  Takeo Igarashi,et al.  As-rigid-as-possible shape manipulation , 2005, ACM Trans. Graph..

[4]  Takeo Igarashi,et al.  Floral diagrams and inflorescences: interactive flower modeling using botanical structural constraints , 2005, SIGGRAPH 2005.

[5]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[6]  Takeo Igarashi,et al.  Spatial keyframing for performance-driven animation , 2005, Symposium on Computer Animation.

[7]  Takeo Igarashi,et al.  A sketch-based interface for modeling myocardial fiber orientation that considers the layered structure of the ventricles. , 2008, The journal of physiological sciences : JPS.

[8]  James A. Landay,et al.  Sketching Interfaces: Toward More Human Interface Design , 2001, Computer.

[9]  Marc Alexa,et al.  Sketching contours , 2008, Comput. Graph..

[10]  Ilya Baran,et al.  Automatic rigging and animation of 3D characters , 2007, SIGGRAPH 2007.

[11]  Andrew S. Glassner,et al.  Proceedings of the 27th annual conference on Computer graphics and interactive techniques , 1994, SIGGRAPH 1994.

[12]  Ellen Yi-Luen Do,et al.  Ambiguous intentions: a paper-like interface for creative design , 1996, UIST '96.

[13]  Takeo Igarashi,et al.  Sketch and run: a stroke-based interface for home robots , 2009, CHI.

[14]  Beryl Plimmer,et al.  A Pen and Paper Metaphor for Orchid Modeling , 2008, GRAPP.

[15]  John Hart The Art of the Storyboard: Storyboarding for Film, TV, and Animation , 1999 .

[16]  Levent Burak Kara,et al.  Sketch-Based 3D-Shape Creation for Industrial Styling Design , 2007, IEEE Computer Graphics and Applications.

[17]  Xavier Granier,et al.  Improved skeleton extraction and surface generation for sketch-based modeling , 2007, GI '07.

[18]  David Salesin,et al.  A sketching interface for articulated figure animation , 2006, SIGGRAPH 2006.

[19]  Brian Wyvill,et al.  ShapeShop: sketch-based solid modeling with BlobTrees , 2007, SIGGRAPH '07.

[20]  Satoshi Matsuoka,et al.  Teddy: A Sketching Interface for 3D Freeform Design , 1999, SIGGRAPH Courses.

[21]  Brian Wyvill,et al.  A sketch-based method to control deformation in a skeletal implicit surface modeler , 2008, SBM'08.

[22]  Karl Sims,et al.  Evolving virtual creatures , 1994, SIGGRAPH.

[23]  Xuejin Chen,et al.  Sketch-based tree modeling using Markov random field , 2008, SIGGRAPH 2008.

[24]  Takeo Igarashi,et al.  Smooth meshes for sketch-based freeform modeling , 2003, I3D '03.

[25]  Vincent Cheutet,et al.  3D sketching for aesthetic design using fully free-form deformation features , 2005, Comput. Graph..

[26]  Brian Wyvill,et al.  ShapeShop: sketch-based solid modeling with BlobTrees , 2006, SIGGRAPH Courses.

[27]  Marc Alexa,et al.  FiberMesh: designing freeform surfaces with 3D curves , 2007, SIGGRAPH 2007.

[28]  Hong Qin,et al.  Free-form deformations via sketching and manipulating scalar fields , 2003, SM '03.

[29]  John F. Hughes,et al.  A Sketch-Based Interface for Clothing Virtual Characters , 2007, IEEE Computer Graphics and Applications.

[30]  Brian Wyvill,et al.  MIBlob: a tool for medical visualization and modelling using sketches , 2004, SIGGRAPH '04.

[31]  Christophe Schlick,et al.  Thor: Sketch-Based 3D Modeling by Skeletons , 2008, Smart Graphics.

[32]  Takeo Igarashi,et al.  The Sketch L-System: Global Control of Tree Modeling Using Free-Form Strokes , 2006, Smart Graphics.

[33]  Chen Mao,et al.  Sketch-Based Virtual Human Modelling and Animation , 2007, Smart Graphics.

[34]  Patricia Riddle,et al.  Evolving controllers for virtual creature locomotion , 2003, GRAPHITE '03.

[35]  Takeo Igarashi,et al.  Smooth meshes for sketch-based freeform modeling , 2007, SIGGRAPH '07.

[36]  Hiromasa Suzuki,et al.  3D Sketch: Sketch-based Model Reconstruction and Rendering , 2000, Workshop on Geometric Modeling.

[37]  Yin Yin Wong Rough and ready prototypes: lessons from graphic design , 1992, CHI '92.

[38]  Mario Costa Sousa,et al.  Sketch-based modeling: A survey , 2009, Comput. Graph..

[39]  J. Hughes,et al.  SmoothSketch: 3D free-form shapes from complex sketches , 2006, ACM Trans. Graph..

[40]  Wolfgang Straßer,et al.  Terrain sketching , 2009, I3D '09.

[41]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[42]  Gershon Elber,et al.  Inferring 3D models from freehand sketches and constraints , 1997, Comput. Aided Des..

[43]  Cindy Grimm Implicit Generalized Cylinders using Profile Curves , 2003 .

[44]  Takeo Igarashi,et al.  A procedural method for modeling the purkinje fibers of the heart. , 2008, The journal of physiological sciences : JPS.

[45]  Ramesh Raskar,et al.  Free‐form sketching with variational implicit surfaces , 2002, Comput. Graph. Forum.

[46]  John P. Lewis,et al.  Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation , 2000, SIGGRAPH.

[47]  Chen Mao,et al.  Sketching-out virtual humans: from 2D storyboarding to immediate 3D character animation , 2006, Advances in Computer Entertainment Technology.