A Sketch-Based Gesture Interface for Rough 3D Stick Figure Animation

This paper introduces a novel gesture interface for sketching out rough 3D stick figure animation. This interface can allow users to draw stick figures with the system automatic assistance in figure proportion control. Given a 2D hand-drawn stick figure under a parallel view, there is a challenge to reconstruct a unique 3D pose from a set of candidates. Our system utilizes figure perspective rendering, and introduces the concept of ‘thickness contrast’ as a sketch gesture combined with some other constraints/assumptions for pose recovery. The resulting pose can be further corrected, based on physical constraints of human body. Once obtaining a series of 3D stick figure poses, user can easily sketch out motion paths and timing, and add their preferable sound/background. The resulting 3D animation can be automatically synthesized in VRML. This system has been tested on a variety of input devices: electric whiteboard, tablet PC, as well as a standard mouse.

[1]  Hsi-Jian Lee,et al.  Determination of 3D human body postures from a single view , 1985, Comput. Vis. Graph. Image Process..

[2]  David Salesin,et al.  A sketching interface for articulated figure animation , 2006, SIGGRAPH 2006.

[3]  Satoshi Matsuoka,et al.  Teddy: A Sketching Interface for 3D Freeform Design , 1999, SIGGRAPH Courses.

[4]  Jae-jin Choi,et al.  Maya Character Animation , 2002 .

[5]  John F. Hughes,et al.  SKETCH: An Interface for Sketching 3D Scenes , 1996, SIGGRAPH.

[6]  Junichi Hoshino,et al.  Intelligent storyboard for prototyping animation , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[7]  Stefan Schlechtweg,et al.  Non-photorealistic computer graphics: modeling, rendering, and animation , 2002 .

[8]  Fabio Remondino,et al.  3D Reconstruction of Human Skeleton from Single Images or Monocular Video Sequences , 2003, DAGM-Symposium.

[9]  Jae-Jin Choi Maya Character Animation, 2nd Edition , 2004 .

[10]  Daniel Thalmann,et al.  Computer Animation and Simulation ’97 , 1997, Eurographics.

[11]  David K. Wright,et al.  From on-line sketching to 2D and 3D geometry: a system based on fuzzy knowledge , 2000, Comput. Aided Des..

[12]  Lee Markosian,et al.  Skin: a constructive approach to modeling free-form shapes , 1999, SIGGRAPH.

[13]  David Edward DiFranco,et al.  Recovery of 3D articulated motion from 2D correspondences , 2000 .

[14]  Aaron Hertzmann,et al.  Style-based inverse kinematics , 2004, ACM Trans. Graph..

[15]  Michiel van de Panne,et al.  Motion doodles: an interface for sketching character motion , 2004, SIGGRAPH 2004.

[16]  Michiel van de Panne,et al.  Motion doodles: an interface for sketching character motion , 2004, SIGGRAPH Courses.

[17]  Ivan E. Sutherland,et al.  Sketchpad a Man-Machine Graphical Communication System , 1899, Outstanding Dissertations in the Computer Sciences.

[18]  Ronie Hecker,et al.  Controlling 3D objects by sketching 2D views , 1992, Other Conferences.

[19]  James A. Landay,et al.  Interactive sketching for the early stages of user interface design , 1995, CHI '95.

[20]  Sílvio César Lizana Terra,et al.  Performance timing for keyframe animation , 2004, SCA '04.

[21]  Barrett Fox 3ds max 6 Animation: CG Filmmaking from Concept to Completion (Consumer) , 2003 .

[22]  Alvin R. Tilley,et al.  The Measure of Man and Woman: Human Factors in Design , 2001 .

[23]  Aaron Hertzmann,et al.  Style-based inverse kinematics , 2004, SIGGRAPH 2004.

[24]  Ellen Yi-Luen Do,et al.  Ambiguous intentions: a paper-like interface for creative design , 1996, UIST '96.

[25]  Thomas P. Moran,et al.  Pen-based interaction techniques for organizing material on an electronic whiteboard , 1997, UIST '97.

[26]  Camillo J. Taylor,et al.  Reconstruction of Articulated Objects from Point Correspondences in a Single Uncalibrated Image , 2000, Comput. Vis. Image Underst..

[27]  Hsi-Jian Lee,et al.  Knowledge-guided visual perception of 3-D human gait from a single image sequence , 1992, IEEE Trans. Syst. Man Cybern..