Three-dimensional proxies for hand-drawn characters

Drawing shapes by hand and manipulating computer-generated objects are the two dominant forms of animation. Though each medium has its own advantages, the techniques developed for one medium are not easily leveraged in the other medium because hand animation is two-dimensional, and inferring the third dimension is mathematically ambiguous. A second challenge is that the character is a consistent three-dimensional (3D) object in computer animation while hand animators introduce geometric inconsistencies in the two-dimensional (2D) shapes to better convey a character's emotional state and personality. In this work, we identify 3D proxies to connect hand-drawn animation and 3D computer animation. We present an integrated approach to generate three levels of 3D proxies: single-points, polygonal shapes, and a full joint hierarchy. We demonstrate how this approach enables one medium to take advantage of techniques developed for the other; for example, 3D physical simulation is used to create clothes for a hand-animated character, and a traditionally trained animator is able to influence the performance of a 3D character while drawing with paper and pencil.

[1]  Camillo J. Taylor,et al.  Reconstruction of Articulated Objects from Point Correspondences in a Single Uncalibrated Image , 2000, Comput. Vis. Image Underst..

[2]  Doug Cooper.  2D/3D hybrid character animation on "Spirit" , 2002, SIGGRAPH '02.

[3]  David A. Forsyth,et al.  Generalizing motion edits with Gaussian processes , 2009, ACM Trans. Graph..

[4]  John Dingliana,et al.  Adding Depth to Cartoons Using Sparse Depth (In)equalities , 2010, Comput. Graph. Forum.

[5]  Paul Rademacher,et al.  View-dependent geometry , 1999, SIGGRAPH.

[6]  Ahmed M. Elgammal,et al.  Inferring 3D body pose from silhouettes using activity manifold learning , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[7]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[8]  John Lasseter.  Tricks to animating characters with a computer , 2001, COMG.

[9]  A. Elgammal,et al.  Inferring 3D body pose from silhouettes using activity manifold learning , 2004, CVPR 2004.

[10]  Eric Daniels,et al.  Deep canvas in Disney's Tarzan , 1999, SIGGRAPH '99.

[11]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[12]  Yaser Sheikh,et al.  Leveraging the talent of hand animators to create three-dimensional animation , 2009, SCA '09.

[13]  Trevor Darrell,et al.  Constraining human body tracking , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[14]  Andrew Zisserman,et al.  Tracking People by Learning Their Appearance , 2007 .

[15]  Jos Stam,et al.  Nucleus: Towards a unified dynamics solver for computer graphics , 2009, 2009 11th IEEE International Conference on Computer-Aided Design and Computer Graphics.

[16]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[17]  F. Thomas,et al.  The illusion of life : Disney animation , 1981 .

[18]  Hans-Peter Seidel,et al.  Scaled Motion Dynamics for Markerless Motion Capture , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Ankur Agarwal,et al.  Recovering 3D human pose from monocular images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Yaser Sheikh,et al.  Augmenting hand animation with three-dimensional secondary motion , 2010, SCA '10.

[21]  Shamus Culhane.  Animation: From Script to Screen , 1989 .

[22]  Jitendra Malik,et al.  Tracking people with twists and exponential maps , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[23]  Hsi-Jian Lee,et al.  Determination of 3D human body postures from a single view , 1985, Comput. Vis. Graph. Image Process..

[24]  David J. Fleet,et al.  Temporal motion models for monocular and multiview 3D human body tracking , 2006, Comput. Vis. Image Underst..

[25]  David Salesin,et al.  A sketching interface for articulated figure animation , 2006, SIGGRAPH 2006.

[26]  Jitendra Malik,et al.  Poselets: Body part detectors trained using 3D human pose annotations , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[27]  Peter Probst.  Mixed media , 2009 .

[28]  Aaron Hertzmann,et al.  Style-based inverse kinematics , 2004, SIGGRAPH 2004.

[29]  Michael J. Black,et al.  Implicit Probabilistic Models of Human Motion for Synthesis and Tracking , 2002, ECCV.

[30]  Adam Finkelstein,et al.  Texture mapping for cel animation , 1998, SIGGRAPH.

[31]  Alec R. Rivers,et al.  2 . 5 D Cartoon Models , 2010 .

[32]  Hans-Peter Seidel,et al.  Staying Well Grounded in Markerless Motion Capture , 2008, DAGM-Symposium.

[33]  Jovan Popović,et al.  Semantic deformation transfer , 2009, SIGGRAPH 2009.

[34]  Gang Hua,et al.  Tracking articulated body by dynamic Markov network , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[35]  Harry Shum,et al.  Stylizing motion with drawings , 2003, SCA '03.

[36]  Pascal Fua,et al.  Hierarchical Implicit Surface Joint Limits to Constrain Video-Based Motion Capture , 2004, ECCV.

[37]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[38]  Scott F. Johnston.  Lumo: illumination for cel animation , 2002, NPAR '02.

[39]  Hans-Peter Seidel,et al.  Online Smoothing for Markerless Motion Capture , 2007, DAGM-Symposium.

[40]  David A. Forsyth,et al.  Tracking People by Learning Their Appearance , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  David Salesin,et al.  Multiperspective panoramas for cel animation , 1997, SIGGRAPH.

[42]  Frédo Durand,et al.  2.5D cartoon models , 2010, SIGGRAPH 2010.

[43]  Alla Safonova,et al.  Achieving good connectivity in motion graphs , 2008, SCA '08.

[44]  Adam Finkelstein,et al.  Shadows for cel animation , 2000, SIGGRAPH.

[45]  Cristian Sminchisescu,et al.  Discriminative density propagation for 3D human motion estimation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[46]  David A. Forsyth,et al.  Computational Studies of Human Motion: Part 1, Tracking and Motion Synthesis , 2005, Found. Trends Comput. Graph. Vis..

[47]  Xiaolin K. Wei,et al.  VideoMocap: modeling physically realistic human motion from monocular video sequences , 2010, ACM Trans. Graph..

[48]  Jessica K. Hodgins,et al.  Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces , 2004, ACM Trans. Graph..

[49]  David J. Fleet,et al.  Stochastic Tracking of 3D Human Figures Using 2D Image Motion , 2000, ECCV.

[50]  Leif Kobbelt,et al.  Character animation from 2D pictures and 3D motion data , 2007, TOGS.

[51]  Cristian Sminchisescu,et al.  Estimating Articulated Human Motion with Covariance Scaled Sampling , 2003, Int. J. Robotics Res..

[52]  Jinxiang Chai,et al.  VideoMocap: modeling physically realistic human motion from monocular video sequences , 2010, SIGGRAPH 2010.

[53]  Jessica K. Hodgins,et al.  Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces , 2004, SIGGRAPH 2004.

[54]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..