Augmenting hand animation with three-dimensional secondary motion

Secondary motion, or the motion of objects in response to that of the primary character, is widely used to amplify the audience's response to the character's motion and to provide a connection to the environment. These three-dimensional (3D) effects are largely passive and tend to be time consuming to animate by hand, yet most are very effectively simulated in current animation software. In this paper, we present a technique for augmenting hand-drawn animation of human characters with 3D physical effects to create secondary motion. In particular, we create animations in which hand-drawn characters interact with cloth and clothing, dynamically simulated balls and particles, and a simple fluid simulation. The driving points or volumes for the secondary motion are tracked in two dimensions, reconstructed into three dimensions, and used to drive and collide with the simulated objects. Our technique employs user interaction that can be reasonably integrated into the traditional animation pipeline of drawing, cleanup, inbetweening, and coloring.

[1]  Eric Daniels,et al.  Deep canvas in Disney's Tarzan , 1999, SIGGRAPH '99.

[2]  Hsi-Jian Lee,et al.  Determination of 3D human body postures from a single view , 1985, Comput. Vis. Graph. Image Process..

[3]  David Salesin,et al.  A sketching interface for articulated figure animation , 2006, SIGGRAPH 2006.

[4]  David J. Fleet,et al.  Temporal motion models for monocular and multiview 3D human body tracking , 2006, Comput. Vis. Image Underst..

[5]  K HodginsJessica,et al.  Interactive control of avatars animated with human motion data , 2002 .

[6]  Cristian Sminchisescu,et al.  Discriminative density propagation for 3D human motion estimation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Hans-Peter Seidel,et al.  Scaled Motion Dynamics for Markerless Motion Capture , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  David A. Forsyth,et al.  Computational Studies of Human Motion: Part 1, Tracking and Motion Synthesis , 2005, Found. Trends Comput. Graph. Vis..

[9]  A. Elgammal,et al.  Inferring 3D body pose from silhouettes using activity manifold learning , 2004, CVPR 2004.

[10]  Trevor Darrell,et al.  Constraining human body tracking , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[11]  Pascal Fua,et al.  Hierarchical Implicit Surface Joint Limits to Constrain Video-Based Motion Capture , 2004, ECCV.

[12]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[13]  Scott F. Johnston.  Lumo: illumination for cel animation , 2002, NPAR '02.

[14]  Christoph Bregler,et al.  Turning to the masters: motion capturing cartoons , 2002, ACM Trans. Graph..

[15]  Hans-Peter Seidel,et al.  Online Smoothing for Markerless Motion Capture , 2007, DAGM-Symposium.

[16]  BreglerChristoph,et al.  Turning to the masters , 2002 .

[17]  Jitendra Malik,et al.  Tracking people with twists and exponential maps , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[18]  David A. Forsyth,et al.  Tracking People by Learning Their Appearance , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Camillo J. Taylor,et al.  Reconstruction of Articulated Objects from Point Correspondences in a Single Uncalibrated Image , 2000, Comput. Vis. Image Underst..

[20]  Jos Stam,et al.  Nucleus: Towards a unified dynamics solver for computer graphics , 2009, 2009 11th IEEE International Conference on Computer-Aided Design and Computer Graphics.

[21]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[22]  F. Thomas,et al.  The illusion of life : Disney animation , 1981 .

[23]  Adam Finkelstein,et al.  Shadows for cel animation , 2000, SIGGRAPH.

[24]  Jinxiang Chai,et al.  Modeling 3D human poses from uncalibrated monocular images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[25]  Michael J. Black,et al.  Implicit Probabilistic Models of Human Motion for Synthesis and Tracking , 2002, ECCV.

[26]  David Salesin,et al.  Multiperspective panoramas for cel animation , 1997, SIGGRAPH.

[27]  AgarwalAnkur,et al.  Recovering 3D Human Pose from Monocular Images , 2006 .

[28]  Jessica K. Hodgins,et al.  Combining Active and Passive Simulations for Secondary Motion , 2000, IEEE Computer Graphics and Applications.

[29]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[30]  Yaser Sheikh,et al.  Leveraging the talent of hand animators to create three-dimensional animation , 2009, SCA '09.

[31]  Ankur Agarwal,et al.  Recovering 3D human pose from monocular images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Harry Shum,et al.  Stylizing motion with drawings , 2003, SCA '03.

[33]  James F. O'Brien,et al.  Computational Studies of Human Motion , 2006 .

[34]  Shamus Culhane.  Animation: From Script to Screen , 1989 .

[35]  David A. Forsyth,et al.  Generalizing motion edits with Gaussian processes , 2009, ACM Trans. Graph..

[36]  John Dingliana,et al.  Adding Depth to Cartoons Using Sparse Depth (In)equalities , 2010, Comput. Graph. Forum.

[37]  Jovan Popović,et al.  Semantic deformation transfer , 2009, SIGGRAPH 2009.

[38]  Jitendra Malik,et al.  Poselets: Body part detectors trained using 3D human pose annotations , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[39]  Adam Finkelstein,et al.  Texture mapping for cel animation , 1998, SIGGRAPH.

[40]  Doug Cooper.  2D/3D hybrid character animation on "Spirit" , 2002, SIGGRAPH '02.

[41]  Peter Probst.  Mixed media , 2009 .

[42]  Hans-Peter Seidel,et al.  Staying Well Grounded in Markerless Motion Capture , 2008, DAGM-Symposium.

[43]  Gang Hua,et al.  Tracking articulated body by dynamic Markov network , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[44]  RamananDeva,et al.  Computational studies of human motion , 2005 .

[45]  Alla Safonova,et al.  Achieving good connectivity in motion graphs , 2008, SCA '08.

[46]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[47]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[48]  Ken-ichi Anjyo,et al.  Bridging the gap between 2D and 3D: a stream of digital animation techniques , 2001, Proceedings Ninth Pacific Conference on Computer Graphics and Applications. Pacific Graphics 2001.

[49]  David J. Fleet,et al.  Stochastic Tracking of 3D Human Figures Using 2D Image Motion , 2000, ECCV.

[50]  Leif Kobbelt,et al.  Character animation from 2D pictures and 3D motion data , 2007, TOGS.

[51]  Cristian Sminchisescu,et al.  Estimating Articulated Human Motion with Covariance Scaled Sampling , 2003, Int. J. Robotics Res..