Generalizing motion edits with Gaussian processes

One way that artists create compelling character animations is by manipulating details of a character's motion. This process is expensive and repetitive. We show that we can make such motion editing more efficient by generalizing the edits an animator makes on short sequences of motion to other sequences. Our method predicts frames for the motion using Gaussian process models of kinematics and dynamics. These estimates are combined with probabilistic inference. Our method can be used to propagate edits from examples to an entire sequence for an existing character, and it can also be used to map a motion from a control character to a very different target character. The technique shows good generalization. For example, we show that an estimator, learned from a few seconds of edited example animation using our methods, generalizes well enough to edit minutes of character animation in a high-quality fashion. Learning is interactive: An animator who wants to improve the output can provide small, correcting examples and the system will produce improved estimates of motion. We make this interactive learning process efficient and natural with a fast, full-body IK system with novel features. Finally, we present data from interviews with professional character animators that indicate that generalizing and propagating animator edits can save artists significant time and work.

[1]  Anthony A. Maciejewski,et al.  Computational modeling for the computer animation of legged figures , 1985, SIGGRAPH.

[2]  Zoran Popovic,et al.  Motion warping , 1995, SIGGRAPH.

[3]  Lance Williams,et al.  Motion signal processing , 1995, SIGGRAPH.

[4]  Kenji Amaya,et al.  Emotion from Motion , 1996, Graphics Interface.

[5]  J. Hahn,et al.  Interpolation Synthesis of Articulated Figure Motion , 1997, IEEE Computer Graphics and Applications.

[6]  Michael Gleicher,et al.  Motion editing with spacetime constraints , 1997, SI3D.

[7]  Bobby Bodenheimer,et al.  The Process of Motion Capture: Dealing with the Data , 1997, Computer Animation and Simulation.

[8]  James K. Hahn,et al.  Interpolation synthesis for articulated figure motion , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[9]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[10]  F. Sebastian Grassia,et al.  Practical Parameterization of Rotations Using the Exponential Map , 1998, J. Graphics, GPU, & Game Tools.

[11]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[12]  Zoran Popovic,et al.  Physically based motion transformation , 1999, SIGGRAPH.

[13]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.

[14]  Lennart Ljung,et al.  System identification (2nd ed.): theory for the user , 1999 .

[15]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[16]  Sung Yong Shin,et al.  Computer puppetry: An importance-based approach , 2001, TOGS.

[17]  Harry Shum,et al.  Motion texture: a two-level statistical model for character motion synthesis , 2002, ACM Trans. Graph..

[18]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[19]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[20]  Lucas Kovar,et al.  Footskate cleanup for motion capture editing , 2002, SCA '02.

[21]  Christoph Bregler,et al.  Turning to the masters: motion capturing cartoons , 2002, ACM Trans. Graph..

[22]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[23]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH '08.

[24]  C. Karen Liu,et al.  Synthesis of complex dynamic character motion from simple animations , 2002, ACM Trans. Graph..

[25]  Mira Dontcheva,et al.  Layered acting for character animation , 2003, ACM Trans. Graph..

[26]  David A. Forsyth,et al.  Motion synthesis from annotations , 2003, ACM Trans. Graph..

[27]  Hyun Joon Shin,et al.  Physical touch-up of human motions , 2003, 11th Pacific Conference onComputer Graphics and Applications, 2003. Proceedings..

[28]  Jovan Popovic,et al.  Example-based control of human motion , 2004, SCA '04.

[29]  Aaron Hertzmann,et al.  Style-based inverse kinematics , 2004, SIGGRAPH 2004.

[30]  Aaron Hertzmann,et al.  Style-based inverse kinematics , 2004, ACM Trans. Graph..

[31]  Lucas Kovar,et al.  Automated extraction and parameterization of motions in large data sets , 2004, ACM Trans. Graph..

[32]  Neil D. Lawrence,et al.  Learning to learn with the informative vector machine , 2004, ICML.

[33]  James F. O'Brien,et al.  Interpolating and approximating implicit surfaces from polygon soup , 2004, SIGGRAPH Courses.

[34]  Michael Gleicher,et al.  Automated extraction and parameterization of motions in large data sets , 2004, SIGGRAPH 2004.

[35]  Jovan Popović,et al.  Style translation for human motion , 2005, ACM Trans. Graph..

[36]  C. K. Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, SIGGRAPH 2005.

[37]  Jessica K. Hodgins,et al.  Performance animation from low-dimensional control signals , 2005, SIGGRAPH 2005.

[38]  C. Karen Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, ACM Trans. Graph..

[39]  Tomohiko Mukai,et al.  Geostatistical motion interpolation , 2005, ACM Trans. Graph..

[40]  David J. Fleet,et al.  Gaussian Process Dynamical Models , 2005, NIPS.

[41]  Takeo Igarashi,et al.  Spatial keyframing for performance-driven animation , 2006, SCA '05.

[42]  Hyeong-Seok Ko,et al.  A physically-based motion retargeting filter , 2005, TOGS.

[43]  David J. Fleet,et al.  Temporal motion models for monocular and multiview 3D human body tracking , 2006, Comput. Vis. Image Underst..

[44]  David A. Forsyth,et al.  Knowing when to put your foot down , 2006, I3D '06.

[45]  David J. Fleet,et al.  Multifactor Gaussian process models for style-content separation , 2007, ICML '07.

[46]  J. Hodgins,et al.  Construction and optimal search of interpolated motion graphs , 2007, SIGGRAPH 2007.

[47]  Neil D. Lawrence,et al.  Hierarchical Gaussian process latent variable models , 2007, ICML '07.

[48]  Jessica K. Hodgins,et al.  Constraint-based motion optimization using a statistical dynamic model , 2007, ACM Trans. Graph..

[49]  Jessica K. Hodgins,et al.  Construction and optimal search of interpolated motion graphs , 2007, ACM Trans. Graph..

[50]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH Classes.

[51]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.