Learning Inverse Rig Mappings by Nonlinear Regression.

We present a framework to design inverse rig-functions - functions that map low level representations of a character's pose such as joint positions or surface geometry to the representation used by animators called the animation rig. Animators design scenes using an animation rig, a framework widely adopted in animation production which allows animators to design character poses and geometry via intuitive parameters and interfaces. Yet most state-of-the-art computer animation techniques control characters through raw, low level representations such as joint angles, joint positions, or vertex coordinates. This difference often stops the adoption of state-of-the-art techniques in animation production. Our framework solves this issue by learning a mapping between the low level representations of the pose and the animation rig. We use nonlinear regression techniques, learning from example animation sequences designed by the animators. When new motions are provided in the skeleton space, the learned mapping is used to estimate the rig controls that reproduce such a motion. We introduce two nonlinear functions for producing such a mapping: Gaussian process regression and feedforward neural networks. The appropriate solution depends on the nature of the rig and the amount of data available for training. We show our framework applied to various examples including articulated biped characters, quadruped characters, facial animation rigs, and deformable characters. With our system, animators have the freedom to apply any motion synthesis algorithm to arbitrary rigging and animation pipelines for immediate editing. This greatly improves the productivity of 3D animation, while retaining the flexibility and creativity of artistic input.

[1]  Taku Komura,et al.  Learning an inverse rig mapping for character animation , 2015, Symposium on Computer Animation.

[2]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[3]  John P. Lewis,et al.  Tuning facial animation in a mocap pipeline , 2014, SIGGRAPH Talks.

[4]  Markus H. Gross,et al.  Efficient simulation of secondary motion in rig-space , 2013, SCA '13.

[5]  Taku Komura,et al.  Relationship descriptors for interactive motion adaptation , 2013, SCA '13.

[6]  Markus H. Gross,et al.  Rig-space physics , 2012, ACM Trans. Graph..

[7]  Ken-ichi Anjyo,et al.  Direct Manipulation Blendshapes , 2010, IEEE Computer Graphics and Applications.

[8]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[9]  Markus H. Gross,et al.  Pose-space animation and transfer of facial details , 2008, SCA '08.

[10]  Christopher K. I. Williams,et al.  Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning) , 2005 .

[11]  Tomohiko Mukai,et al.  Geostatistical motion interpolation , 2005, ACM Trans. Graph..

[12]  Samuel R. Buss,et al.  Selectively Damped Least Squares for Inverse Kinematics , 2005, J. Graph. Tools.

[13]  Steven M. Seitz,et al.  Spacetime faces , 2004, ACM Trans. Graph..

[14]  Lucas Kovar,et al.  Automated extraction and parameterization of motions in large data sets , 2004, ACM Trans. Graph..

[15]  Aaron Hertzmann,et al.  Style-based inverse kinematics , 2004, ACM Trans. Graph..

[16]  Katsu Yamane,et al.  Natural Motion Animation through Constraining and Deconstraining at Will , 2003, IEEE Trans. Vis. Comput. Graph..

[17]  Peter-Pike J. Sloan,et al.  Artist‐Directed Inverse‐Kinematics Using Radial Basis Function Interpolation , 2001, Comput. Graph. Forum.

[18]  Peter-Pike J. Sloan,et al.  Shape by example , 2001, I3D '01.

[19]  Sung Yong Shin,et al.  A Coordinate-Invariant Approach to Multiresolution Motion Analysis , 2001, Graph. Model..

[20]  John P. Lewis,et al.  Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation , 2000, SIGGRAPH.

[21]  Kwang-Jin Choi,et al.  On-line motion retargetting , 1999, Proceedings. Seventh Pacific Conference on Computer Graphics and Applications (Cat. No.PR00293).

[22]  David Salesin,et al.  Synthesizing realistic facial expressions from photographs , 1998, SIGGRAPH.

[23]  Zoran Popovic,et al.  Motion warping , 1995, SIGGRAPH.

[24]  Stefano Chiaverini,et al.  Estimate of the two smallest singular values of the Jacobian Matrix: Application to damped least-squares inverse kinematics , 1993, J. Field Robotics.

[25]  Peter D. Lawrence,et al.  General inverse kinematics with the error damped pseudoinverse , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[26]  T. Yoshikawa,et al.  Task-Priority Based Redundancy Control of Robot Manipulators , 1987 .

[27]  Yoshihiko Nakamura,et al.  Inverse kinematic solutions with singularity robustness for robot manipulator control , 1986 .

[28]  Xiaohua Xian,et al.  A Powell Optimization Approach for Example-Based Skinning in a Production Animation Environment , 2006 .

[29]  N Mai Duy,et al.  APPROXIMATION OF FUNCTION AND ITS DERIVATIVES USING RADIAL BASIS FUNCTION NETWORKS , 2003 .

[30]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2022 .