A physically-based motion retargeting filter

This article presents a novel constraint-based motion editing technique. On the basis of animator-specified kinematic and dynamic constraints, the method converts a given captured or animated motion to a physically plausible motion. In contrast to previous methods using spacetime optimization, we cast the motion editing problem as a constrained state estimation problem, based on the per-frame Kalman filter framework. The method works as a filter that sequentially scans the input motion to produce a stream of output motion frames at a stable interactive rate. Animators can tune several filter parameters to adjust to different motions, turn the constraints on or off based on their contributions to the final result, or provide a rough sketch (kinematic hint) as an effective way of producing the desired motion. Experiments on various systems show that the technique processes the motions of a human with 54 degrees of freedom, at about 150 fps when only kinematic constraints are applied, and at about 10 fps when both kinematic and dynamic constraints are applied. Experiments on various types of motion show that the proposed method produces remarkably realistic animations.

[1]  Michael Gleicher,et al.  Motion editing with spacetime constraints , 1997, SI3D.

[2]  Taku Komura,et al.  Calculation and visualization of the dynamic ability of the human body , 1999 .

[3]  Michael Gleicher,et al.  Comparing Constraint-Based Motion Editing Methods , 2001, Graph. Model..

[4]  Miomir Vukobratović,et al.  Biped Locomotion: Dynamics, Stability, Control and Application , 1990 .

[5]  Petros Faloutsos,et al.  Composable controllers for physics-based character animation , 2001, SIGGRAPH.

[6]  Hirochika Inoue,et al.  Real-time humanoid motion generation through ZMP manipulation based on inverted pendulum control , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[7]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[8]  Zicheng Liu,et al.  Hierarchical spacetime control , 1994, SIGGRAPH.

[9]  Michael F. Cohen,et al.  Efficient generation of motion transitions using spacetime constraints , 1996, SIGGRAPH.

[10]  Hendrik Van Brussel,et al.  A Smoothly Constrained Kalman Filter , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[12]  Hyun Joon Shin,et al.  Physical touch-up of human motions , 2003, 11th Pacific Conference onComputer Graphics and Applications, 2003. Proceedings..

[13]  Rudolph van der Merwe,et al.  The unscented Kalman filter for nonlinear estimation , 2000, Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373).

[14]  C. Karen Liu,et al.  Synthesis of complex dynamic character motion from simple animations , 2002, ACM Trans. Graph..

[15]  S. Haykin.  Kalman Filtering and Neural Networks , 2001 .

[16]  Hyeong-Seok Ko,et al.  Motion Balance Filtering , 2000, Comput. Graph. Forum.

[17]  Masaki Oshita,et al.  A Dynamic Motion Control Technique for Human‐like Articulated Figures , 2001, Comput. Graph. Forum.

[18]  John J. Craig,et al.  Introduction to Robotics Mechanics and Control , 1986 .

[19]  Kwang-Jin Choi,et al.  Online motion retargetting , 2000, Comput. Animat. Virtual Worlds.

[20]  Kwang-Jin Choi,et al.  On-line motion retargetting , 1999, Proceedings. Seventh Pacific Conference on Computer Graphics and Applications (Cat. No.PR00293).

[21]  M. Vukobratovic,et al.  Biped Locomotion , 1990 .

[22]  Hyeong-Seok Ko,et al.  Spacetime sweeping: an interactive dynamic constraints solver , 2002, Proceedings of Computer Animation 2002 (CA 2002).

[23]  Norman I. Badler,et al.  Strength guided motion , 1990, SIGGRAPH.

[24]  Zoran Popovic,et al.  Physically based motion transformation , 1999, SIGGRAPH.

[25]  Nancy S. Pollard,et al.  Force-based motion editing for locomotion tasks , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[26]  Katsu Yamane,et al.  Dynamics Filter - concept and implementation of online motion Generator for human figures , 2000, IEEE Trans. Robotics Autom..

[27]  Greg Welch,et al.  Welch & Bishop , An Introduction to the Kalman Filter 2 1 The Discrete Kalman Filter In 1960 , 1994 .

[28]  Norman I. Badler,et al.  Animating human locomotion with inverse dynamics , 1996, IEEE Computer Graphics and Applications.

[29]  D. Simon,et al.  Kalman filtering with state equality constraints , 2002 .

[30]  Nancy S. Pollard,et al.  Efficient synthesis of physically valid human motion , 2003, ACM Trans. Graph..

[31]  Sung Yong Shin,et al.  Computer puppetry: An importance-based approach , 2001, TOGS.

[32]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[33]  Michiel van de Panne,et al.  Parameterized gait synthesis , 1996, IEEE Computer Graphics and Applications.

[34]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[35]  Jessica K. Hodgins,et al.  Motion capture-driven simulations that hit and react , 2002, SCA '02.

[36]  Andrew P. Witkin,et al.  Spacetime constraints , 1988, SIGGRAPH.

[37]  Yoshihiko Nakamura,et al.  Making feasible walking motion of humanoid robots from human motion capture data , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[38]  Rudolph van der Merwe,et al.  The square-root unscented Kalman filter for state and parameter-estimation , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[39]  Phillip J. McKerrow,et al.  Introduction to robotics , 1991 .

[40]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.

[41]  Jessica K. Hodgins,et al.  Adapting simulated behaviors for new characters , 1997, SIGGRAPH.

[42]  Michael F. Cohen,et al.  Interactive spacetime control for animation , 1992, SIGGRAPH.