Motion capture-driven simulations that hit and react

Controllable, reactive human motion is essential in many video games and training environments. Characters in these applications often perform tasks based on modified motion data, but response to unpredicted events is also important in order to maintain realism. We approach the problem of motion synthesis for interactive, humanlike characters by combining dynamic simulation and human motion capture data. Our control systems use trajectory tracking to follow motion capture data and a balance controller to keep the character upright while modifying sequences from a small motion library to accomplish specified tasks, such as throwing punches or swinging a racket. The system reacts to forces computed from a physical collision model by changing stiffness and damping terms. The freestanding, simulated humans respond automatically to impacts and smoothly return to tracking. We compare the resulting motion with video and recorded human data.

[1]  M. S. Turner,et al.  Anyone for tennis? , 1986, Nature.

[2]  Mitsuo Kawato,et al.  Feedback-Error-Learning Neural Network for Supervised Motor Learning , 1990 .

[3]  Michiel van de Panne,et al.  Guided Optimization for Balanced Locomotion , 1995 .

[4]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[5]  Zoran Popovic,et al.  Motion warping , 1995, SIGGRAPH.

[6]  Ken-ichi Anjyo,et al.  Fourier principles for emotion-based human figure animation , 1995, SIGGRAPH.

[7]  Lance Williams,et al.  Motion signal processing , 1995, SIGGRAPH.

[8]  Eugene Fiume,et al.  Limit cycle control and its application to the animation of balancing and walking , 1996, SIGGRAPH.

[9]  Norman I. Badler,et al.  User-controlled physics-based animation for articulated figures , 1996, Proceedings Computer Animation '96.

[10]  Michael F. Cohen,et al.  Efficient generation of motion transitions using spacetime constraints , 1996, SIGGRAPH.

[11]  James K. Hahn,et al.  Interpolation synthesis for articulated figure motion , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[12]  Jerry E. Pratt,et al.  Virtual model control of a bipedal walking robot , 1997, Proceedings of International Conference on Robotics and Automation.

[13]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[14]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[15]  Zoran Popovic,et al.  Physically based motion transformation , 1999, SIGGRAPH.

[16]  Jessica K. Hodgins,et al.  Tracking and Modifying Upper-body Human Motion Data with Dynamic Simulation , 1999, Computer Animation and Simulation.

[17]  Nancy S. Pollard,et al.  Simple Machines for Scaling Human Motion , 1999, Computer Animation and Simulation.

[18]  Daniel Thalmann,et al.  Anyone for Tennis? , 1999, Presence: Teleoperators & Virtual Environments.

[19]  Kwang-Jin Choi,et al.  Processing Motion Capture Data to Achieve Positional Accuracy , 1999, Graph. Model. Image Process..

[20]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.

[21]  Jessica K. Hodgins,et al.  Simulating leaping, tumbling, landing and balancing humans , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[22]  Petros Faloutsos,et al.  The virtual stuntman: dynamic characters with a repertoire of autonomous motor skills , 2001, Comput. Graph..

[23]  Masaki Oshita,et al.  A Dynamic Motion Control Technique for Human‐like Articulated Figures , 2001, Comput. Graph. Forum.

[24]  Petros Faloutsos,et al.  Composable controllers for physics-based character animation , 2001, SIGGRAPH.

[25]  M. Kawato,et al.  A hierarchical neural-network model for control and learning of voluntary movement , 2004, Biological Cybernetics.