Interactive animation of virtual humans based on motion capture data

This paper presents a novel, parameteric framework for synthesizing new character motions from existing motion capture data. Our framework can conduct morphological adaptation as well as kinematic and physically-based corrections. All these solvers are organized in layers in order to be easily combined together. Given locomotion as an example, the system automatically adapts the motion data to the size of the synthetic figure and to its environment; the character will correctly step over complex ground shapes and counteract with external forces applied to the body. Our framework is based on a frame-based solver. This ensures animating hundreds of humanoids with different morphologies in real-time. It is particularly suitable for interactive applications such as video games and virtual reality where a user interacts in an unpredictable way. Copyright © 2009 John Wiley & Sons, Ltd.

[1]  Daniel Thalmann,et al.  A global human walking model with real-time kinematic personification , 1990, The Visual Computer.

[2]  Petros Faloutsos,et al.  Flipping with physics: motion editing for acrobatics , 2007, SCA '07.

[3]  Ronan Boulic,et al.  An inverse kinematics architecture enforcing an arbitrary number of strict priority levels , 2004, The Visual Computer.

[4]  Jehee Lee,et al.  Simulating biped behaviors from human motion data , 2007, SIGGRAPH 2007.

[5]  C. Karen Liu,et al.  Synthesis of complex dynamic character motion from simple animations , 2002, ACM Trans. Graph..

[6]  Ronan Boulic,et al.  Interactive motion deformation with prioritized constraints , 2004, SCA '04.

[7]  Lucas Kovar,et al.  Footskate cleanup for motion capture editing , 2002, SCA '02.

[8]  Thomas W. Calvert,et al.  Knowledge-Driven, Interactive Animation of Human Running , 1996, Graphics Interface.

[9]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.

[10]  Michael Gleicher,et al.  Motion editing with spacetime constraints , 1997, SI3D.

[11]  M. V. D. Panne,et al.  SIMBICON: simple biped locomotion control , 2007, SIGGRAPH 2007.

[12]  Franck Multon,et al.  MKM: A Global Framework for Animating Humans in Virtual Reality Applications , 2008, PRESENCE: Teleoperators and Virtual Environments.

[13]  A. Newell.  Unified Theories of Cognition , 1990 .

[14]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[15]  Taku Komura,et al.  Dynamic motion adaptation for 3D acrobatic humanoids , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[16]  Jovan Popovic,et al.  Adaptation of performed ballistic motion , 2005, TOGS.

[17]  Katsu Yamane,et al.  Dynamics Filter - concept and implementation of online motion Generator for human figures , 2000, IEEE Trans. Robotics Autom..

[18]  Norman I. Badler,et al.  Animating human locomotion with inverse dynamics , 1996, IEEE Computer Graphics and Applications.

[19]  Jessica K. Hodgins,et al.  Constraint-based motion optimization using a statistical dynamic model , 2007, SIGGRAPH 2007.

[20]  Daniel Thalmann,et al.  PCA-based walking engine using motion capture data , 2004 .

[21]  Brendan McCane,et al.  Calculating the 2D motion of lumbar vertebrae using splines. , 2006, Journal of biomechanics.

[22]  Victor B. Zordan,et al.  Dynamic response for motion capture animation , 2005, SIGGRAPH 2005.

[23]  Andrew P. Witkin,et al.  Spacetime constraints , 1988, SIGGRAPH.

[24]  Daniel Thalmann,et al.  A robust approach for the center of mass position control with inverse kinetics , 1996 .

[25]  Bruno Arnaldi,et al.  Morphology‐independent representation of motions for interactive human‐like animation , 2005, Comput. Graph. Forum.

[26]  Norman I. Badler,et al.  Real-Time Inverse Kinematics Techniques for Anthropomorphic Limbs , 2000, Graph. Model..

[27]  Dimitris N. Metaxas,et al.  Automating gait generation , 2001, SIGGRAPH.

[28]  Daniel Thalmann,et al.  A robust approach for the control of the center of mass with inverse kinetics , 1996, Comput. Graph..

[29]  Hyun Joon Shin,et al.  Physical touch-up of human motions , 2003, 11th Pacific Conference onComputer Graphics and Applications, 2003. Proceedings..

[30]  Hyeong-Seok Ko,et al.  A physically-based motion retargeting filter , 2005, TOGS.

[31]  C. Karen Liu,et al.  Momentum-based parameterization of dynamic character motion , 2004, SCA '04.

[32]  Katsu Yamane,et al.  Natural Motion Animation through Constraining and Deconstraining at Will , 2003, IEEE Trans. Vis. Comput. Graph..

[33]  Stéphane Donikian,et al.  Crowd of Virtual Humans: a New Approach for Real Time Navigation in Complex and Structured Environments , 2004, Comput. Graph. Forum.

[34]  Sung Yong Shin,et al.  Computer puppetry: An importance-based approach , 2001, TOGS.

[35]  David A. Forsyth,et al.  Pushing people around , 2005, SCA '05.

[36]  R. Kulpa,et al.  Fast inverse kinematics and kinetics solver for human-like figures , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..