Interactive animation of virtual humans based on motion capture data

This paper presents a novel, parameteric framework for synthesizing new character motions from existing motion capture data. Our framework can conduct morphological adaptation as well as kinematic and physically‐based corrections. All these solvers are organized in layers in order to be easily combined together. Given locomotion as an example, the system automatically adapts the motion data to the size of the synthetic figure and to its environment; the character will correctly step over complex ground shapes and counteract with external forces applied to the body. Our framework is based on a frame‐based solver. This ensures animating hundreds of humanoids with different morphologies in real‐time. It is particularly suitable for interactive applications such as video games and virtual reality where a user interacts in an unpredictable way. Copyright © 2009 John Wiley & Sons, Ltd.

[1]  Daniel Thalmann,et al.  A global human walking model with real-time kinematic personification , 1990, The Visual Computer.

[2]  Richard Reviewer-Granger.  Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[3]  Katsu Yamane,et al.  Dynamics Filter - concept and implementation of online motion Generator for human figures , 2000, IEEE Trans. Robotics Autom..

[4]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[5]  Brendan McCane,et al.  Calculating the 2D motion of lumbar vertebrae using splines. , 2006, Journal of biomechanics.

[6]  Victor B. Zordan,et al.  Dynamic response for motion capture animation , 2005, SIGGRAPH 2005.

[7]  Norman I. Badler,et al.  Animating human locomotion with inverse dynamics , 1996, IEEE Computer Graphics and Applications.

[8]  David A. Forsyth,et al.  Pushing people around , 2005, SCA '05.

[9]  Jehee Lee,et al.  Simulating biped behaviors from human motion data , 2007, ACM Trans. Graph..

[10]  Andrew P. Witkin,et al.  Spacetime constraints , 1988, SIGGRAPH.

[11]  Bruno Arnaldi,et al.  Morphology‐independent representation of motions for interactive human‐like animation , 2005, Comput. Graph. Forum.

[12]  Jessica K. Hodgins,et al.  Constraint-based motion optimization using a statistical dynamic model , 2007, SIGGRAPH 2007.

[13]  Jovan Popovic,et al.  Adaptation of performed ballistic motion , 2005, TOGS.

[14]  Norman I. Badler,et al.  Real-Time Inverse Kinematics Techniques for Anthropomorphic Limbs , 2000, Graph. Model..

[15]  KangKang Yin,et al.  SIMBICON: simple biped locomotion control , 2007, ACM Trans. Graph..

[16]  Dimitris N. Metaxas,et al.  Automating gait generation , 2001, SIGGRAPH.

[17]  Daniel Thalmann,et al.  PCA-based walking engine using motion capture data , 2004, Proceedings Computer Graphics International, 2004..

[18]  Hyun Joon Shin,et al.  Physical touch-up of human motions , 2003, 11th Pacific Conference onComputer Graphics and Applications, 2003. Proceedings..

[19]  Hyeong-Seok Ko,et al.  A physically-based motion retargeting filter , 2005, TOGS.

[20]  C. Karen Liu,et al.  Momentum-based parameterization of dynamic character motion , 2004, SCA '04.

[21]  Stéphane Donikian,et al.  Crowd of Virtual Humans: a New Approach for Real Time Navigation in Complex and Structured Environments , 2004, Comput. Graph. Forum.

[22]  Sung Yong Shin,et al.  Computer puppetry: An importance-based approach , 2001, TOGS.

[23]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.

[24]  M. V. D. Panne,et al.  SIMBICON: simple biped locomotion control , 2007, SIGGRAPH 2007.

[25]  Thomas W. Calvert,et al.  Knowledge-Driven, Interactive Animation of Human Running , 1996, Graphics Interface.

[26]  Petros Faloutsos,et al.  Flipping with physics: motion editing for acrobatics , 2007, SCA '07.

[27]  R. Kulpa,et al.  Fast inverse kinematics and kinetics solver for human-like figures , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[28]  Franck Multon,et al.  MKM: A Global Framework for Animating Humans in Virtual Reality Applications , 2008, PRESENCE: Teleoperators and Virtual Environments.

[29]  Daniel Thalmann,et al.  A robust approach for the center of mass position control with inverse kinetics , 1996 .

[30]  Ronan Boulic,et al.  An inverse kinematics architecture enforcing an arbitrary number of strict priority levels , 2004, The Visual Computer.

[31]  C. Karen Liu,et al.  Synthesis of complex dynamic character motion from simple animations , 2002, ACM Trans. Graph..

[32]  Ronan Boulic,et al.  Interactive motion deformation with prioritized constraints , 2004, SCA '04.

[33]  Michael Gleicher,et al.  Motion editing with spacetime constraints , 1997, SI3D.

[34]  Jessica K. Hodgins,et al.  Constraint-based motion optimization using a statistical dynamic model , 2007, ACM Trans. Graph..

[35]  Daniel Thalmann,et al.  A robust approach for the control of the center of mass with inverse kinetics , 1996, Comput. Graph..

[36]  Taku Komura,et al.  Dynamic motion adaptation for 3D acrobatic humanoids , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[37]  Katsu Yamane,et al.  Natural Motion Animation through Constraining and Deconstraining at Will , 2003, IEEE Trans. Vis. Comput. Graph..