MKM: A Global Framework for Animating Humans in Virtual Reality Applications

Virtual humans are more and more used in VR applications, but their animation is still a challenge, especially if complex tasks must be carried out in interaction with the user. In many applications with virtual humans, credible virtual characters play a major role in presence. Motion editing techniques assume that the natural laws are intrinsically encoded in prerecorded trajectories and that modifications may preserve these natural laws, leading to credible autonomous actors. However, a complete knowledge of all the constraints is required to ensure continuity or to synchronize and blend several actions necessary to achieve a given task. We propose a framework capable of performing these tasks in an interactive environment that can change at each frame, depending on the users orders. This framework enables VR applications to animate from dozens of characters in real time for complex constraints, to hundreds of characters if only ground adaptation is performed. It offers the following capabilities: motion synchronization, blending, retargeting, and adaptation thanks to enhanced inverse kinetics and kinematics solver. To evaluate this framework, we have compared the motor behavior of subjects in real and in virtual environments.

[1]  Bruno Arnaldi,et al.  Morphology‐independent representation of motions for interactive human‐like animation , 2005, Comput. Graph. Forum.

[2]  Jessica K. Hodgins,et al.  Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces , 2004, SIGGRAPH 2004.

[3]  Bruno Arnaldi,et al.  Motion blending for real-time animation while accounting for the environment , 2004, Proceedings Computer Graphics International, 2004..

[4]  Bruno Arnaldi,et al.  Synchronization for dynamic blending of motions , 2004, SCA '04.

[5]  Norman I. Badler,et al.  Real-Time Inverse Kinematics Techniques for Anthropomorphic Limbs , 2000, Graph. Model..

[6]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[7]  Jehee Lee,et al.  Precomputing avatar behavior from human motion data , 2004, SCA '04.

[8]  Ronan Boulic,et al.  An inverse kinematics architecture enforcing an arbitrary number of strict priority levels , 2004, The Visual Computer.

[9]  Ronan Boulic,et al.  Interactive motion deformation with prioritized constraints , 2004, SCA '04.

[10]  Tomohiko Mukai,et al.  Geostatistical motion interpolation , 2005, SIGGRAPH '05.

[11]  Kwang-Jin Choi,et al.  Online motion retargetting , 2000, Comput. Animat. Virtual Worlds.

[12]  Lucas Kovar,et al.  Motion Graphs , 2002, ACM Trans. Graph..

[13]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.

[14]  Kwang-Jin Choi,et al.  Online motion retargetting , 2000, Comput. Animat. Virtual Worlds.

[15]  Shang Guo,et al.  A high-level control mechanism for human locomotion based on parametric frame space interpolation , 1996 .

[16]  Eugene Fiume,et al.  An efficient search algorithm for motion data using weighted PCA , 2005, SCA '05.

[17]  Sung Yong Shin,et al.  Computer puppetry: An importance-based approach , 2001, TOGS.

[18]  Franck Multon,et al.  Using Virtual Reality to Analyze Sports Performance , 2010, IEEE Computer Graphics and Applications.

[19]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[20]  Taku Komura,et al.  Interactive animation of virtual humans based on motion capture data , 2009 .

[21]  Aaron Hertzmann,et al.  Style-based inverse kinematics , 2004, ACM Trans. Graph..

[22]  Daniel Thalmann,et al.  Integration of motion control techniques for virtual human and avatar real-time animation , 1997, VRST '97.

[23]  Thomas W. Calvert,et al.  Knowledge-Driven, Interactive Animation of Human Running , 1996, Graphics Interface.

[24]  Bruno Arnaldi,et al.  Real Handball Goalkeeper vs. Virtual Handball Thrower , 2003, Presence: Teleoperators & Virtual Environments.

[25]  Michael Gleicher,et al.  Constraint-based motion adaptation , 1998, Comput. Animat. Virtual Worlds.

[26]  Daniel Thalmann,et al.  PCA-based walking engine using motion capture data , 2004 .

[27]  Kari Pulli,et al.  Style translation for human motion , 2005, SIGGRAPH 2005.

[28]  Chih-Cheng Chen,et al.  A combined optimization method for solving the inverse kinematics problems of mechanical manipulators , 1991, IEEE Trans. Robotics Autom..

[29]  Franck Multon,et al.  Using virtual reality to analyze links between handball thrower kinematics and goalkeeper's reactions , 2004, Neuroscience Letters.

[30]  Daniel Thalmann,et al.  A global human walking model with real-time kinematic personification , 1990, The Visual Computer.

[31]  Lucas Kovar,et al.  Flexible automatic motion blending with registration curves , 2003, SCA '03.

[32]  Zoran Popovic,et al.  Motion warping , 1995, SIGGRAPH.