Responsive Action Generation by Physically-Based Motion Retrieval and Adaptation

Responsive motion generation of avatars who have physical interactions with their environment is a key issue in VR and video games. We present a performance-driven avatar control interface with physically-based motion retrieval. When the interaction between the user-controlled avatar and its environment is going to happen, the avatar has to select the motion clip that satisfies both kinematic and dynamic constraints. A two-steps process is proposed. Firstly, it selects a set of candidate motions according to the performance of the user. Secondly, these candidate motions are further ranked according to their capability to satisfy dynamic constraints such as balance and comfort. The motion associated with the highest score is finally adapted in order to accurately satisfy the kinematic constraints imposed by the virtual world. The experimental results show that it can efficiently control the avatar with an intuitive performance-based interface based on few motion sensors.

[1]  Bruno Arnaldi,et al.  Morphology‐independent representation of motions for interactive human‐like animation , 2005, Comput. Graph. Forum.

[2]  Jessica K. Hodgins,et al.  Action capture with accelerometers , 2008, SCA '08.

[3]  Makoto Sato,et al.  Physics‐driven Multi Dimensional Keyframe Animation for Artist‐directable Interactive Character , 2009, Comput. Graph. Forum.

[4]  Jehee Lee,et al.  Simulating biped behaviors from human motion data , 2007, SIGGRAPH 2007.

[5]  Tido Röder,et al.  Efficient content-based retrieval of motion capture data , 2005, SIGGRAPH 2005.

[6]  Dimitrios Gunopulos,et al.  Indexing Large Human-Motion Databases , 2004, VLDB.

[7]  Jessica K. Hodgins,et al.  Adapting simulated behaviors for new characters , 1997, SIGGRAPH.

[8]  Feng Liu,et al.  3D motion retrieval with motion index tree , 2003, Comput. Vis. Image Underst..

[9]  M. V. D. Panne,et al.  SIMBICON: simple biped locomotion control , 2007, SIGGRAPH 2007.

[10]  Jessica K. Hodgins,et al.  Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces , 2004, SIGGRAPH 2004.

[11]  C. Karen Liu,et al.  Performance-based control interface for character animation , 2009, SIGGRAPH 2009.

[12]  Victor B. Zordan,et al.  Dynamic response for motion capture animation , 2005, SIGGRAPH '05.

[13]  C. Karen Liu,et al.  Optimization-based interactive motion synthesis , 2009, ACM Trans. Graph..

[14]  Jessica K. Hodgins,et al.  Animation of Human Diving , 1996, Comput. Graph. Forum.

[15]  Jessica K. Hodgins,et al.  Motion capture-driven simulations that hit and react , 2002, SCA '02.

[16]  Andrew P. Witkin,et al.  Spacetime constraints , 1988, SIGGRAPH.

[17]  Aaron Hertzmann,et al.  Active learning for real-time motion controllers , 2007, SIGGRAPH 2007.

[18]  Shun Zhang,et al.  Intuitive Motion Retrieval with Motion Sensors , 2008, CGI 2008.

[19]  Hyun Joon Shin,et al.  Physical touch-up of human motions , 2003, 11th Pacific Conference onComputer Graphics and Applications, 2003. Proceedings..

[20]  Hyeong-Seok Ko,et al.  A physically-based motion retargeting filter , 2005, TOGS.

[21]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[22]  Rodney A. Brooks,et al.  Humanoid robots , 2002, CACM.

[23]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[24]  Hyeong-Seok Ko,et al.  Spacetime sweeping: an interactive dynamic constraints solver , 2002, Proceedings of Computer Animation 2002 (CA 2002).

[25]  Jessica K. Hodgins,et al.  Accelerometer-based user interfaces for the control of a physically simulated character , 2008, SIGGRAPH 2008.

[26]  Jessica K. Hodgins,et al.  Performance animation from low-dimensional control signals , 2005, SIGGRAPH 2005.

[27]  Katsu Yamane,et al.  Dynamics Filter - concept and implementation of online motion Generator for human figures , 2000, IEEE Trans. Robotics Autom..

[28]  Xiang Zhang,et al.  Performance-driven motion choreographing with accelerometers , 2009 .

[29]  Hyeong-Seok Ko,et al.  Motion Balance Filtering , 2000, Comput. Graph. Forum.