Morphology independent motion retrieval and control

This paper addresses the problem of selecting and adapting a motion in order to make a virtual human interact with a user in real-time. We describe a method that is able to retrieve the most appropriate motion in interactive environments where both the constraints and the character's morphology are not known in advance. The method described here is based on a morphology-independent representation of motion to perform fast motion retargetting and retrieval. Because the size of the database is not infinite, even the best candidate motion may not satisfy precisely all the imposed constraints. As a second step of the algorithm, the selected motion is locally adapted in order to accurately satisfy these constraints. This adaptation allows dealing with a large set of possible movements even if no candidate in the database exactly fits the constraints. In this paper, we propose a method to select an appropriate motion in a small database in order to reduce precomputation, search and manual editing time. To us, an appropriate motion should deal with the morphology of the character and unpredictable constraints imposed in real-time by the user. Indeed, the size of an avatar is not always known in advance in VR applications and the environment induces many adaptations of its original captured motion. In this work, we illustrate our method on a kung-fu fighter that has to kick and punch targets that are interactively displaced. 75 kung-fu motions were performed by 4 actors and will be used by virtual fighters with different sizes and proportions. We so allow the morphology of the virtual fighter to change during the simulation. The method will adapt the animation according to this new character. The target is driven by a real-time motion capture system which tracks the position of the head of the user in an immersive environment. This example demonstrates the ability of our method to deal with average-size databases in an interactive application without requiring long preprocessing.

[1]  Bruno Arnaldi,et al.  Morphology‐independent representation of motions for interactive human‐like animation , 2005, Comput. Graph. Forum.

[2]  Lucas Kovar,et al.  Automated extraction and parameterization of motions in large data sets , 2004, ACM Trans. Graph..

[3]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[4]  Chris Hecker,et al.  Real-time motion retargeting to highly varied user-created morphologies , 2008, ACM Trans. Graph..

[5]  R. Kulpa,et al.  Fast inverse kinematics and kinetics solver for human-like figures , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[6]  Alla Safonova,et al.  Achieving good connectivity in motion graphs , 2008, SCA '08.

[7]  Lucas Kovar,et al.  Motion Graphs , 2002, ACM Trans. Graph..

[8]  Nancy S. Pollard,et al.  To appear in the ACM SIGGRAPH conference proceedings Responsive Characters from Motion Fragments , 2022 .

[9]  Jessica K. Hodgins,et al.  Construction and optimal search of interpolated motion graphs , 2007, ACM Trans. Graph..

[10]  Chih-Cheng Chen,et al.  A combined optimization method for solving the inverse kinematics problems of mechanical manipulators , 1991, IEEE Trans. Robotics Autom..

[11]  Hyun Joon Shin,et al.  Fat graphs: constructing an interactive character with continuous controls , 2006, SCA '06.

[12]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.

[13]  Meinard Müller,et al.  Motion templates for automatic classification and retrieval of motion capture data , 2006, SCA '06.

[14]  Feng Liu,et al.  3D motion retrieval with motion index tree , 2003, Comput. Vis. Image Underst..

[15]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[16]  Sung Yong Shin,et al.  Planning biped locomotion using motion capture data and probabilistic roadmaps , 2003, TOGS.