Responsive characters from motion fragments

In game environments, animated character motion must rapidly adapt to changes in player input - for example, if a directional signal from the player's gamepad is not incorporated into the character's trajectory immediately, the character may blithely run off a ledge. Traditional schemes for data-driven character animation lack the split-second reactivity required for this direct control; while they can be made to work, motion artifacts will result. We describe an on-line character animation controller that assembles a motion stream from short motion fragments, choosing each fragment based on current player input and the previous fragment. By adding a simple model of player behavior we are able to improve an existing reinforcement learning method for precalculating good fragment choices. We demonstrate the efficacy of our model by comparing the animation selected by our new controller to that selected by existing methods and to the optimal selection, given knowledge of the entire path. This comparison is performed over real-world data collected from a game prototype. Finally, we provide results indicating that occasional low-quality transitions between motion segments are crucial to high-quality on-line motion generation; this is an important result for others crafting animation systems for directly-controlled characters, as it argues against the common practice of transition thresholding.

[1]  Demetri Terzopoulos,et al.  Automated learning of muscle-actuated locomotion through control abstraction , 1995, SIGGRAPH.

[2]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[3]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[4]  Eugene Fiume,et al.  Interactive control for physically-based animation , 2000, SIGGRAPH.

[5]  Irfan A. Essa,et al.  Machine Learning for Video-Based Rendering , 2000, NIPS.

[6]  Roberto Pieraccini,et al.  A stochastic model of human-machine interaction for learning dialog strategies , 2000, IEEE Trans. Speech Audio Process..

[7]  Sung Yong Shin,et al.  Computer puppetry: An importance-based approach , 2001, TOGS.

[8]  Petros Faloutsos,et al.  Composable controllers for physics-based character animation , 2001, SIGGRAPH.

[9]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[10]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[11]  Mira Dontcheva,et al.  Layered acting for character animation , 2003, ACM Trans. Graph..

[12]  Doug L. James,et al.  Precomputing interactive dynamic deformable scenes , 2003, ACM Trans. Graph..

[13]  Jovan Popovic,et al.  Example-based control of human motion , 2004, SCA '04.

[14]  Nancy S. Pollard,et al.  Evaluating motion graphs for character navigation , 2004, SCA '04.

[15]  C. Karen Liu,et al.  Momentum-based parameterization of dynamic character motion , 2004, SCA '04.

[16]  Jehee Lee,et al.  Precomputing avatar behavior from human motion data , 2004, SCA '04.

[17]  Andrew W. Moore,et al.  The parti-game algorithm for variable resolution reinforcement learning in multidimensional state-spaces , 2004, Machine Learning.

[18]  Peng Zhao,et al.  User interfaces for interactive control of physics-based 3D characters , 2005, I3D '05.

[19]  David A. Forsyth,et al.  Learning to move autonomously in a hostile world , 2005, SIGGRAPH '05.

[20]  Jessica K. Hodgins,et al.  Performance animation from low-dimensional control signals , 2005, ACM Trans. Graph..

[21]  Jessica K. Hodgins,et al.  Performance animation from low-dimensional control signals , 2005, SIGGRAPH 2005.

[22]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[23]  Doug L. James,et al.  Mesh ensemble motion graphs , 2006, SIGGRAPH '06.

[24]  Hyun Joon Shin,et al.  Fat graphs: constructing an interactive character with continuous controls , 2006, SCA '06.

[25]  J. Hodgins,et al.  Reducing the search space for physically realistic human motion synthesis , 2006 .

[26]  Okan Arikan,et al.  Quick Motion Transitions with Cached Multi-way Blends , 2006 .

[27]  Adrien Treuille,et al.  Near-optimal character animation with continuous control , 2007, SIGGRAPH 2007.

[28]  Nancy S. Pollard,et al.  Evaluating motion graphs for character animation , 2007, TOGS.

[29]  Michael Gleicher,et al.  Parametric motion graphs , 2007, SI3D.

[30]  Jessica K. Hodgins,et al.  Construction and optimal search of interpolated motion graphs , 2007, ACM Trans. Graph..

[31]  Hyun Joon Shin,et al.  Snap-together motion: assembling run-time animations , 2003, SIGGRAPH '08.

[32]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH Classes.