Modeling physical capabilities of humanoid agents using motion capture data

In this paper we demonstrate a method for fine-grained modeling of a synthetic agentýs physical capabilities ¿ running, jumping, sneaking, and other modes of movement. Using motion capture data acquired from human subjects, we extract a motion graph and construct a cost map for the space of agent actions. We show how a planner can incorporate this cost model into the planning process to select between equivalent goal-achieving plans. We explore the utility of our model in three different capacities: 1) modeling other agents in the environment; 2) representing heterogeneous agents with different physical capabilities; 3) modeling agent physical states (e.g., wounded or tired agents). This technique can be incorporated into applications where human-like, high-fidelity physical models are important to the agentsý reasoning process, such as virtual training environments.

[1]  David A. Forsyth,et al.  Motion synthesis from annotations , 2003, ACM Trans. Graph..

[2]  Munindar P. Singh,et al.  Conversational Agents , 1997 .

[3]  Bradley J. Best,et al.  Spatial Plans , Communication , and Teamwork in Synthetic MOUT Agents , 2003 .

[4]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH '08.

[5]  John E. Laird,et al.  Variability in Human Behavior Modeling for Military Simulations , 2003 .

[6]  W. Lewis Johnson,et al.  Integrating pedagogical capabilities in a virtual environment agent , 1997, AGENTS '97.

[7]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[8]  Jessica K. Hodgins,et al.  Three-dimensional human running , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[9]  Brett R Fajen,et al.  Behavioral dynamics of steering, obstacle avoidance, and route selection. , 2003, Journal of experimental psychology. Human perception and performance.

[10]  Robert E. Tarjan,et al.  Depth-First Search and Linear Graph Algorithms , 1972, SIAM J. Comput..

[11]  John Funge,et al.  Cognitive modeling: knowledge, reasoning and planning for intelligent characters , 1999, SIGGRAPH.

[12]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[13]  Milind Tambe,et al.  Intelligent Automated Agents for Flight Training Simulators , 1993 .

[14]  W. Lewis Johnson,et al.  Extending virtual humans to support team training in virtual reality , 2003 .

[15]  James C. Lester,et al.  Increasing believability in animated pedagogical agents , 1997, AGENTS '97.

[16]  Maja J. Mataric,et al.  Automated derivation of behavior vocabularies for autonomous humanoid motion , 2003, AAMAS '03.

[17]  Maja J. Mataric,et al.  Deriving action and behavior primitives from human motion data , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Robert E. Wray INTELLIGENT OPPONENTS FOR VIRTUAL REALITY TRAINERS , 2002 .

[19]  J. Cassell,et al.  Embodied conversational agents , 2000 .

[20]  Jeff Rickel,et al.  Virtual Humans for Team Training in Virtual Reality , 1999 .

[21]  Yun Xia,et al.  Skeletonization via the Realization of the Fire Front's Propagation and Extinction in Digital Binary Shapes , 1989, IEEE Trans. Pattern Anal. Mach. Intell..