Learning to move autonomously in a hostile world

Figure 1: This sequence was recorded from a live, interactive demo, in which the user controls the crate and can move it anywhere at anytime. A virtual agent is tasked with traveling from the left of the scene to the target on the right. While the agent is running towards the target, the user moves the crate into the position shown on the left, blocking the agent’s intended path. The local motion planner selects frames that avoid hitting the object but still make progress toward the goal (A). The user again moves the object into the agent’s path, and again the system successfully copes (B). Altogether, the user tries to block the agent by moving the crate 3 times, but the agent still dodges it and arrives at the target position seamlessly.

[1]  Demetri Terzopoulos,et al.  Artificial Fishes: Autonomous Locomotion, Perception, Behavior, and Learning in a Simulated Physical World , 1994, Artificial Life.

[2]  David A. Forsyth,et al.  Motion synthesis from annotations , 2003, ACM Trans. Graph..

[3]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[4]  Harry Shum,et al.  Motion texture: a two-level statistical model for character motion synthesis , 2002, ACM Trans. Graph..

[5]  Craig W. Reynolds.  Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[6]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH '08.

[7]  Adrian Hilton,et al.  Realistic synthesis of novel human movements from a database of motion capture examples , 2000, Proceedings Workshop on Human Motion.

[8]  Jehee Lee,et al.  Precomputing avatar behavior from human motion data , 2004, SCA '04.

[9]  John Funge,et al.  Cognitive modeling: knowledge, reasoning and planning for intelligent characters , 1999, SIGGRAPH.

[10]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[11]  Demetri Terzopoulos,et al.  Artificial life for computer graphics , 1999, CACM.

[12]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[13]  Maja J. Mataric,et al.  Getting Humanoids to Move and Imitate , 2000, IEEE Intell. Syst..

[14]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[15]  James J. Kuffner,et al.  Autonomous behaviors for interactive vehicle animations , 2004, SCA '04.

[16]  J. Baxter,et al.  Direct gradient-based reinforcement learning , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[17]  Bruce Blumberg,et al.  Multi-level direction of autonomous creatures for real-time virtual environments , 1995, SIGGRAPH.