Parameterized Action Representation and Natural Language Instructions for Dynamic Behavior Modification of Embodied Agents

We introduce a prototype for building a strategy game. A player can control and modify the behavior of all the characters in a game, and introduce new strategies, through the powerful medium of natural language instructions. We describe a Parameterized Action Representation (PAR) designed to bridge the gap between natural language instructions and the virtual agents who are to carry them out. We will illustrate PAR through an interactive demonstration of a multi-agent strategy game.

[1]  Norman I. Badler,et al.  Instructions, Intentions and Expectations , 1995, Artif. Intell..

[2]  Rodney A. Brooks,et al.  A robot that walks; emergent behaviors from a carefully evolved network , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[3]  Ken Perlin,et al.  Improv: a system for scripting interactive actors in virtual worlds , 1996, SIGGRAPH.

[4]  Norman I. Badler,et al.  Smart avatars in JackMOO , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[5]  Norman I. Badler,et al.  Animation control for real-time virtual humans , 1999, CACM.

[6]  Norman I. Badler,et al.  Gesticulation behaviors for virtual humans , 1998, Proceedings Pacific Graphics '98. Sixth Pacific Conference on Computer Graphics and Applications (Cat. No.98EX208).

[7]  David Zeltzer,et al.  Task-level graphical simulation: abstraction, representation, and control , 1991 .

[8]  Norman I. Badler,et al.  Casualty Modeling for Real-Time Medical Training , 1996, Presence: Teleoperators & Virtual Environments.

[9]  Bonnie Webber,et al.  Animation from instructions , 1991 .

[10]  John E. Laird,et al.  Flexibly Instructable Agents , 1995, J. Artif. Intell. Res..

[11]  S. Narayanan.  Talking the Talk is Like Walking the Walk : A Computational Model of Verbal Aspect , 1997 .

[12]  Christopher W. Geib,et al.  Planning for animation , 1996 .

[13]  Norman I. Badler,et al.  A Virtual Human Presenter , 1997 .

[14]  Mark Steedman,et al.  Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents , 1994, SIGGRAPH.

[15]  XTAG Research Group,et al.  A Lexicalized Tree Adjoining Grammar for English , 1998, ArXiv.

[16]  W. Lewis Johnson,et al.  Steve: an animated pedagogical agent for procedural training in virtual environments , 1997, SGAR.

[17]  Martha Palmer,et al.  Final Report to Air Force HRGA Regarding Feasibility of Natural Language Text Generation from Task Networks for Use in Automatic Generation of Technical Order from DEPTH Simulations , 1997 .

[18]  Mark Lutz,et al.  Programming Python , 1996 .

[19]  Norman I. Badler,et al.  Simulating humans: computer graphics animation and control , 1993 .

[20]  Anne Abeillé,et al.  A Lexicalized Tree Adjoining Grammar for English , 1990 .