A Parameterized Action Representation for Virtual Human Agents

We describe a Parameterized Action Representation (PAR) designed to bridge the gap between natural language instructions and the virtual agents who are to carry them out. The PAR is therefore constructed based jointly on implemented motion capabilities of virtual human figures and linguistic requirements for instruction interpretation. We will illustrate PAR and a real-time execution architecture controlling 3D animated virtual human avatars. Comments Postprint version. Published in American Association for Artificial Intelligence, Spring Synposium, 2000. Author(s) Norman I. Badler, Ramamani Bindiganavale, Juliet C. Bourne, Martha Palmer, Jianping Shi, and William Schuler This journal article is available at ScholarlyCommons: http://repository.upenn.edu/hms/26 A Parameterized Action Representation for Virtual Human Agents Norman Badler, Rama Bindiganavale, Juliet Bourne Martha Palmer, Jianping Shi, William Schuler Center for Human Modeling and Simulation Computer and Information Science Department University of Pennsylvania Philadelphia, PA 19104-6389

[1]  Norman I. Badler,et al.  Casualty Modeling for Real-Time Medical Training , 1996, Presence: Teleoperators & Virtual Environments.

[2]  W. Lewis Johnson,et al.  Steve: an animated pedagogical agent for procedural training in virtual environments , 1997, SGAR.

[3]  Martha Palmer,et al.  Final Report to Air Force HRGA Regarding Feasibility of Natural Language Text Generation from Task Networks for Use in Automatic Generation of Technical Order from DEPTH Simulations , 1997 .

[4]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[5]  R. James Firby.  Task Networks for Controlling Continuous Processes , 1994, AIPS.

[6]  Norman I. Badler,et al.  Simulating humans: computer graphics animation and control , 1993 .

[7]  Norman I. Badler,et al.  Motion Abstraction and Mapping with Spatial Constraints , 1998, CAPTECH.

[8]  Norman I. Badler,et al.  A Virtual Human Presenter , 1997 .

[9]  Mark Steedman,et al.  Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents , 1994, SIGGRAPH.

[10]  Christopher W. Geib,et al.  Planning for animation , 1996 .

[11]  Juliet C. Bourne.  Generating Adequate Instructions: Knowing When to Stop , 1998, AAAI/IAAI.

[12]  Norman I. Badler,et al.  Smart avatars in JackMOO , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[13]  Norman I. Badler,et al.  Decision networks for integrating the behaviors of virtual agents and avatars , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.