Task-Level Object Grasping for Simulated Agents

Simulating a human figure performing a manual task requires that the agent interact with objects in the environment in a realistic manner. Graphic or programming interfaces to control human figure animation, however, do not allow the animator to instruct the system with concise high-level commands. Instructions coming from a high-level planner cannot be directly given to a synthetic agent because they do not specify such details as which end-effector to use or where on the object to grasp. Because current animation systems require joint angle displacement descriptions of motion—even for motions that incorporate upwards of 15 joints—an efficient connection between high-level specifications and low-level hand joint motion is required. In this paper we describe a system that directs task-level, general-purpose, object grasping for a simulated human agent. The Object-Specific Reasoner (OSR) is a reasoning module that uses knowledge of the object of the underspecified action to generate values for missing parameters. The Grasp Behavior manages simultaneous motions of the joints in the hand, wrist, and arm, and provides a programmer with a high-level description of the desired action. When composed hierarchically, the OSR and the Grasp behavior interpret task-level commands and direct specific motions to the animation system. These modules are implemented as part of the Jock system at the University of Pennsylvania.

[1]  R. James Firby,et al.  An Investigation into Reactive Planning in Complex Domains , 1987, AAAI.

[2]  Norman I. Badler,et al.  Terrain reasoning for human locomotion , 1994, Proceedings of Computer Animation '94.

[3]  Norman I. Badler,et al.  Simulating humans: computer graphics animation and control , 1993 .

[4]  Daniel Thalmann,et al.  Simulation of object and human skin formations in a grasping task , 1989, SIGGRAPH.

[5]  Norman I. Badler,et al.  Real-Time Inverse Kinematics of the Human Arm , 1996, Presence: Teleoperators & Virtual Environments.

[6]  Nadia Magnenat-Thalmann,et al.  Human body deformations using joint-dependent local operators and finite-element theory , 1991 .

[7]  John E. Laird,et al.  Integrating, Execution, Planning, and Learning in Soar for External Environments , 1990, AAAI.

[8]  M. Arbib,et al.  Opposition Space as a Structuring Concept for the Analysis of Skilled Hand Movements , 1986 .

[9]  Michael Girard,et al.  Computer animation of knowledge-based human grasping , 1991, SIGGRAPH.

[10]  Timothy W. Bickmore,et al.  A basic agent , 1990, Comput. Intell..

[11]  Joe Jackson,et al.  Knowledge-based prehension: capturing human dexterity , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[12]  Craig W. Reynolds.  Flocks, herds, and schools: a distributed behavioral model , 1998 .

[13]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[14]  Huan Liu,et al.  Knowledge-based control of grasping in robot hands using heuristics from human motor skills , 1993, IEEE Trans. Robotics Autom..

[15]  P. L. Adams.  THE ORIGINS OF INTELLIGENCE IN CHILDREN , 1976 .

[16]  Christopher W. Geib,et al.  Planning for Reactive Behaviors in Hide and Seek , 1995 .

[17]  Russell H. Taylor,et al.  Automatic Synthesis of Fine-Motion Strategies for Robots , 1984 .

[18]  Jean-Claude Latombe,et al.  Planning motions with intentions , 1994, SIGGRAPH.

[19]  Daniel Thalmann,et al.  Joint-dependent local deformations for hand animation and object grasping , 1989 .

[20]  George A. Bekey,et al.  A strategy for grasp synthesis with multifingered robot hands , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[21]  Thea Iberall,et al.  Grasp Planning from Human Prehension , 1987, IJCAI.

[22]  Steve Strassmann.  Semi-Autonomous Animated Actors , 1994, AAAI.

[23]  Christopher W. Geib,et al.  SodaJack: An Architecture For Agents That Search For And Manipulate Objects , 1994 .

[24]  R. Howe,et al.  Human grasp choice and robotic grasp analysis , 1990 .

[25]  Christopher W. Geib,et al.  Planning and Terrain Reasoning , 1995 .

[26]  D. McDermott.  Transformational Planning of Reactive Behavior , 1992 .

[27]  Mark Steedman,et al.  Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents , 1994, SIGGRAPH.

[28]  M. Arbib.  Coordinated control programs for movements of the hand , 1985 .

[29]  Sharon A. Stansfield,et al.  Knowledge-based robotic grasping , 1990, Proceedings., IEEE International Conference on Robotics and Automation.