Teleassistance: Contextual Guidance for Autonomous Manipulation

We present teleassistance, a two-tiered control structure for robotic manipulation that combines the advantages of autonomy and teleoperation. At the top level, a teleoperator provides global, deictic references via a natural sign language. Each sign indicates the next action to perform and a relative and hand-centered coordinate frame in which to perform it. For example, the teleoperator may point to an object for reaching, or preshape the hand for grasping. At the lower level autonomous servo routines run within the reference frames provided. Teleassistance offers two benefits. First, the servo routines can position the robot in relative coordinates and interpret feedback within a constrained context. This significantly simplifies the computational load of the autonomous routines and requires only a sparse model of the task. Second, the operator's actions are symbolic, conveying intent without requiring the person to literally control the robot. This helps to alleviate many of the problems inherent to teleoperation, including poor mappings between operator and robot physiology, reliance on a broad communication bandwidth, and the potential for robot damage when solely under remote control. To demonstrate the concept, a Utah/MIT hand mounted on a Puma 760 arm opens a door.

[1]  Blake Hannaford,et al.  Hidden Markov Model Analysis of Force/ Torque Information in Telemanipulation , 1989, ISER.

[2]  Katsushi Ikeuchi,et al.  Grasp recognition and manipulative motion characterization from human hand motion sequences , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[3]  Masayuki Inaba,et al.  Seeing, understanding and doing human task , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[4]  Ruzena Bajcsy,et al.  Sensorimotor Learning Using Active Perception in Continuous Domains , 1991 .

[5]  Dana H. Ballard,et al.  Sensing qualitative events to control manipulation , 1992, Other Conferences.

[6]  Rodney A. Brooks,et al.  A layered intelligent control system for a mobile robot , 1986 .

[7]  Eileen Kowler,et al.  Reading twisted text: Implications for the role of saccades , 1987, Vision Research.

[8]  D H Ballard,et al.  Hand-eye coordination during sequential tasks. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[9]  Jonathan H. Connell,et al.  A colony architecture for an artificial creature , 1989 .

[10]  Dana H. Ballard,et al.  Animate Vision , 1991, Artif. Intell..

[11]  M. Arbib.  Coordinated control programs for movements of the hand , 1985 .

[12]  Katsushi Ikeuchi,et al.  Towards an assembly plan from observation : fine localization based on face contact constraints , 1991 .

[13]  Dana H. Ballard,et al.  Recognizing teleoperated manipulations , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[14]  Jill D. Crismann.  Deictic primitives for general purpose navigation , 1994 .

[15]  Teuvo Kohonen,et al.  Improved versions of learning vector quantization , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[16]  Dana H. Ballard,et al.  Principles of animate vision , 1992, CVGIP Image Underst..

[17]  Thomas H. Speeter.  Transforming Human Hand Motion for Telemanipulation , 1992, Presence: Teleoperators & Virtual Environments.

[18]  Tsuneo Yoshikawa,et al.  Operation modes for cooperating with autonomous functions in intelligent teleoperation systems , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[19]  Richard P. Paul,et al.  Operating Interaction and Teleprogramming for Subsea Manipulation , 1992 .