Robot-augmented communication: a remote-collaboration system based on a shared field of view in real space

To create a more efficient environment in which to perform remote maintenance, the authors propose a novel collaboration concept, called robot-augmented communication (RAC). In RAC a maintenance robot and an on-site human worker are assisted by another skilled human operator at a remote support center. By emphasizing the intentions of the remote supporter through robot functions that cannot be imitated by humans, RAC can provide effective support for the on-site worker. In the present study, as the first manifestation of RAC, featuring the projection capability of a maintenance robot, a prototype remote-collaboration system named SCOPE (sight collaboration by projection effect) was developed. This system consists of a projector unit with a camera, a multiple control unit (MCU) for video/voice communications, and PCs connected via a network. It has three key functions: creating a shared field of view between a remote supporter and an on-site worker, keeping meta-information related to objects in real space, and projecting meta-information onto the objects. The effectiveness of these functions was evaluated by experiments on two fundamental tasks $"comprehending a target object" and "transmission of instruction details" nvolved in a typical maintenance operation. The experimental results show that each function is effective in shortening the time taken to perform the maintenance operation.

[1]  Susumu Tachi,et al.  Tele-existence (I): Design and Evaluation of a Visual Display with Sensation of Presence , 1985 .

[2]  Tomio Watanabe,et al.  Sensory evaluation of expressive actions of InterRobot for human interaction and communication support , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[3]  Toshiaki Sugimura,et al.  Alter-Ego Interface Technology , 2003 .

[4]  Hiroshi Masuda,et al.  Application of the wearable system to shipbuilding industrial engineering , 2001 .

[5]  E. G. Johnsen.  Teleoperators and Human Augmentation , 1967 .

[6]  Robert E. Kraut,et al.  Collaboration in performance of physical tasks: effects on outcomes and communication , 1996, CSCW '96.

[7]  Masahiko Mikawa,et al.  Smooth and easy telecommunication using CTerm , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).