Applications of augmented reality for human-robot communication

The director/agent (D/A) metaphor of telerobotic interaction is discussed as a potential means for achieving human-robot synergy. In order for the human operator to communicate spatial information to the robot during D/A operations, the medium of augmented reality through overlaid virtual stereographics is proposed, leading to what is referred to as virtual control. An overview is given of the ARGOS (Augmented Reality through Graphic Overlays on Stereovideo) system. In particular, the uses of overlaid virtual pointers for enhancing absolute depth judgement tasks, virtual tape measures for real-world quantification, virtual tethers for perceptual enhancement in manual teleoperation, virtual landmarks for enhancing depth scaling, and virtual object overlays for on-object edge enhancement and display superposition are all presented and discussed.

[1]  Mohan M. Trivedi,et al.  A vision system for robotic inspection and manipulation , 1988, Computer.

[2]  Richard A. Volz,et al.  Teleautonomous systems: projecting and coordinating intelligent action at a distance , 1990, IEEE Trans. Robotics Autom..

[3]  R. L. Pepper,et al.  Research Issues in Teleoperator Systems , 1984 .

[4]  Won S. Kim,et al.  The phantom robot: predictive displays for teleoperation with time delay , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[5]  David Drascic,et al.  Skill Acquisition and Task Performance in Teleoperation Using Monoscopic and Stereoscopic Video Remote Viewing , 1991 .

[6]  Shumin Zhai,et al.  Telerobotic virtual control system , 1992, Other Conferences.

[7]  S.G. Maclean,et al.  Vision system development in a space simulation laboratory , 1990, ISPRS International Conference on Computer Vision and Remote Sensing.

[8]  Thomas S. Sheridan,et al.  Human and computer roles in supervisory control and telerobotics: musings about function, language and hierarchy , 1988 .

[9]  Drew McDermott,et al.  Introduction to artificial intelligence , 1986, Addison-Wesley series in computer science.

[10]  Lenny Lipton,et al.  A flicker-free field-sequential stereoscopic video system , 1984 .

[11]  Paul Milgram,et al.  Adaptation effects in stereo due to on-line changes in camera configuration , 1992, Electronic Imaging.

[12]  Shumin Zhai,et al.  An evaluation of four 6 degree-of-freedom input techniques , 1993, CHI '93.

[13]  Renwick E. Curry,et al.  Flight-deck automation: promises and problems , 1980 .

[14]  Paul Milgram,et al.  A virtual stereographic pointer for a real three dimensional video world , 1990, INTERACT.

[15]  Susumu Tachi,et al.  Tele-existence master-slave system for remote manipulation , 1990, EEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications.

[16]  Susumu Tachi,et al.  Tele-existence master-slave system for remote manipulation. II , 1990, 29th IEEE Conference on Decision and Control.

[17]  Shumin Zhai,et al.  ARGOS: a display system for augmenting reality , 1993, CHI '93.

[18]  Paul Milgram,et al.  Effect of stereographic + stereovideo 'tether' enhancement for a peg-in-hole task , 1992, [Proceedings] 1992 IEEE International Conference on Systems, Man, and Cybernetics.

[19]  Shumin Zhai,et al.  Human performance evaluation of manipulation schemes in virtual environments , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[20]  Paul Milgram,et al.  Positioning accuracy of a virtual stereographic pointer in a real stereoscopic video world , 1991, Electronic Imaging.

[21]  Peter Kazanzides,et al.  An image-directed robotic system for hip replacemetn surgery. , 1990 .