Some of what one needs to know about using head-mounted displays to improve teleoperator performance

It is noted that a head-mounted display (HMD) system would be a useful teleoperator system display if it increased operator performance of the desired task but could degrade performance because of display update rate limitations and communication delays. 3-D tracking and pick-and-place tasks are simulated to characterize performance levels for a range of update rates and delays. How performance changes as the display is altered to maintain the update rate is also examined. The results of the update experiments indicate that performance levels degrade only slightly until the update rate is below 1 or 2 Hz. Attempts to maintain update rate by eliminating display features such as stereo and occlusion cues show that the presence of either cue alone is sufficient to maintain performance levels in the simple, short-term tasks considered. Delays also degrade performance in both manipulation tasks considered. These HMD performance problems are not lessened by the presentation of a predictive feedback display. Instead, the delay in the head movement tracking loop must be eliminated. >

[1]  A. Bejczy,et al.  Graphics displays for operator aid in telemanipulation , 1991, Conference Proceedings 1991 IEEE International Conference on Systems, Man, and Cybernetics.

[2]  Clifford A. Shaffer,et al.  Real-time robot arm collision detection for telerobotics , 1991 .

[3]  Frank Tendick,et al.  Telerobotics: problems and research needs , 1988 .

[4]  Lawrence W. Stark,et al.  The effect of monocular target blur on simulated telerobotic manipulation , 1991, IEEE Trans. Robotics Autom..

[5]  A. K. Bejczy,et al.  Force-reflective teleoperated system with shared and compliant control capabilities , 1989 .

[6]  Lawrence W. Stark,et al.  Visual enhancements in pick-and-place tasks: Human operators controlling a simulated cylindrical manipulator , 1987, IEEE Journal on Robotics and Automation.

[7]  Lawrence Stark,et al.  On-the-screen visual enhancements for a telerobotic vision system , 1988, Proceedings of the 1988 IEEE International Conference on Systems, Man, and Cybernetics.

[8]  R E Cole,et al.  Display System Variables Affecting Operator Performance in Undersea Vehicles and Work Systems. , 1978 .

[9]  Gregory K. Tharp,et al.  A helmet mounted display to adapt the telerobotic environment to human vision , 1990 .

[10]  S. Stifter Collision detection in the robot simulation system SMART , 1992 .

[11]  R. Held,et al.  Adaptation to displaced and delayed visual feedback from the hand. , 1966 .

[12]  Michitaka Hirose,et al.  Development of visual 3D virtual environment for control software , 1991 .

[13]  Warren Robinett,et al.  Virtual environment display system , 1987, I3D '86.

[14]  Blake Hannaford,et al.  Force-reflection and shared compliant control in operating telemanipulators with time delay , 1992, IEEE Trans. Robotics Autom..

[15]  William R. Ferrell,et al.  Remote manipulation with transmission delay. , 1965 .

[16]  Won S. Kim,et al.  The phantom robot: predictive displays for teleoperation with time delay , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[17]  Katsuya Matsunaga,et al.  A helmet mounted display for telerobotics , 1988, Digest of Papers. COMPCON Spring 88 Thirty-Third IEEE Computer Society International Conference.

[18]  M J Leslie,et al.  Effects of time delay in the visual feedback loop of a man-machine system , 1966 .

[19]  Blake Hannaford,et al.  Telerobotics: Display, control, and communication problems , 1987, IEEE J. Robotics Autom..

[20]  Michael Venturino,et al.  Performance and head movements using a helmet-mounted display with different sized fields-of-view , 1990 .

[21]  B H Kishimoto,et al.  Remote Operator Performance Using Bandwidth-Limited TV Displays: A Review and Proposal. , 1980 .

[22]  L Stark,et al.  Eye Movements during the Viewing of Necker Cubes , 1978, Perception.

[23]  Blake Hannaford,et al.  Quantitative Evaluation of Perspective and Stereoscopic Displays in Three-Axis Manual Tracking Tasks , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[24]  T. Sheridan,et al.  Video Framerate, Resolution and Grayscale Tradeoffs for Undersea Telemanipulator Control , 1981 .

[25]  Lawrence Stark,et al.  Depth cues for telerobotic tasks in virtual environments , 1992 .

[26]  Scott S. Fisher,et al.  Defining, modeling, and measuring system lag in virtual environments , 1990, Other Conferences.