A helmet mounted display system with active gaze control for visual telepresence

The objective of a Visual Telepresence System is to provide the operator with a high fidelity image from a remote stereo camera pair linked to a pan/tilt device such that the operator may reorient the camera position by use of head movement. Systems such as these which utilise virtual reality style helmet mounted displays have a number of limitations. The geometry of the camera positions and of the displays is generally fixed and is most suitable only for viewing elements of a scene at a particular distance. To address such limitations, a prototype system has been developed where the geometry of the displays and cameras is dynamically controlled by the eye movement of the operator. This paper explores why it is necessary to actively adjust the display system as well as the cameras and justifies the use of mechanical adjustment of the displays as an alternative to adjustment by electronic or image processing methods. The electronic and mechanical design is described including optical arrangements and control algorithms. The performance and accuracy of the system is assessed with respect to eye movement.

[1]  L. Young,et al.  Survey of eye movement recording methods , 1975 .

[2]  Warren Robinett,et al.  A Computational Model for the Stereoscopic Optics of a Head-Mounted Display , 1991, Presence: Teleoperators & Virtual Environments.

[3]  R. Carpenter,et al.  Movements of the Eyes , 1978 .

[4]  Mark Mon-Williams,et al.  Natural problems for stereoscopic depth perception in virtual environments , 1995, Vision Research.

[5]  David W. Murray,et al.  Feasibility of using eye tracking to increase resolution for visual telepresence , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[6]  Rosemary J. Stevenson,et al.  Effects of Text Structure and Prior Knowledge of the Learner on Navigation in Hypertext , 1998, Hum. Factors.

[7]  David W. Murray,et al.  Hardware development of the Yorick series of active vision systems , 1998, Microprocess. Microsystems.

[8]  M. Mon-Williams,et al.  Health issues with virtual reality displays: what we do know and what we don't , 1997, COMG.

[9]  Gavriel Salvendy,et al.  Aftereffects and Sense of Presence in Virtual Environments: Formulation of a Research and Development Agenda , 1998, Int. J. Hum. Comput. Interact..

[10]  D. Robinson,et al.  A METHOD OF MEASURING EYE MOVEMENT USING A SCLERAL SEARCH COIL IN A MAGNETIC FIELD. , 1963, IEEE transactions on bio-medical engineering.

[11]  Anup Basu,et al.  Analysis of Error in Depth Perception with Vergence and Spatially Varying Sensing , 1996, Comput. Vis. Image Underst..

[12]  Mark A. Handschy,et al.  Miniature FLC/CMOS color-sequential display systems , 1997 .

[13]  Sukhan Lee,et al.  Optimal 3D viewing with adaptive stereo displays , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[14]  Ross L. Pepper,et al.  Stereo TV Improves Operator Performance Under Degraded Visibility Conditions , 1981 .

[15]  Katsuya Matsunaga,et al.  A helmet mounted display for telerobotics , 1988, Digest of Papers. COMPCON Spring 88 Thirty-Third IEEE Computer Society International Conference.

[16]  Mark Mon-Williams,et al.  Binocular Virtual Reality Displays: When Problems Do and Don't Occur , 1998, Hum. Factors.

[17]  M. Mon-Williams,et al.  The contribution of vision and proprioception to judgements of finger proximity , 1998, Experimental Brain Research.

[18]  David W. Murray,et al.  Closing the Loop for Visual Telepresence , 1996 .