Optimization of illumination schemes in a head-mounted display integrated with eye tracking capabilities

Head-mounted display (HMD) technologies find a variety of applications in the field of 3D virtual and augmented environments, 3D scientific visualization, as well as wearable displays. While most of the current HMDs use head pose to approximate line of sight, we propose to investigate approaches and designs for integrating eye tracking capability into HMDs from a low-level system design perspective and to explore schemes for optimizing system performance. In this paper, we particularly propose to optimize the illumination scheme, which is a critical component in designing an eye tracking-HMD (ET-HMD) integrated system. An optimal design can improve not only eye tracking accuracy, but also robustness. Using LightTools, we present the simulation of a complete eye illumination and imaging system using an eye model along with multiple near infrared LED (IRLED) illuminators and imaging optics, showing the irradiance variation of the different eye structures. The simulation of dark pupil effects along with multiple 1st-order Purkinje images will be presented. A parametric analysis is performed to investigate the relationships between the IRLED configurations and the irradiance distribution at the eye, and a set of optimal configuration parameters is recommended. The analysis will be further refined by actual eye image acquisition and processing.

[1]  James E. Sheedy,et al.  Field Guide to Visual and Ophthalmic Optics , 2005 .

[2]  J P Rolland,et al.  High-resolution inset head-mounted display. , 1998, Applied optics.

[3]  Jannick P. Rolland,et al.  Towards Quantifying Depth and Size Perception in Virtual Environments , 1993, Presence: Teleoperators & Virtual Environments.

[4]  Hong Hua,et al.  Integration of eye tracking capability into optical see-through head-mounted displays , 2001, IS&T/SPIE Electronic Imaging.

[5]  David A. Atchison,et al.  Optics of the Human Eye , 2023 .

[6]  K. Tanie,et al.  An eye movement tracking type head mounted display for virtual reality system: evaluation experiments of a prototype system , 1994, Proceedings of IEEE International Conference on Systems, Man and Cybernetics.

[7]  L. Young,et al.  Survey of eye movement recording methods , 1975 .

[8]  Kazuo Tanie,et al.  Eye movement tracking type image display system for wide view image presentation with high-resolution - evaluation of high-resolution image presentation , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  J P Rolland,et al.  Engineering of head-mounted projective displays. , 2000, Applied optics.

[10]  Henry Fuchs,et al.  Optical Versus Video See-Through Head-Mounted Displays in Medical Visualization , 2000, Presence: Teleoperators & Virtual Environments.

[11]  René M. Müri,et al.  Recording of Horizontal Saccadic Eye Movements: Methodological Comparison Between Electro-Oculography and Infrared Reflection Oculography , 1986 .

[12]  George W. Fitzmaurice,et al.  HMDs, caves & chameleon: a human-centric analysis of interaction in virtual space , 1998, COMG.

[13]  Mark A. Livingston,et al.  Superior augmented reality registration by integrating landmark tracking and magnetic tracking , 1996, SIGGRAPH.

[14]  Andrew T. Duchowski.  Incorporating the viewer's point of regard (POR) in gaze-contingent virtual environments , 1998, Electronic Imaging.

[15]  H. Collewijn,et al.  Human gaze stability in the horizontal, vertical and torsional direction during voluntary head movements, evaluated with a three-dimensional scleral induction coil technique , 1987, Vision Research.

[16]  Kazuo Tanie,et al.  High resolution, wide view angle head mounted display using eye movement tracking: system structure and evaluation experiments , 1995, Proceedings 4th IEEE International Workshop on Robot and Human Communication.

[17]  Ivan E. Sutherland,et al.  The Ultimate Display , 1965 .

[18]  Andrew W. Fitzgibbon,et al.  Direct Least Square Fitting of Ellipses , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Kazuo Tanie,et al.  Development of an eye movement tracking type head mounted display: capturing and displaying real environment images with high reality , 1997, Proceedings of International Conference on Robotics and Automation.

[20]  Erik Viirre,et al.  The Virtual Retinal Display: A new Display Technology using Scanned Laser Light , 1998 .

[21]  Steve Marschner,et al.  Image-Based BRDF Measurement Including Human Skin , 1999, Rendering Techniques.

[22]  Andrew W. Fitzgibbon,et al.  Direct least squares fitting of ellipses , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[23]  Arie E. Kaufman,et al.  An eye tracking computer user interface , 1993, Proceedings of 1993 IEEE Research Properties in Virtual Reality Symposium.

[24]  Gary Moody,et al.  Eye tracker system for use with head mounted displays , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[25]  D. Robinson,et al.  A METHOD OF MEASURING EYE MOVEMENT USING A SCLERAL SEARCH COIL IN A MAGNETIC FIELD. , 1963, IEEE transactions on bio-medical engineering.