Required Accuracy of Gaze Tracking for Varifocal Displays

Varifocal displays are a practical method to solve vergence–accommodation conflict in near-eye displays for both virtual and augmented reality, but they are reliant on knowing the user's focal state. One approach for detecting the focal state is to use the link between vergence and accommodation and employ binocular gaze tracking to determine the depth of the fixation point; consequently, the focal depth is also known. In order to ensure the virtual image is in focus, the display must be set to a depth which causes no negative perceptual or physiological effects to the viewer, which indicates error bounds for the calculation of fixation point. I analyze the required gaze tracker accuracy to ensure the display focus is set within the viewer's depth of field, zone of comfort, and zone of clear single binocular vision. My findings indicate that for the median adult using an augmented reality varifocal display, gaze tracking accuracy must be better than 0.541°. In addition, I discuss eye tracking approaches presented in the literature to determine their ability to meet the specified requirements.

[1]  Zahra Hakimi,et al.  SET: a pupil detection method using sinusoidal approximation , 2015, Front. Neuroeng..

[2]  Dirk Seidel,et al.  Quantifying interactions between accommodation and vergence in a binocularly normal population , 2014, Vision Research.

[3]  Dongheng Li,et al.  Starburst: A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[4]  Hong Hua.  Enabling Focus Cues in Head-Mounted Displays , 2017 .

[5]  K J Ciuffreda,et al.  Dynamics of human voluntary accommodation. , 1988, American journal of optometry and physiological optics.

[6]  E F FINCHAM,et al.  The reciprocal actions of accommodation and convergence , 1957, The Journal of physiology.

[7]  Campbell Fw.  A method for measuring the depth of field of the human eye. , 1954 .

[8]  Junzhong Liang,et al.  Objective measurement of wave aberrations of the human eye with the use of a Hartmann-Shack wave-front sensor. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  Otmar Hilliges,et al.  Deep Pictorial Gaze Estimation , 2018, ECCV.

[10]  M W Morgan,et al.  Accommodation and vergence. , 1968, American journal of optometry and archives of American Academy of Optometry.

[11]  BY F. W. CAMIPBELL,et al.  DYNAMICS OF ACCOMMODATION RESPONSES OF THE HUMAN EYE , 2006 .

[12]  Adrian Glasser,et al.  Amplitude dependent accommodative dynamics in humans , 2003, Vision Research.

[13]  Neil A. Dodgson,et al.  Variation and extrema of human interpupillary distance , 2004, IS&T/SPIE Electronic Imaging.

[14]  Takashi Shibata,et al.  Visual discomfort with stereo displays: effects of viewing distance and direction of vergence-accommodation conflict , 2011, Electronic Imaging.

[15]  J. P. H. Reulen,et al.  Precise recording of eye movement: the IRIS technique Part 1 , 2006, Medical and Biological Engineering and Computing.

[16]  A S Percival,et al.  The Prescribing of Spectacles , 1911, Nature.

[17]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[18]  Bin Wang,et al.  Depth-of-focus of the human eye: theory and clinical implications. , 2006, Survey of ophthalmology.

[19]  D. Robinson,et al.  A METHOD OF MEASURING EYE MOVEMENT USING A SCLERAL SEARCH COIL IN A MAGNETIC FIELD. , 1963, IEEE transactions on bio-medical engineering.

[20]  Anthony I. Tew.  Simulation results for an innovative point-of-regard sensor using neural networks , 1997, Neural Computing & Applications.

[21]  H. Collewijn,et al.  Precise recording of human eye movements , 1975, Vision Research.

[22]  C. Schor,et al.  A dynamic model of cross-coupling between accommodation and convergence: simulations of step and frequency responses. , 1992, Optometry and vision science : official publication of the American Academy of Optometry.

[23]  Charles Sheard,et al.  The Prescription Of Prisms: As Determined by Analyses of Data on Relative Amplitudes of Convergence and Accommodation , 1934 .

[24]  Glenn A. Fry,et al.  FURTHER EXPERIMENTS ON THE ACCOMMODATION CONVERGENCE RELATIONSHIP , 1939 .

[25]  H D Crane,et al.  Servo-controlled infrared optometer. , 1970, Journal of the Optical Society of America.

[26]  Kenneth N. Ogle,et al.  An Analytical Treatment of the Longitudinal Horopter; Its Measurement and Application to Related Phenomena, Especially to the Relative Size and Shape of the Ocular Images* , 1932 .

[27]  Wolfgang Rosenstiel,et al.  ExCuSe: Robust Pupil Detection in Real-World Scenarios , 2015, CAIP.

[28]  Thiago Santini,et al.  ElSe: ellipse selection for robust pupil detection in real-world environments , 2015, ETRA.

[29]  K N OGLE,et al.  Observations on accommodative convergence; especially its nonlinear relationships. , 1959, American journal of ophthalmology.

[30]  Gregory Kramida,et al.  Resolving the Vergence-Accommodation Conflict in Head-Mounted Displays , 2016, IEEE Transactions on Visualization and Computer Graphics.

[31]  H D Crane,et al.  Accurate two-dimensional eye tracker using first and fourth Purkinje images. , 1973, Journal of the Optical Society of America.

[32]  Joohwan Kim,et al.  NVGaze: An Anatomically-Informed Dataset for Low-Latency, Near-Eye Gaze Estimation , 2019, CHI.

[33]  Arie E. Kaufman,et al.  An eye tracking computer user interface , 1993, Proceedings of 1993 IEEE Research Properties in Virtual Reality Symposium.

[34]  Otmar Hilliges,et al.  Learning to find eye region landmarks for remote gaze estimation in unconstrained settings , 2018, ETRA.

[35]  C. Schor,et al.  Binocular sensory fusion is limited by spatial resolution , 1984, Vision Research.

[36]  Shumeet Baluja,et al.  Non-Intrusive Gaze Tracking Using Artificial Neural Networks , 1993, NIPS.