A model-based approach to video-based eye tracking

Video-based eye tracking typically relies on tracking the pupil and a first-surface corneal reflection (CR) of an illumination source. The positional difference between these two features is used to determine the observer's eye-in-head orientation. With the use of head-mounted eye trackers, this positional difference is unavoidably affected by relative movements between the eye tracking camera and the subject's eye. Video-based trackers also suffer from problems resulting in poor CR detection, such as spurious reflections being mistaken as the desired CR. We approach these problems by modelling how these features—pupil and CR—are affected by different relative movements of the eye. Optical relationships between the offset of the apparent pupil centre and that of the CR are derived. An experiment was conducted with five observers to support these derivations. Solutions to the aforementioned problems using these offset relationships are provided. The first application compensates for movements of an eye tracking camera with respect to the eye and reduces noise in the final eye orientation data. The second application is prediction of CR locations for artefact removal in the new eye tracking system prototype.

[1]  D. Ballard,et al.  Eye movements in natural behavior , 2005, Trends in Cognitive Sciences.

[2]  Andrew W. Fitzgibbon,et al.  Direct Least Square Fitting of Ellipses , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Dongheng Li,et al.  openEyes: an open-hardware open-source system for low-cost eye tracking , 2006 .

[4]  J Merchant,et al.  Remote measurement of eye direction allowing subject motion over one cubic foot of space. , 1974, IEEE transactions on bio-medical engineering.

[5]  Carlos Hitoshi Morimoto,et al.  Eye gaze tracking techniques for interactive applications , 2005, Comput. Vis. Image Underst..

[6]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[7]  L. Young,et al.  Survey of eye movement recording methods , 1975 .

[8]  H D Crane,et al.  Accurate two-dimensional eye tracker using first and fourth Purkinje images. , 1973, Journal of the Optical Society of America.

[9]  Hanqi Zhuang,et al.  A cascaded scheme for eye tracking and head movement compensation , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[10]  J. Pelz,et al.  Oculomotor behavior and perceptual strategies in complex tasks , 2001, Vision Research.

[11]  Michael F. Land,et al.  From eye movements to actions: how batsmen hit the ball , 2000, Nature Neuroscience.

[12]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[13]  John Robson,et al.  Vision research : a practical guide to laboratory methods , 1998 .

[14]  G. Wnek,et al.  Encyclopedia of biomaterials and biomedical engineering , 2008 .

[15]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[16]  D. Atchison,et al.  The eye and visual optical instruments: Frontmatter , 1997 .

[17]  E. B. Delabarre.  A method of recording eye-movements. , 1898 .

[18]  D. Whitteridge.  Movements of the eyes R. H. S. Carpenter, Pion Ltd, London (1977), 420 pp., $27.00 , 1979, Neuroscience.

[19]  Han Collewijn,et al.  Eye movement recording , 1998 .