Reconstruction of display and eyes from a single image

This paper introduces a novel method for reconstructing human eyes and visual display from reflections on the cornea. This problem is difficult because the camera is not directly facing the display, but instead captures the eyes of a person in front of the display. Reconstruction of eyes and display is useful for point-of-gaze estimation, which can be approximated from the 3D positions of the iris and display. It is shown that iris boundaries (limbus) and display reflections in a single intrinsically calibrated image provide enough information for such an estimation. The proposed method assumes a simplified geometric eyeball model with certain anatomical constants which are used to reconstruct the eye. A noise performance analysis shows the sensitivity of the proposed method to imperfect data. Experiments on various subjects show that it is possible to determine the approximate area of gaze on a display from a single image.

[1]  Michael F. Land,et al.  The Human Eye: Structure and Function , 1999, Nature Medicine.

[2]  Andrew W. Fitzgibbon,et al.  Direct Least Square Fitting of Ellipses , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Qian Chen,et al.  Camera Calibration with Two Arbitrary Coplanar Circles , 2004, ECCV.

[4]  Richard S. Snell,et al.  Clinical Anatomy of the Eye: Snell/Clinical Anatomy of the Eye , 1997 .

[5]  Moshe Eizenman,et al.  Investigation of the Cross-Ratios Method for Point-of-Gaze Estimation , 2008, IEEE Transactions on Biomedical Engineering.

[6]  Atsushi Nakazawa,et al.  Display-camera calibration from eye reflections , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[7]  Seth J. Teller,et al.  Determining the Lines Through Four Lines , 1999, J. Graphics, GPU, & Game Tools.

[8]  N A Brennan,et al.  Anatomically accurate, finite model eye for optical modeling. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  Gerhard W. Cibis,et al.  Clinical Anatomy of the Eye , 1990 .

[10]  Peihua Li,et al.  Robust and accurate iris segmentation in very noisy iris images , 2010, Image Vis. Comput..

[11]  Moshe Eizenman,et al.  Remote point-of-gaze estimation requiring a single-point calibration for applications with infants , 2008, ETRA.

[12]  Myung Jin Chung,et al.  A novel non-intrusive eye gaze estimation using cross-ratio under large head motion , 2005, Comput. Vis. Image Underst..

[13]  Yu-Te Wu,et al.  A calibration-free gaze tracking technique , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[14]  Zhenwen Dai,et al.  Polygonal Light Source Estimation , 2009, ACCV.

[15]  Philippe Bekaert,et al.  Screen-Camera Calibration Using Gray Codes , 2009, 2009 Canadian Conference on Computer and Robot Vision.

[16]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[17]  Stefan Kohlbecher,et al.  Calibration-free eye tracking by reconstruction of the pupil ellipse in 3D space , 2008, ETRA.

[18]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[19]  Vincent Lepetit,et al.  3D pose refinement from reflections , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  K NayarShree,et al.  Corneal Imaging System , 2006 .

[21]  Shree K. Nayar,et al.  Corneal Imaging System: Environment from Eyes , 2006, International Journal of Computer Vision.

[22]  Qiang Ji,et al.  3D gaze estimation with a single camera without IR illumination , 2008, 2008 19th International Conference on Pattern Recognition.

[23]  Jian-Gang Wang,et al.  Estimating the eye gaze from one eye , 2005, Comput. Vis. Image Underst..