Hybrid Method for 3-D Gaze Tracking Using Glint and Contour Features

Glint features have important roles in gaze-tracking systems. However, when the operation range of a gaze-tracking system is enlarged, the performance of glint-feature-based (GFB) approaches will be degraded mainly due to the curvature variation problem at around the edge of the cornea. Although the pupil contour feature may provide complementary information to help estimating the eye gaze, existing methods do not properly handle the cornea refraction problem, leading to inaccurate results. This paper describes a contour-feature-based (CFB) 3-D gaze-tracking method that is compatible to cornea refraction. We also show that both the GFB and CFB approaches can be formulated in a unified framework and, thus, they can be easily integrated. Furthermore, it is shown that the proposed CFB method and the GFB method should be integrated because the two methods provide complementary information that helps to leverage the strength of both features, providing robustness and flexibility to the system. Computer simulations and real experiments show the effectiveness of the proposed approach for gaze tracking.

[1]  P Kang Ryoung A REAL-TIME GAZE POSITION ESTIMATION METHOD BASED ON A 3-D EYE MODEL , 2007 .

[2]  Worthy N. Martin,et al.  Human-computer interaction using eye-gaze input , 1989, IEEE Trans. Syst. Man Cybern..

[3]  Stefan Kohlbecher,et al.  Calibration-free eye tracking by reconstruction of the pupil ellipse in 3D space , 2008, ETRA.

[4]  Alastair G. Gale A note on the remote oculometer technique for recording eye movements , 1982, Vision Research.

[5]  David Beymer,et al.  Eye gaze tracking using an active stereo head , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[6]  L. Young,et al.  Survey of eye movement recording methods , 1975 .

[7]  H D Crane,et al.  Accurate two-dimensional eye tracker using first and fourth Purkinje images. , 1973, Journal of the Optical Society of America.

[8]  Sheng-Wen Shih,et al.  A novel approach to 3-D gaze tracking using stereo cameras , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Carlos Hitoshi Morimoto,et al.  Eye gaze tracking techniques for interactive applications , 2005, Comput. Vis. Image Underst..

[10]  Moshe Eizenman,et al.  General theory of remote gaze estimation using the pupil center and corneal reflections , 2006, IEEE Transactions on Biomedical Engineering.

[11]  Rafael Cabeza,et al.  Models for Gaze Tracking Systems , 2007, EURASIP J. Image Video Process..

[12]  Naoki Mukawa,et al.  FreeGaze: a gaze tracking system for everyday gaze interaction , 2002, ETRA.

[13]  K. Preston White,et al.  Eye-gaze word processing , 1990, IEEE Trans. Syst. Man Cybern..

[14]  M. Luckiesh,et al.  Color and vision. , 1915 .

[15]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Rafael Cabeza,et al.  Evaluation of Corneal Refraction in a Model of a Gaze Tracking System , 2008, IEEE Transactions on Biomedical Engineering.

[17]  Rafael Cabeza,et al.  Gaze Estimation Interpolation Methods Based on Binocular Data , 2012, IEEE Transactions on Biomedical Engineering.

[18]  Andrew W. Fitzgibbon,et al.  Direct Least Square Fitting of Ellipses , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[21]  Qiang Ji,et al.  Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance , 2002, Real Time Imaging.

[22]  Songde Ma,et al.  Conics-based stereo, motion estimation, and pose determination , 1993, International Journal of Computer Vision.

[23]  Kang Ryoung Park A Real-Time Gaze Position Estimation Method Based on a 3-D Eye Model , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Beno Benhabib,et al.  Three-dimensional location estimation of circular features for machine vision , 1992, IEEE Trans. Robotics Autom..

[25]  Zhiwei Zhu,et al.  Novel Eye Gaze Tracking Techniques Under Natural Head Movement , 2007, IEEE Transactions on Biomedical Engineering.

[26]  Jian-Gang Wang,et al.  Study on eye gaze estimation , 2002, IEEE Trans. Syst. Man Cybern. Part B.