A Novel Remote Eye Gaze Tracking System Using Line Illumination Sources

This paper proposes a novel system to estimate the 3D point of gaze using observations of the pupil center and corneal reflections (glints). A mathematical model is developed with two solutions to estimate the corneal center efficiently using lines of LED lights. Differing from existing 3D approaches requiring associating light sources with glints, the model automatically associates glints and LED lines and can handle missing glints well. The new model also enables a user-friendly calibration process, allowing natural head movement. Experiments demonstrate that the proposed system can achieve accurate gaze estimation with natural head movement. The performance is impressive when using the natural calibration, requiring less user cooperation.

[1]  Zhengyou Zhang,et al.  Improving cross-ratio-based eye tracking techniques by leveraging the binocular fixation constraint , 2014, ETRA.

[2]  Carlos Hitoshi Morimoto,et al.  Improving Head Movement Tolerance of Cross-Ratio Based Eye Trackers , 2012, International Journal of Computer Vision.

[3]  Myung Jin Chung,et al.  A novel non-intrusive eye gaze estimation using cross-ratio under large head motion , 2005, Comput. Vis. Image Underst..

[4]  Qiang Ji,et al.  A robust 3D eye gaze tracking system using noise reduction , 2008, ETRA.

[5]  Zhiwei Zhu,et al.  Novel Eye Gaze Tracking Techniques Under Natural Head Movement , 2007, IEEE Transactions on Biomedical Engineering.

[6]  Jean-Philippe Thiran,et al.  Towards Convenient Calibration for Cross-Ratio Based Gaze Estimation , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[7]  Carlos Hitoshi Morimoto,et al.  Free head motion eye gaze tracking using a single camera and multiple light sources , 2006, 2006 19th Brazilian Symposium on Computer Graphics and Image Processing.

[8]  Moshe Eizenman,et al.  User-calibration-free remote gaze estimation system , 2010, ETRA.

[9]  Carlos Hitoshi Morimoto,et al.  Eye gaze tracking techniques for interactive applications , 2005, Comput. Vis. Image Underst..

[10]  Moshe Eizenman,et al.  General theory of remote gaze estimation using the pupil center and corneal reflections , 2006, IEEE Transactions on Biomedical Engineering.

[11]  Naoki Mukawa,et al.  FreeGaze: a gaze tracking system for everyday gaze interaction , 2002, ETRA.

[12]  E. LESTER SMITH,et al.  AND OTHERS , 2005 .

[13]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[14]  Jean-Philippe Thiran,et al.  A Regression-Based User Calibration Framework for Real-Time Gaze Estimation , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Jean-Philippe Thiran,et al.  Robust gaze estimation based on adaptive fusion of multiple cameras , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[17]  Narendra Ahuja,et al.  Towards accurate and robust cross-ratio based gaze trackers through learning from simulation , 2014, ETRA.

[18]  Atsushi Nakazawa,et al.  Display-camera calibration using eye reflections and geometry constraints , 2011, Comput. Vis. Image Underst..

[19]  M. Eizenman,et al.  Simplifying the Cross-Ratios Method of Point-Of-Gaze Estimation , 2017 .

[20]  Dan Witzner Hansen,et al.  Homography normalization for robust gaze estimation in uncalibrated setups , 2010, ETRA.

[21]  Elias D. Guestrin.  Remote, Non-contact Gaze Estimation with Minimal Subject Cooperation , 2010 .