Iris Feature-Based 3-D Gaze Estimation Method Using a One-Camera-One-Light-Source System

Multicamera or multilight-source is generally used to estimate the 3-D coordinates of the cornea center for 3-D gaze estimation in the existing gaze trackers. Although some model-based methods use one-camera systems to estimate 3-D gazes, which include some user-dependent eye parameters preset by fixed values, a one-camera-one-light-source system is still unable to achieve 3-D gaze estimation by considering individual differences. In this article, an iris feature-based method using one camera and one light source for 3-D gaze estimation is proposed. The iris radius and the kappa angle are determined during user calibration. The optical axis is reconstructed by the iris center and its normal vector from only the iris features. Therefore, with the real-time estimation of kappa angle, the 3-D gaze is estimated by an optimization method. Computer simulations and practical experiments have been performed to analyze the feasibility and robustness of the proposed method. This article’s innovation lies in achieving 3-D gaze estimation based on only one-camera and one-light source with calibrated eye-specific parameters, which breaks through the limitation of the existing methods using a 3-D cornea center on the system’s hardware requirements of 3-D gaze estimation. The simplified hardware system has great application values, especially in the portable mobile devices widely used today. Moreover, a binocular model is used to optimize the results of the point of regard, which improves the accuracy of 3-D gaze estimation effectively.

[1]  Krzysztof Fornalczyk,et al.  Single web camera robust interactive eye-gaze tracking method , 2015 .

[2]  Sung-Jea Ko,et al.  A novel single IR light based gaze estimation method using virtual glints , 2015, IEEE Transactions on Consumer Electronics.

[3]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Sheng-Wen Shih,et al.  A novel approach to 3-D gaze tracking using stereo cameras , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[5]  Carlos Hitoshi Morimoto,et al.  Eye gaze tracking techniques for interactive applications , 2005, Comput. Vis. Image Underst..

[6]  Moshe Eizenman,et al.  General theory of remote gaze estimation using the pupil center and corneal reflections , 2006, IEEE Transactions on Biomedical Engineering.

[7]  Naoki Mukawa,et al.  FreeGaze: a gaze tracking system for everyday gaze interaction , 2002, ETRA.

[8]  Pieter Blignaut,et al.  Mapping the Pupil-Glint Vector to Gaze Coordinates in a Simple Video-Based Eye Tracker , 2013 .

[9]  Rafael Cabeza,et al.  A Novel Gaze Estimation System With One Calibration Point , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Ting Xue,et al.  Matching and 3-D Reconstruction of Multibubbles Based on Virtual Stereo Vision , 2014, IEEE Transactions on Instrumentation and Measurement.

[11]  Ke Zhang,et al.  A Simplified 3D Gaze Tracking Technology with Stereo Vision , 2010, 2010 International Conference on Optoelectronics and Image Processing.

[12]  S.M. Kim,et al.  Non-intrusive eye gaze tracking under natural head movements , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  Lu Yang,et al.  Gazing point dependent eye gaze estimation , 2017, Pattern Recognit..

[14]  Zhiwei Zhu,et al.  Eye gaze tracking under natural head movements , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Yi-Ping Hung,et al.  Hybrid Method for 3-D Gaze Tracking Using Glint and Contour Features , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Naoki Tanaka,et al.  User-calibration-free gaze tracking with estimation of the horizontal angles between the visual and the optical axes of both eyes , 2010, ETRA.

[17]  Naoki Tanaka,et al.  Calibration-free gaze tracking using a binocular 3D eye model , 2009, CHI Extended Abstracts.

[18]  Qiang Ji,et al.  Deep eye fixation map learning for calibration-free eye gaze tracking , 2016, ETRA.

[19]  Carlos Hitoshi Morimoto,et al.  Free head motion eye gaze tracking using a single camera and multiple light sources , 2006, 2006 19th Brazilian Symposium on Computer Graphics and Image Processing.

[20]  Peter D. Lawrence,et al.  A single camera eye-gaze tracking system with free head motion , 2006, ETRA.

[21]  Michael F. Land,et al.  The Human Eye: Structure and Function , 1999, Nature Medicine.

[22]  Yiu Cheung Shiu,et al.  3D location of circular and spherical features by monocular model-based vision , 1989, Conference Proceedings., IEEE International Conference on Systems, Man and Cybernetics.

[23]  Nasser Kehtarnavaz,et al.  An Object-Tracking Algorithm Based on Multiple-Model Particle Filtering With State Partitioning , 2009, IEEE Transactions on Instrumentation and Measurement.

[24]  Jian-Gang Wang,et al.  Gaze determination via images of irises , 2001, Image Vis. Comput..

[25]  Shigang Li,et al.  Gaze Estimation From Color Image Based on the Eye Model With Known Head Pose , 2016, IEEE Transactions on Human-Machine Systems.

[26]  Zicheng Liu,et al.  Real time gaze estimation with a consumer depth camera , 2015, Inf. Sci..

[27]  Carlos Hitoshi Morimoto,et al.  Detecting eye position and gaze from a single camera and 2 light sources , 2002, Object recognition supported by user interaction for service robots.

[28]  Yue Gao,et al.  Estimating 3D Gaze Directions Using Unlabeled Eye Images via Synthetic Iris Appearance Fitting , 2016, IEEE Transactions on Multimedia.

[29]  Qinmu Peng,et al.  Eye Gaze Tracking With a Web Camera in a Desktop Environment , 2015, IEEE Transactions on Human-Machine Systems.

[30]  David Beymer,et al.  Eye gaze tracking using an active stereo head , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[31]  Peter Robinson,et al.  Learning an appearance-based gaze estimator from one million synthesised images , 2016, ETRA.

[32]  Honghai Liu,et al.  Two-eye model-based gaze estimation from a Kinect sensor , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[33]  Shaun J. Canavan,et al.  A Multi-Gesture Interaction System Using a 3-D Iris Disk Model for Gaze Estimation and an Active Appearance Model for 3-D Hand Pointing , 2011, IEEE Transactions on Multimedia.

[34]  Dan Witzner Hansen,et al.  Homography normalization for robust gaze estimation in uncalibrated setups , 2010, ETRA.

[35]  Zhiwei Zhu,et al.  Novel Eye Gaze Tracking Techniques Under Natural Head Movement , 2007, IEEE Transactions on Biomedical Engineering.

[36]  Jing Xu,et al.  An easy iris center detection method for eye gaze tracking system , 2015 .

[37]  Rafael Cabeza,et al.  Models for Gaze Tracking Systems , 2007, EURASIP J. Image Video Process..

[38]  Moshe Eizenman,et al.  Investigation of the Cross-Ratios Method for Point-of-Gaze Estimation , 2008, IEEE Transactions on Biomedical Engineering.

[39]  Sung-Jea Ko,et al.  Improved remote gaze estimation using corneal reflection-adaptive geometric transforms , 2014 .

[40]  M. Eizenman,et al.  Remote Point-of-Gaze Estimation with Free Head Movements Requiring a Single-Point Calibration , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[41]  Tao Hu,et al.  Gaze estimation in a gaze tracking system , 2011, Science China Information Sciences.

[42]  Yoshinobu Ebisawa Improved video-based eye-gaze detection method , 1998, IEEE Trans. Instrum. Meas..

[43]  Jose Sigut,et al.  Iris Center Corneal Reflection Method for Gaze Tracking Using Visible Light , 2011, IEEE Transactions on Biomedical Engineering.