Two-eye model-based gaze estimation from a Kinect sensor

In this paper, we present an effective and accurate gaze estimation method based on two-eye model of a subject with the tolerance of free head movement from a Kinect sensor. To accurately and efficiently determine the point of gaze, i) we employ two-eye model to improve the estimation accuracy; ii) we propose an improved convolution-based means of gradients method to localize the iris center in 3D space; iii) we present a new personal calibration method that only needs one calibration point. The method approximates the visual axis as a line from the iris center to the gaze point to determine the eyeball centers and the Kappa angles. The final point of gaze can be calculated by using the calibrated personal eye parameters. We experimentally evaluate the proposed gaze estimation method on eleven subjects. Experimental results demonstrate that our gaze estimation method has an average estimation accuracy around 1.99°, which outperforms many leading methods in the state-of-the-art.

[1]  Shigang Li,et al.  Gaze Estimation From Color Image Based on the Eye Model With Known Head Pose , 2016, IEEE Transactions on Human-Machine Systems.

[2]  Shigang Li,et al.  Eye-Model-Based Gaze Estimation by RGB-D Camera , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[3]  Youfu Li,et al.  GM-PHD-Based Multi-Target Visual Tracking Using Entropy Distribution and Game Theory , 2014, IEEE Transactions on Industrial Informatics.

[4]  Michael Vaiman,et al.  Variations in Eyeball Diameters of the Healthy Adults , 2014, Journal of ophthalmology.

[5]  Jean-Marc Odobez,et al.  Gaze estimation from multimodal Kinect data , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[6]  Erhardt Barth,et al.  Accurate Eye Centre Localisation by Means of Gradients , 2011, VISAPP.

[7]  Honghai Liu,et al.  Gaze estimation driven solution for interacting children with ASD , 2015, 2015 International Symposium on Micro-NanoMechatronics and Human Science (MHS).

[8]  Gene H. Golub,et al.  Singular value decomposition and least squares solutions , 1970, Milestones in Matrix Computation.

[9]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[10]  Moshe Eizenman,et al.  General theory of remote gaze estimation using the pupil center and corneal reflections , 2006, IEEE Transactions on Biomedical Engineering.

[11]  Amine Naït-Ali,et al.  An Adaptive Algorithm for Eye-Gaze-Tracking-Device Calibration , 2008, IEEE Transactions on Instrumentation and Measurement.

[12]  Reza Jafari,et al.  Eye-gaze estimation under various head positions and iris states , 2015, Expert Syst. Appl..

[13]  Fernando De la Torre,et al.  Supervised Descent Method and Its Applications to Face Alignment , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Li Shigang,et al.  Eye-Model-Based Gaze Estimation by RGB-D Camera , 2014, CVPR 2014.

[15]  Zicheng Liu,et al.  Real time gaze estimation with a consumer depth camera , 2015, Inf. Sci..

[16]  Reza Jafari,et al.  Gaze estimation using Kinect/PTZ camera , 2012, 2012 IEEE International Symposium on Robotic and Sensors Environments Proceedings.

[17]  Jean-Marc Odobez,et al.  Geometric Generative Gaze Estimation (G3E) for Remote RGB-D Cameras , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Qinmu Peng,et al.  Eye Gaze Tracking With a Web Camera in a Desktop Environment , 2015, IEEE Transactions on Human-Machine Systems.

[19]  Theo Gevers,et al.  Accurate Eye Center Location through Invariant Isocentric Patterns , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Dario Cazzato,et al.  An Investigation on the Feasibility of Uncalibrated and Unconstrained Gaze Tracking for Human Assistive Applications by Using Head Pose Estimation , 2014, Sensors.

[21]  Moshe Eizenman,et al.  An Automatic Personal Calibration Procedure for Advanced Gaze Estimation Systems , 2010, IEEE Transactions on Biomedical Engineering.