Eye Gaze Tracking With a Web Camera in a Desktop Environment

This paper addresses the eye gaze tracking problem using a lowcost andmore convenient web camera in a desktop environment, as opposed to gaze tracking techniques requiring specific hardware, e.g., infrared high-resolution camera and infrared light sources, as well as a cumbersome calibration process. In the proposed method, we first track the human face in a real-time video sequence to extract the eye regions. Then, we combine intensity energy and edge strength to obtain the iris center and utilize the piecewise eye corner detector to detect the eye corner. We adopt a sinusoidal head model to simulate the 3-D head shape, and propose an adaptive weighted facial features embedded in the pose from the orthography and scaling with iterations algorithm, whereby the head pose can be estimated. Finally, the eye gaze tracking is accomplished by integration of the eye vector and the head movement information. Experiments are performed to estimate the eye movement and head pose on the BioID dataset and pose dataset, respectively. In addition, experiments for gaze tracking are performed in real-time video sequences under a desktop environment. The proposed method is not sensitive to the light conditions. Experimental results show that ourmethod achieves an average accuracy of around 1 . 28 ◦ without head movement and 2 . 27 ◦ with minor movement of the head.

[1]  B. Hood,et al.  Look into my eyes: Gaze direction and person memory , 2004, Memory.

[2]  Arie E. Kaufman,et al.  An eye tracking computer user interface , 1993, Proceedings of 1993 IEEE Research Properties in Virtual Reality Symposium.

[3]  Steven J. Landry,et al.  An Eye Movement Analysis Algorithm for a Multielement Target Tracking Task: Maximum Transition-Based Agglomerative Hierarchical Clustering , 2015, IEEE Transactions on Human-Machine Systems.

[4]  Jie Zhu,et al.  Subpixel eye gaze tracking , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[5]  Moshe Eizenman,et al.  General theory of remote gaze estimation using the pupil center and corneal reflections , 2006, IEEE Transactions on Biomedical Engineering.

[6]  Tsukasa Ogasawara,et al.  Estimating 3-D Point-of-Regard in a Real Environment Using a Head-Mounted Eye-Tracking System , 2014, IEEE Transactions on Human-Machine Systems.

[7]  D. Robinson,et al.  A METHOD OF MEASURING EYE MOVEMENT USING A SCLERAL SEARCH COIL IN A MAGNETIC FIELD. , 1963, IEEE transactions on bio-medical engineering.

[8]  Dan Witzner Hansen,et al.  Eye tracking in the wild , 2005, Comput. Vis. Image Underst..

[9]  Silvia Conforto,et al.  A neural-based remote eye gaze tracker under natural head motion , 2008, Comput. Methods Programs Biomed..

[10]  S. Liversedge,et al.  Saccadic eye movements and cognition , 2000, Trends in Cognitive Sciences.

[11]  Irfan A. Essa,et al.  A non-invasive computer vision system for reliable eye tracking , 2000, CHI Extended Abstracts.

[12]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[13]  Nicu Sebe,et al.  Combining Head Pose and Eye Location Information for Gaze Estimation , 2012, IEEE Transactions on Image Processing.

[14]  Andrew T Duchowski,et al.  A breadth-first survey of eye-tracking applications , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[15]  Jeff B. Pelz,et al.  Building a lightweight eyetracking headgear , 2004, ETRA.