On visual gaze tracking based on a single low cost camera

Gaze tracking technologies provide an unconventional way of human-computer interaction, envisaged to advance practical applications and industrial products in a multitude of fields. The success of such systems depends on selecting the best calibration setup and image features that correspond to a person's line of sight. The purpose of this study is to estimate eye gaze from a single, low cost web-cam, under natural lighting. Facial traits are extracted from the sensory data, from which distance vectors related to gaze are derived. Different experimental setups are studied to evaluate the robustness of the proposed method with respect to various calibration setups, camera position and head movements. The use of new additional features improves the modeling of the subtle eye movements in the vertical direction, while a new calibration setup is proposed that further enhances the performance. The results demonstrate that the proposed framework is able to track gaze with good accuracy, consolidating the use of inexpensive equipment and techniques towards an ever-expanding range of gaze tracking applications. HighlightsUses only a single camera, offering convenience and minimal intrusiveness.Positions of upper eyelids contribute in ameliorating vertical gaze accuracy.Calibration points arranged at a 'cross pattern' demonstrate better performance.Gaze is estimated with high accuracy, suitable for most gaze tracking applications.

[1]  Jian-Gang Wang,et al.  Estimating the eye gaze from one eye , 2005, Comput. Vis. Image Underst..

[2]  Alessandro Ledda,et al.  3D Face tracking and gaze estimation using a monocular camera , 2011 .

[3]  Dave M. Stampe,et al.  Heuristic filtering and reliable calibration methods for video-based pupil-tracking systems , 1993 .

[4]  Zhi-Hua Zhou,et al.  Projection functions for eye detection , 2004, Pattern Recognit..

[5]  Shumeet Baluja,et al.  Non-Intrusive Gaze Tracking Using Artificial Neural Networks , 1993, NIPS.

[6]  Takahiro Ishikawa,et al.  Passive driver gaze tracking with active appearance models , 2004 .

[7]  Mubarak Shah,et al.  Determining driver visual attention with one camera , 2003, IEEE Trans. Intell. Transp. Syst..

[8]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  T. Eames.  THE VISUAL FIELDS , 1955 .

[10]  Zhiwei Zhu,et al.  Novel Eye Gaze Tracking Techniques Under Natural Head Movement , 2007, IEEE Transactions on Biomedical Engineering.

[11]  Juan J. Cerrolaza,et al.  Study of Polynomial Mapping Functions in Video-Oculography Eye Trackers , 2012, TCHI.

[12]  Jian-Gang Wang,et al.  Study on eye gaze estimation , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[13]  T. Boult,et al.  The eyes have it , 2003, WBMA '03.

[14]  Yu-Tzu Lin,et al.  Real-time eye-gaze estimation using a low-resolution webcam , 2012, Multimedia Tools and Applications.

[15]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  S. Langton,et al.  The influence of head contour and nose angle on the perception of eye-gaze direction , 2004, Perception & psychophysics.

[17]  Nicu Sebe,et al.  Webcam-Based Visual Gaze Estimation , 2009, ICIAP.

[18]  Hanan Salam,et al.  INTEGRATING HEAD POSE TO A 3D M ULTI - TEXTURE APPROACH FOR GAZE DETECTION , 2013 .

[19]  F. Xavier Roca,et al.  Real-time gaze tracking with appearance-based models , 2009, Machine Vision and Applications.

[20]  Yi-Ping Hung,et al.  Appearance-Based Gaze Tracking with Free Head Movement , 2014, 2014 22nd International Conference on Pattern Recognition.

[21]  Wei Gao,et al.  A Novel Simple 2D Model of Eye Gaze Estimation , 2010, 2010 Second International Conference on Intelligent Human-Machine Systems and Cybernetics.

[22]  Yoichi Sato,et al.  Learning-by-Synthesis for Appearance-Based 3D Gaze Estimation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Alexander Zelinsky,et al.  3-D facial pose and gaze point estimation using a robust real-time tracking paradigm , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[24]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[25]  Nicu Sebe,et al.  What Are You Looking at? , 2011, International Journal of Computer Vision.

[26]  Heiko Neumann,et al.  A comprehensive head pose and gaze database , 2007 .

[27]  Nicu Sebe,et al.  Combining Head Pose and Eye Location Information for Gaze Estimation , 2012, IEEE Transactions on Image Processing.

[28]  L. Bour,et al.  Neurophysiological aspects of eye and eyelid movements during blinking in humans. , 2000, Journal of neurophysiology.

[29]  MatthewsIain,et al.  Lucas-Kanade 20 Years On , 2004 .

[30]  Mick P. Couper,et al.  IN THE EYE OF THE BEHOLDER , 2008, Du Bois Review: Social Science Research on Race.

[31]  Luke Fletcher,et al.  Correlating driver gaze with the road scene for driver assistance systems , 2005, Robotics Auton. Syst..

[32]  Timo Schneider,et al.  Manifold Alignment for Person Independent Appearance-Based Gaze Estimation , 2014, 2014 22nd International Conference on Pattern Recognition.

[33]  Laura Chamberlain.  Eye Tracking Methodology; Theory and Practice , 2007 .

[34]  Rico Fischer,et al.  Eye tracking and its application in usability and media research , 2003, MMI Interakt..

[35]  Hirotake Yamazoe,et al.  Remote gaze estimation with a single camera based on facial-feature tracking without special calibration actions , 2008, ETRA.

[36]  Theo Gevers,et al.  Calibration-Free Gaze Estimation Using Human Gaze Patterns , 2013, 2013 IEEE International Conference on Computer Vision.

[37]  Alexander Zelinsky,et al.  Fast Radial Symmetry for Detecting Points of Interest , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  R. Pieters,et al.  A Review of Eye-Tracking Research in Marketing , 2008 .

[39]  Mads Nielsen,et al.  Eye typing using Markov and active appearance models , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[40]  Li-Qun Xu,et al.  A Novel Approach to Real-time Non-intrusive Gaze Finding , 1998, BMVC.

[41]  Andrew T Duchowski,et al.  A breadth-first survey of eye-tracking applications , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[42]  Dan Witzner Hansen,et al.  Eye tracking in the wild , 2005, Comput. Vis. Image Underst..

[43]  Murphy-ChutorianErik,et al.  Head Pose Estimation in Computer Vision , 2009 .

[44]  Nikos Fakotakis,et al.  Precise localization of eye centers in low resolution color images , 2015, Image Vis. Comput..

[45]  Carlos Hitoshi Morimoto,et al.  Eye gaze tracking techniques for interactive applications , 2005, Comput. Vis. Image Underst..

[46]  Kostas Karpouzis,et al.  Visual Focus of Attention in Non-calibrated Environments using Gaze Estimation , 2014, International Journal of Computer Vision.

[47]  Qiang Ji,et al.  3D gaze estimation with a single camera without IR illumination , 2008, 2008 19th International Conference on Pattern Recognition.

[48]  Pong C. Yuen,et al.  Variance projection function and its application to eye detection for human face recognition , 1998, Pattern Recognit. Lett..

[49]  Rafael Cabeza,et al.  Evaluation of pupil center-eye corner vector for gaze estimation using a web cam , 2012, ETRA '12.

[50]  Jie Zhu,et al.  Subpixel eye gaze tracking , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[51]  Peter M. Corcoran,et al.  Real-time eye gaze tracking for gaming design and consumer electronics systems , 2012, IEEE Transactions on Consumer Electronics.

[52]  Marcus Nyström,et al.  Eye tracker data quality: what it is and how to measure it , 2012, ETRA.

[53]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[54]  Yoichi Sato,et al.  Appearance-Based Gaze Estimation Using Visual Saliency , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  Silvia Conforto,et al.  A neural-based remote eye gaze tracker under natural head motion , 2008, Comput. Methods Programs Biomed..

[56]  Sung-Jea Ko,et al.  Eyeball model-based iris center localization for visible image-based eye-gaze tracking systems , 2013, IEEE Transactions on Consumer Electronics.

[57]  Steven K. Feiner,et al.  Gaze locking: passive eye contact detection for human-object interaction , 2013, UIST.

[58]  Andreas Bulling,et al.  EyeTab: model-based gaze estimation on unmodified tablet computers , 2014, ETRA.

[59]  N. Emery,et al.  The eyes have it: the neuroethology, function and evolution of social gaze , 2000, Neuroscience & Biobehavioral Reviews.

[60]  Hyun Lee,et al.  Rapid eye detection method for non-glasses type 3D display on portable devices , 2010, IEEE Transactions on Consumer Electronics.

[61]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[62]  Worthy N. Martin,et al.  Human-computer interaction using eye-gaze input , 1989, IEEE Trans. Syst. Man Cybern..

[63]  André P. Calitz,et al.  The added value of eye tracking in the usability evaluation of a network management tool , 2005 .

[64]  Nikos Fakotakis,et al.  An Accurate Eye Center Localization Method for Low Resolution Color Imagery , 2012, 2012 IEEE 24th International Conference on Tools with Artificial Intelligence.

[65]  Tony Charman,et al.  Neural Correlates of Eye Gaze Processing in the Infant Broader Autism Phenotype , 2009, Biological Psychiatry.