Model-based head pose-free gaze estimation for assistive communication

Employing video-based eye-gaze tracking as an assistive communication tool.A geometrical model of the face and eyes is proposed to estimate the eye-gaze.The challenge of estimating the eye-gaze under free head movements is addressed.The proposed method requires minimal user calibration prior to gaze estimation.The method is evaluated on real data collected from a subject with cerebral palsy. The significance of employing video-based eye-gaze tracking as an assistive tool has long been recognised, especially in the domain of human-computer interaction to assist physically challenged individuals in operating a computer by the eye movements alone. Nonetheless, several operating conditions typically associated with existing eye-gaze tracking methods, relating to constraints on the head movement and prolonged user-calibration prior to gaze estimation, need to be alleviated in order to better assist individuals with motor disabilities. In this paper, we propose a method that is based on a cylindrical head and spherical eyeballs model to estimate the three-dimensional eye-gaze under free head movement from a single camera integrated into a notebook computer, alleviating any assumptions of stationary head movement without requiring prolonged user co-operation prior to gaze estimation. The validity of the proposed method has been investigated on a publicly available data set and real-life data captured through the voluntary collaboration of a group of normal subjects and a person suffering from cerebral palsy.

[1]  Alexander Zelinsky,et al.  An algorithm for real-time stereo vision implementation of head pose and gaze direction measurement , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[2]  Kentaro Takemura,et al.  Estimating point-of-regard using corneal surface image , 2014, ETRA.

[3]  Qiang Ji,et al.  3D gaze estimation with a single camera without IR illumination , 2008, 2008 19th International Conference on Pattern Recognition.

[4]  Hirotake Yamazoe,et al.  Remote gaze estimation with a single camera based on facial-feature tracking without special calibration actions , 2008, ETRA.

[5]  Dongheng Li,et al.  Starburst: A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[6]  Jing Xiao,et al.  Meticulously detailed eye region model and its application to analysis of facial images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Kenneth P. Camilleri,et al.  Fasthpe : a recipe for quick head pose estimation , 2014 .

[9]  Jian-Gang Wang,et al.  Estimating the eye gaze from one eye , 2005, Comput. Vis. Image Underst..

[10]  Mubarak Shah,et al.  Monitoring head/eye motion for driver alertness with one camera , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[11]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[12]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[13]  Oleg V. Komogortsev,et al.  Eye tracking on unmodified common tablets: challenges and solutions , 2012, ETRA '12.

[14]  Miad Faezipour,et al.  Classifiers comparison for a new eye gaze direction classification system , 2014, IEEE Long Island Systems, Applications and Technology (LISAT) Conference 2014.

[15]  Dinesh K. Pai,et al.  Rolling motion makes the eyes roll: torsion during smooth pursuit eye movements , 2013 .

[16]  Kai Kunze,et al.  My reading life: towards utilizing eyetracking on unmodified tablets and phones , 2013, UbiComp.

[17]  Oleg V. Komogortsev,et al.  Real-time eye gaze tracking with an unmodified commodity webcam employing a neural network , 2010, CHI Extended Abstracts.

[18]  Kenneth P. Camilleri,et al.  Cursor control by point-of-regard estimation for a computer with integrated webcam , 2014 .

[19]  Takahiro Okabe,et al.  Learning gaze biases with head motion for head pose-free gaze estimation , 2014, Image Vis. Comput..

[20]  Caroline M Wilkinson,et al.  Measurement of eyeball protrusion and its application in facial reconstruction. , 2003, Journal of forensic sciences.

[21]  Theo Gevers,et al.  Accurate eye center location and tracking using isophote curvature , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  K. Krigger.  Cerebral palsy: an overview. , 2006, American family physician.

[23]  Nicu Sebe,et al.  Combining Head Pose and Eye Location Information for Gaze Estimation , 2012, IEEE Transactions on Image Processing.

[24]  Robert J. K. Jacob,et al.  What you look at is what you get: eye movement-based interaction techniques , 1990, CHI '90.

[25]  Takahiko Horiuchi,et al.  Eye-Gaze Detection from Monocular Camera Image Using Parametric Template Matching , 2007, ACCV.

[26]  Z Tomori,et al.  Eye tracking using artificial neural networks for human computer interaction. , 2011, Physiological research.

[27]  Olivier White,et al.  Computation of gaze orientation under unrestrained head movements , 2007, Journal of Neuroscience Methods.

[28]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[29]  Jing Xiao,et al.  Robust full‐motion recovery of head by dynamic templates and re‐registration techniques , 2003 .

[30]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Antonio Albiol,et al.  Estimating Point of Regard with a Consumer Camera at a Distance , 2013, IbPRIA.

[32]  Qian Chen,et al.  Tracking Iris Contour with a 3D Eye-Model for Gaze Estimation , 2007, ACCV.

[33]  Shaun J. Canavan,et al.  A Multi-Gesture Interaction System Using a 3-D Iris Disk Model for Gaze Estimation and an Active Appearance Model for 3-D Hand Pointing , 2011, IEEE Transactions on Multimedia.

[34]  Thai-Hoang Huynh,et al.  Eye-gaze detection with a single WebCAM based on geometry features extraction , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[35]  Nicu Sebe,et al.  Webcam-Based Visual Gaze Estimation , 2009, ICIAP.

[36]  Ioannis Patras,et al.  Gaze Tracking by Using Factorized Likelihoods Particle Filtering and Stereo Vision , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[37]  Michael Vaiman,et al.  Variations in Eyeball Diameters of the Healthy Adults , 2014, Journal of ophthalmology.

[38]  Lijun Yin,et al.  Viewing direction estimation based on 3D eyeball construction for HRI , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[39]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Peter Eisert,et al.  Model based 3D gaze estimation for provision of virtual eye contact , 2012, 2012 19th IEEE International Conference on Image Processing.

[41]  Steven K. Feiner,et al.  Gaze locking: passive eye contact detection for human-object interaction , 2013, UIST.

[42]  Karen M. Evans,et al.  Collecting and Analyzing Eye-Tracking Data in Outdoor Environments , 2012 .

[43]  Haibo Wang,et al.  Tracking Eye Gaze under Coordinated Head Rotations with an Ordinary Camera , 2009, ACCV.