A local and scale integrated feature descriptor in eye-gaze tracking

Eye-gaze tracking technology provides us with an unconventional way of Human Computer Interaction, and brings a lot of convenience with many practical applications and industrial products. The main focus of eye-gaze tracking is to calculate the model of gaze directions and the gaze coordinates. Based on computer vision, the key problem in the modeling process is the feature description. In this paper, a new descriptor, Local and Scale Integrated Feature (LoSIF) is proposed to extract eye-gaze movement features based on non-intrusive system, allowing slight head movements. The feature descriptor depends on two-level Haar wavelet transform, and carries on a combination of multi-resolution characteristics and effective dimension reduction algorithm, to achieve local and scale eye movement characterization. We use Support Vector Regression to estimate the mapping function between the appearance of the eyes and the corresponding gaze directions. As the experiment results show, the accuracy is within an acceptable range of 1 degree.

[1]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  John Paulin Hansen,et al.  Evaluation of a low-cost open-source gaze tracker , 2010, ETRA.

[3]  Klaus Bartl,et al.  Mobile eye tracking as a basis for real-time control of a gaze driven head-mounted video camera , 2006, ETRA '06.

[4]  Hongzhi Ge Gabor Directional Binary Pattern: An Image Descriptor for Gaze Estimation , 2010, EURASIP J. Adv. Signal Process..

[5]  Moshe Eizenman,et al.  An Automatic Personal Calibration Procedure for Advanced Gaze Estimation Systems , 2010, IEEE Transactions on Biomedical Engineering.

[6]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[7]  Zhiwei Zhu,et al.  Novel Eye Gaze Tracking Techniques Under Natural Head Movement , 2007, IEEE Transactions on Biomedical Engineering.

[8]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Mads Nielsen,et al.  Eye typing using Markov and active appearance models , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[11]  Carlos Hitoshi Morimoto,et al.  Free head motion eye gaze tracking using a single camera and multiple light sources , 2006, 2006 19th Brazilian Symposium on Computer Graphics and Image Processing.

[12]  Huchuan Lu,et al.  Gaze tracking by Binocular Vision and LBP features , 2008, 2008 19th International Conference on Pattern Recognition.