Accurate Eye Center Localization via Hierarchical Adaptive Convolution

Eye center localization has been an active research topic for decades due to its important biological properties, which indicates human's visual focus of attention. However, accurate eye center localization still remains challenging due to the high degree appearance variation caused by different kinds of viewing angles, illumination conditions, occlusions and head pose. This paper proposes a hierarchical adaptive convolution method (HAC) to localize the eye center accurately while consuming low computational cost. It mainly utilizes the dramatic illumination changes between the iris and sclera. More specifically, novel hierarchical kernels are designed to convolute the eye images and a differential operation is applied on the adjacent convolution results to generate various response maps. The final eye center is localized by searching the maximum response value among the response maps. Experimental results on several publicly available datasets demonstrate that HAC outperforms the start-of-the-art methods by a large margin. The code is made publicly available at https://github.com/myopengit/HAC

[1]  Fernando De la Torre,et al.  Supervised Descent Method and Its Applications to Face Alignment , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Erhardt Barth,et al.  Accurate Eye Centre Localisation by Means of Gradients , 2011, VISAPP.

[3]  Sanghoon Kim,et al.  Multi-Scale Gabor Feature Based Eye Localization , 2007 .

[4]  Aurobinda Routray,et al.  Fast and accurate algorithm for eye localisation for gaze tracking in low-resolution images , 2016, IET Comput. Vis..

[5]  Igor S. Pandzic,et al.  Eye pupil localization with an ensemble of randomized trees , 2014, Pattern Recognit..

[6]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[7]  Imran Usman,et al.  A non-circular iris localization algorithm using image projection function and gray level statistics , 2013 .

[8]  Ashok A. Ghatol,et al.  Iris recognition: an emerging biometric technology , 2007 .

[9]  Alexander Zelinsky,et al.  Fast Radial Symmetry for Detecting Points of Interest , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  John Daugman,et al.  High Confidence Visual Recognition of Persons by a Test of Statistical Independence , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Qinmu Peng,et al.  Eye Gaze Tracking With a Web Camera in a Desktop Environment , 2015, IEEE Transactions on Human-Machine Systems.

[12]  Honghai Liu,et al.  Visual Focus of Attention Estimation Using Eye Center Localization , 2017, IEEE Systems Journal.

[13]  Qiang Ji,et al.  Learning the Deep Features for Eye Detection in Uncontrolled Conditions , 2014, 2014 22nd International Conference on Pattern Recognition.

[14]  Xiaoming Liu,et al.  Large-Pose Face Alignment via CNN-Based Dense 3D Model Fitting , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Alan Hanjalic,et al.  Eye localization for face matching: is it always useful and under what conditions? , 2008, CIVR '08.

[16]  Fernando De la Torre,et al.  Driver Gaze Tracking and Eyes Off the Road Detection System , 2015, IEEE Transactions on Intelligent Transportation Systems.

[17]  Klaus J. Kirchberg,et al.  Robust Face Detection Using the Hausdorff Distance , 2001, AVBPA.

[18]  Theo Gevers,et al.  Accurate Eye Center Location through Invariant Isocentric Patterns , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Gabriel M. Araujo,et al.  Weak Classifier for Density Estimation in Eye Localization and Tracking , 2017, IEEE Transactions on Image Processing.

[20]  Andreas Bulling,et al.  EyeTab: model-based gaze estimation on unmodified tablet computers , 2014, ETRA.

[21]  J. Shanbehzadeh,et al.  Automatic Adaptive Center of Pupil Detection Using Face Detection and CDF Analysis , 2010 .

[22]  Sung-Jea Ko,et al.  Eyeball model-based iris center localization for visible image-based eye-gaze tracking systems , 2013, IEEE Transactions on Consumer Electronics.

[23]  Paola Campadelli,et al.  Precise Eye Localization through a General-to-specific Model Definition , 2006, BMVC.

[24]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Nikos Fakotakis,et al.  Precise localization of eye centers in low resolution color images , 2015, Image Vis. Comput..

[26]  Qiang Ji,et al.  A joint cascaded framework for simultaneous eye detection and eye state estimation , 2017, Pattern Recognit..

[27]  Larry S. Davis,et al.  Model-based object pose in 25 lines of code , 1992, International Journal of Computer Vision.

[28]  Patrick J. Flynn,et al.  Image understanding for iris biometrics: A survey , 2008, Comput. Vis. Image Underst..

[29]  Rafael Cabeza,et al.  Hybrid method based on topography for robust detection of iris center and eye corners , 2013, TOMCCAP.