Visual Focus of Attention Estimation Using Eye Center Localization

Estimating people visual focus of attention (VFOA) plays a crucial role in various practical systems such as human–robot interaction. It is challenging to extract the cue of the VFOA of a person due to the difficulty of recognizing gaze directionality. In this paper, we propose an improved integrodifferential approach to represent gaze via efficiently and accurately localizing the eye center in lower resolution image. The proposed method takes advantage of the drastic intensity changes between the iris and the sclera and the grayscale of the eye center as well. The number of kernels is optimized to convolute the original eye region image, and the eye center is located via searching the maximum ratio derivative of the neighbor curve magnitudes in the convolution image. Experimental results confirm that the algorithm outperforms the state-of-the-art methods in terms of computational cost, accuracy, and robustness to illumination changes.

[1]  Alexander H. Waibel,et al.  From Gaze to Focus of Attention , 1999, VISUAL.

[2]  Honghai Liu,et al.  Human Hand Motion Analysis With Multisensory Information , 2014, IEEE/ASME Transactions on Mechatronics.

[3]  Mehmet Türkan,et al.  Human eye localization using edge projections , 2007, VISAPP.

[4]  Rodney A. Brooks,et al.  Prospects for Human Level Intelligence for Humanoid Robots , 1998 .

[5]  Patrick J. Flynn,et al.  Image understanding for iris biometrics: A survey , 2008, Comput. Vis. Image Underst..

[6]  Klaus J. Kirchberg,et al.  Robust Face Detection Using the Hausdorff Distance , 2001, AVBPA.

[7]  I. Pitas,et al.  An Eye Detection Algorithm Using Pixel to Edge Information , 2005 .

[8]  John Daugman,et al.  The importance of being random: statistical principles of iris recognition , 2003, Pattern Recognit..

[9]  Wen Gao,et al.  2D Cascaded AdaBoost for Eye Localization , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[10]  Paola Campadelli,et al.  Precise Eye Localization through a General-to-specific Model Definition , 2006, BMVC.

[11]  Jean-Marc Odobez,et al.  Tracking the Visual Focus of Attention for a Varying Number of Wandering People , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[14]  Nicholas L. Cassimatis,et al.  A Cognitive Substrate for Achieving Human-Level Intelligence , 2006, AI Mag..

[15]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[16]  Björn W. Schuller,et al.  Context-Sensitive Learning for Enhanced Audiovisual Emotion Classification , 2012, IEEE Transactions on Affective Computing.

[17]  Timothy F. Cootes,et al.  A Multi-Stage Approach to Facial Feature Detection , 2004, BMVC.

[18]  Tanja Schultz,et al.  Identifying the addressee in human-human-robot interactions based on head pose and speech , 2004, ICMI '04.

[19]  J. Gregory Trafton,et al.  Integrating cognition, perception and action through mental simulation in robots , 2004, Robotics Auton. Syst..

[20]  J. Shanbehzadeh,et al.  Automatic Adaptive Center of Pupil Detection Using Face Detection and CDF Analysis , 2010 .

[21]  Alan Hanjalic,et al.  Eye localization for face matching: is it always useful and under what conditions? , 2008, CIVR '08.

[22]  Yehezkel Yeshurun,et al.  Context-free attentional operators: The generalized symmetry transform , 1995, International Journal of Computer Vision.

[23]  Imran Usman,et al.  A non-circular iris localization algorithm using image projection function and gray level statistics , 2013 .

[24]  Roel Vertegaal,et al.  Using social geometry to manage interruptions and co-worker attention in office environments , 2005, Graphics Interface.

[25]  N. Sudha,et al.  Efficient segmentation technique for noisy frontal view iris images using Fourier spectral density , 2011, Signal Image Video Process..

[26]  Theo Gevers,et al.  Accurate eye center location and tracking using isophote curvature , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Erhardt Barth,et al.  Accurate Eye Centre Localisation by Means of Gradients , 2011, VISAPP.

[28]  Honghai Liu,et al.  Exploring Human Hand Capabilities Into Embedded Multifingered Object Manipulation , 2011, IEEE Transactions on Industrial Informatics.

[29]  John Daugman,et al.  High Confidence Visual Recognition of Persons by a Test of Statistical Independence , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Theo Gevers,et al.  Accurate Eye Center Location through Invariant Isocentric Patterns , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Jiri Matas,et al.  Feature-based affine-invariant localization of faces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Igor S. Pandzic,et al.  Eye pupil localization with an ensemble of randomized trees , 2014, Pattern Recognit..

[33]  LinLin Shen,et al.  A Novel Eye Location Algorithm based on Radial Symmetry Transform , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[34]  Sanghoon Kim,et al.  Multi-Scale Gabor Feature Based Eye Localization , 2007 .