Eyegaze Detection from Monocular Camera Image for Eyegaze Communication System

An eyegaze interface is one of the key technologies as an input device in the ubiquitous-computing society. In particular, an eyegaze communication system is very important and useful for severely handicapped users such as quadriplegic patients. Most of the conventional eyegaze tracking algorithms require specific light sources, equipment and devices. In this study, a simple eyegaze detection algorithm is proposed using a single monocular video camera. The proposed algorithm works under the condition of fixed head pose, but slight movement of the face is accepted. In our system, we assume that all users have the same eyeball size based on physiological eyeball models. However, we succeed to calibrate the physiologic movement of the eyeball center depending on the gazing direction by approximating it as a change in the eyeball radius. In the gaze detection stage, the iris is extracted from a captured face frame by using the Hough transform. Then, the eyegaze angle is derived by calculating the Euclidean distance of the iris centers between the extracted frame and a reference frame captured in the calibration process. We apply our system to an eyegaze communication interface, and verified the performance through key typing experiments with a visual keyboard on display.

[1]  James Gips,et al.  Direct Control of the Computer Through Electrodes Placed Around the Eyes , 1993, HCI.

[2]  Alexander Zelinsky,et al.  An algorithm for real-time stereo vision implementation of head pose and gaze direction measurement , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[3]  Shumin Zhai,et al.  Manual and gaze input cascaded (MAGIC) pointing , 1999, CHI '99.

[4]  Zakia Hammal,et al.  Eyes Segmentation Applied to Gaze Direction and Vigilance Estimation , 2005, ICAPR.

[5]  R. D. Watkins,et al.  THE OPTICAL SYSTEM OF THE EYE , 1970 .

[6]  H D Crane,et al.  Accurate two-dimensional eye tracker using first and fourth Purkinje images. , 1973, Journal of the Optical Society of America.

[7]  Shinjiro Kawato,et al.  Gaze Direction Estimation with a Single Camera Based on Four Reference Points and Three Calibration Images , 2006, ACCV.

[8]  Francis Heed Adler,et al.  Adler's Physiology of the eye;: Clinical application , 1976 .

[9]  Jin Liu,et al.  Eye and gaze tracking for visually controlled interactive stereoscopic displays , 1999, Signal Process. Image Commun..

[10]  Shinjiro Kawato,et al.  Just blink your eyes: a head-free gaze tracking system , 2003, CHI Extended Abstracts.

[11]  Iain Matthews,et al.  Passive Driver Gaze Tracking with Active Appearance Models (特集 センシング技術) , 2004 .

[12]  Laurent Bonnaud,et al.  Gaze direction estimation tool based on head motion analysis or iris position estimation , 2005, 2005 13th European Signal Processing Conference.

[13]  Jian-Gang Wang,et al.  Gaze determination via images of irises , 2001, Image Vis. Comput..