Detection and tracking of eyes for gaze-camera control

Abstract A head-off gaze-camera needs eye location information for head-free usage. For this purpose, we propose new algorithms to extract and track the positions of eyes in a real-time video stream. For extraction of eye positions, we detect blinks based on the differences between successive images. However, eyelid regions are fairly small. To distinguish them from dominant head movement, we elaborate a head movement cancellation process. For eye-position tracking, we use a template of ‘Between-the-Eyes,’ which is updated frame-by-frame, instead of the eyes themselves. Eyes are searched based on the current position of ‘Between-the-Eyes’ and their geometrical relations to the position in the previous frame. The ‘Between-the-Eyes’ pattern is easier to locate accurately than eye patterns. We implemented the system on a PC with a Pentium III 866-MHz CPU. The system runs at 30 frames/s and robustly detects and tracks the eyes.

[1]  Shinjiro Kawato,et al.  Real-time detection of nodding and head-shaking by directly detecting and tracking the "between-eyes" , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[2]  Margrit Betke,et al.  Communication via eye blinks - detection and duration analysis in real time , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  Takeo Kanade,et al.  Dual-state parametric eye tracking , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[4]  C. Colombo,et al.  Human-computer interaction based on eye movement tracking , 1995, Proceedings of Conference on Computer Architectures for Machine Perception.

[5]  M. Eriksson,et al.  Eye-tracking for detection of driver fatigue , 1997, Proceedings of Conference on Intelligent Transportation Systems.

[6]  Pong C. Yuen,et al.  Multi-cues eye detection on gray intensity image , 2001, Pattern Recognit..

[7]  Amarnag Subramanya,et al.  Real time eye tracking for human computer interfaces , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[8]  Alexander Zelinsky,et al.  An algorithm for real-time stereo vision implementation of head pose and gaze direction measurement , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[9]  James L. Crowley,et al.  Multi-modal tracking of faces for video communications , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Azriel Rosenfeld,et al.  Eye detection in a face image using linear and nonlinear filters , 2001, Pattern Recognit..

[11]  Fatih Kurugollu,et al.  A comparison of visual target tracking methods in noisy environments , 1995, Proceedings of IECON '95 - 21st Annual Conference on IEEE Industrial Electronics.

[12]  Carlos Hitoshi Morimoto,et al.  Pupil detection and tracking using multiple light sources , 2000, Image Vis. Comput..

[13]  Andrew Beng Jin Teoh,et al.  Eye detection using hybrid rule based approach and contour mapping , 2001, Proceedings of the Sixth International Symposium on Signal Processing and its Applications (Cat.No.01EX467).

[14]  Shinjiro Kawato,et al.  Just blink your eyes: a head-free gaze tracking system , 2003, CHI Extended Abstracts.

[15]  Mohamed Rizon,et al.  Detection of eyes from human faces by Hough transform and separability filter , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[16]  Olivier Faugeras,et al.  3D Dynamic Scene Analysis: A Stereo Based Approach , 1992 .

[17]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..