Perceptual user interfaces using vision-based eye tracking

We present a multi-camera vision-based eye tracking method to robustly locate and track user's eyes as they interact with an application. We propose enhancements to various vision-based eye-tracking approaches, which include (a) the use of multiple cameras to estimate head pose and increase coverage of the sensors and (b) the use of probabilistic measures incorporating Fisher's linear discriminant to robustly track the eyes under varying lighting conditions in real-time. We present experiments and quantitative results to demonstrate the robustness of our eye tracking in two application prototypes.

[1]  Alexander Zelinsky,et al.  Behavior recognition based on head pose and gaze direction measurement , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[2]  M. Argyle,et al.  Gaze and Mutual Gaze , 1994, British Journal of Psychiatry.

[3]  D. Legge,et al.  Perception and Information. , 1976 .

[4]  Marco La Cascia,et al.  Fast, reliable head tracking under varying illumination , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[5]  Roel Vertegaal,et al.  Establishing remote conversations through eye contact with physical awareness proxies , 2003, CHI Extended Abstracts.

[6]  Elizabeth D. Mynatt,et al.  Digital family portraits: supporting peace of mind for extended family members , 2001, CHI.

[7]  Irfan Essa,et al.  Head Tracking Using a Textured Polygonal Model , 1998 .

[8]  Aulikki Hyrskykari,et al.  101 spots, or how do users read menus? , 1998, CHI.

[9]  Allen Allport,et al.  Visual attention , 1989 .

[10]  Elizabeth D. Mynatt,et al.  Cook’s Collage: Two Exploratory Designs , 2001 .

[11]  A. L. Yarbus.  Eye Movements During Perception of Complex Objects , 1967 .

[12]  Gregory D. Abowd,et al.  The Family Intercom: Developing a Context-Aware Audio Communication System , 2001, UbiComp.

[13]  Carlos Hitoshi Morimoto,et al.  Pupil detection and tracking using multiple light sources , 2000, Image Vis. Comput..

[14]  Irfan Essa,et al.  Fast Multiple Camera Head Pose Tracking , 2003 .

[15]  M. Argyle.  Social interactions. , 1976, Science.

[16]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[17]  Irfan A. Essa,et al.  Detecting and tracking eyes by using their physiological properties, dynamics, and appearance , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[18]  Joseph H. Goldberg,et al.  Eye-gaze determination of user intent at the computer interface , 1993 .

[19]  Trevor Darrell,et al.  3D pose tracking with linear depth and brightness constraints , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[20]  Rainer Stiefelhagen,et al.  Tracking focus of attention in meetings , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.