In this paper we present a non-intrusive model-based gaze tracking system. The system estimates the 3D pose of a user's head by tracking as few as six facial feature points. The system locates a human face using a statistical color model without any mark on the face and then traces the facial features, such as eyes, nostrils and lip corners. A full perspective model is employed to map these feature points onto the 3D pose. Several techniques have been developed to track the features points and recover from failure. We currently achieve a frame rate of 15+ frames per second using an HP 9000 workstation with a frame grabber and a Canon VC-C1 camera. The application of the system has been demonstrated by a gaze-driven panorama image viewer. The potential applications of the system include multimodal interfaces, virtual reality and video-teleconferencing.
[1]
Takeo Kanade,et al.
Real-time 3-D pose estimation using a high-speed range sensor
,
1993,
Proceedings of the 1994 IEEE International Conference on Robotics and Automation.
[2]
Roberto Cipolla,et al.
Fast visual tracking by temporal consensus
,
1996,
Image Vis. Comput..
[3]
Alex Waibel,et al.
Tracking Human Faces in Real-Time,
,
1995
.
[4]
Larry S. Davis,et al.
Model-Based Object Pose in 25 Lines of Code
,
1992,
ECCV.
[5]
Roberto Brunelli,et al.
Face Recognition: Features Versus Templates
,
1993,
IEEE Trans. Pattern Anal. Mach. Intell..
[6]
Shumeet Baluja,et al.
Non-Intrusive Gaze Tracking Using Artificial Neural Networks
,
1993,
NIPS.
[7]
Roberto Cipolla,et al.
Non-intrusive gaze tracking for human-computer interaction
,
1994
.