论文信息 - Robust Real-Time Face Tracking and Gesture Recognition

Robust Real-Time Face Tracking and Gesture Recognition

People natural ly express themselves through facial gestures. We have implemented an interface that tracks a person's facial features robustly in real t ime (30Hz) and does not require art i f icial artifacts such as special i l lumination or facial makeup. Even if features become occluded the system is capable of recovering tracking in a couple of frames after the features reappear in the image. Based on this fault tolerant face tracker we have implemented realt ime gesture recognition capable of distinguish 12 different gestures ranging from "yes", "no" and "may be" to winks, blinks and "asleep".

Alexander Zelinsky | J. Heizmann | A. Zelinsky | J. Heizmann

[1] Christoph von der Malsburg,et al. Tracking and learning graphs and pose on image sequences of faces , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[2] Ian D. Reid,et al. Recursive Affine Structure and Motion from Image Sequences , 1994, ECCV.

[3] Roberto Cipolla,et al. Non-intrusive gaze tracking for human-computer interaction , 1994 .

[4] Alexandros Eleftheriadis,et al. Automatic Location Tracking of Faces and Facial Features in Video Sequences , 1995 .

[5] Gregory D. Hager,et al. X Vision: Combining Image Warping and Geometric Constraints for Fast Visual Tracking , 1996, ECCV.

[6] Michael J. Black,et al. Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion , 1995, Proceedings of IEEE International Conference on Computer Vision.

[7] A. Pentland,et al. Attention-driven Expression and Gesture Analysis in an Interactive Environment , 1995 .

[8] Alex Pentland,et al. Visually Controlled Graphics , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[9] Gregory D. Hager,et al. A Framework for Real-time Window-Based Tracking Using Off-The-Shelf Hardware , 1994 .

[10] S. M. Bozic. Digital and Kalman filtering , 1979 .