Monitoring Human Faces from Multi-view Image Sequences

The paper proposes a vision-based monitoring of human faces based on the automatic pose-invariant face detection and generation of detailed parametric descriptions of dynamic changes of face mimics. The monitoring approach involves the extraction and the classification of face features. The approach is designed especially for the monitoring of faces which captured directly during the Human Computer Interaction. The use of multi-view images provides sufficient information for the automatic head pose estimation and face mimic changes. The results of the automatic facial image analysis are described by the so-called Face Mimic Graph. The Face Mimic Graph provides the quantitative and qualitative information of face mimic changes captured during the face monitoring.

[1]  Zheng Zhang Feature-Based Facial Expression Recognition: Experiments With a Multi-Layer Perceptron , 1998 .

[2]  Heinrich Niemann,et al.  System zur Diagnoseunterstützung von Patienten mit Gesichtslähmungen , 2000, Bildverarbeitung für die Medizin.

[3]  Alex Pentland,et al.  Coding, Analysis, Interpretation, and Recognition of Facial Expressions , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Takeo Kanade,et al.  Automated facial expression recognition based on FACS action units , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[5]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Timothy F. Cootes,et al.  Automatic Interpretation and Coding of Face Images Using Flexible Models , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  A. Wierzbicka Emotions Across Languages And Cultures , 1999 .

[8]  S. Lanser,et al.  A modification of Deriche's approach to edge detection , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol. III. Conference C: Image, Speech and Signal Analysis,.

[9]  Takeo Kanade,et al.  Detection, tracking, and classification of action units in facial expression , 2000, Robotics Auton. Syst..