3D head pose estimation without feature tracking

We present a robust approach to estimate the 3D pose of human heads in a single image. In contrast with other research, this method only makes use of the information about the skin region and the hair region of heads. At first, we use an efficient algorithm based on a perceptually uniform color system and fuzzy theory to extract the skin region and hair region, which are then used to detect faces in images. After that, the areas, the centers, and the axis of the least inertia both of the skin region and the hair region are calculated, which are then used to estimate the 3D pose of the head. We tested our method by estimating the 3D pose of a head from live video sequences. The three angles describing the three rotation elements of a head about X, Y and Z axes are extracted from each frame of the image sequence, which are then sent to a program that generates CG animations of a synthesized head in the estimated pose.

[1]  Haiyuan Wu,et al.  A fuzzy-theory-based face detector , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[2]  Hans Peter Graf,et al.  Robust face feature analysis for automatic speechreading and character animation , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[3]  Larry S. Davis,et al.  Computing 3-D head orientation from a monocular image sequence , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[4]  Christoph von der Malsburg,et al.  Tracking and learning graphs and pose on image sequences of faces , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[5]  Martlesham Heath,et al.  Real-Time Facial Motion Analysis for Virtual , 1996 .

[6]  David Machin,et al.  Real-time facial motion analysis for virtual teleconferencing , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[7]  Qian Chen,et al.  Active face observation system , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[8]  Alexander Zelinsky,et al.  Real-time visual recognition of facial gestures for human-computer interaction , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[9]  Qian Chen,et al.  Face detection by fuzzy pattern matching , 1995, Proceedings of IEEE International Conference on Computer Vision.

[10]  Yasuhito Suenaga,et al.  Headreader: Realtime motion detection of human head from image sequence , 1992, Systems and Computers in Japan.