Detection of face position and 3D orientation in 2D image

This paper is focused on using headtracking for determination of the 3D orientation of head from 2D frame as a supplement lip-reading method. The task is proposed for determination of position and rotation of the driver1⁄4s (speaker1⁄4s) head during the speech. We divided the article to three parts. First we describe a module of automatic determination of the head shape in the image. The second part contains the localization of important points in the area of head. Finally we present the determination of the 3D orientation and scale and compare the results of our algorithm and a real measurement.

[1]  Mubarak Shah,et al.  Monitoring head/eye motion for driver alertness with one camera , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[2]  Richard I. Hartley,et al.  In defence of the 8-point algorithm , 1995, Proceedings of IEEE International Conference on Computer Vision.

[3]  Tomaso A. Poggio,et al.  Example-Based Learning for View-Based Human Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Tzong-Jer Yang,et al.  Real-time 3-D head motion estimation in facial image coding , 1998, Proceedings 1998 MultiMedia Modeling. MMM'98 (Cat. No.98EX200).

[5]  John R. Kender,et al.  Finding skin in color images , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[6]  J. F. Guitarte Low Resource Lip Finding and Tracking Algorithm for Embedded Devices , 2003 .

[7]  Alexander H. Waibel,et al.  Skin-Color Modeling and Adaptation , 1998, ACCV.